-- Logs begin at Wed 2022-06-22 09:26:26 UTC, end at Wed 2022-06-22 10:33:51 UTC. -- Jun 22 10:07:13.855883 dv-cinder-847131-1-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jun 22 10:07:13.863738 dv-cinder-847131-1-iscsi devstack@n-api.service[103373]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jun 22 10:07:13.865716 dv-cinder-847131-1-iscsi devstack@n-api.service[103373]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Jun 22 10:07:13 2022] *** Jun 22 10:07:13.867659 dv-cinder-847131-1-iscsi devstack@n-api.service[103373]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jun 22 10:07:13.867659 dv-cinder-847131-1-iscsi devstack@n-api.service[103373]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jun 22 10:07:13.867659 dv-cinder-847131-1-iscsi devstack@n-api.service[103373]: nodename: dv-cinder-847131-1-iscsi Jun 22 10:07:13.867659 dv-cinder-847131-1-iscsi devstack@n-api.service[103373]: machine: x86_64 Jun 22 10:07:13.867659 dv-cinder-847131-1-iscsi devstack@n-api.service[103373]: clock source: unix Jun 22 10:07:13.867659 dv-cinder-847131-1-iscsi devstack@n-api.service[103373]: pcre jit disabled Jun 22 10:07:13.867659 dv-cinder-847131-1-iscsi devstack@n-api.service[103373]: detected number of CPU cores: 4 Jun 22 10:07:13.867659 dv-cinder-847131-1-iscsi devstack@n-api.service[103373]: current working directory: / Jun 22 10:07:13.867659 dv-cinder-847131-1-iscsi devstack@n-api.service[103373]: detected binary path: /usr/bin/uwsgi-core Jun 22 10:07:13.867659 dv-cinder-847131-1-iscsi devstack@n-api.service[103373]: your processes number limit is 47680 Jun 22 10:07:13.867659 dv-cinder-847131-1-iscsi devstack@n-api.service[103373]: your memory page size is 4096 bytes Jun 22 10:07:13.867659 dv-cinder-847131-1-iscsi devstack@n-api.service[103373]: detected max file descriptor number: 2048 Jun 22 10:07:13.867659 dv-cinder-847131-1-iscsi devstack@n-api.service[103373]: lock engine: pthread robust mutexes Jun 22 10:07:13.867659 dv-cinder-847131-1-iscsi devstack@n-api.service[103373]: thunder lock: enabled Jun 22 10:07:13.867659 dv-cinder-847131-1-iscsi devstack@n-api.service[103373]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jun 22 10:07:13.867659 dv-cinder-847131-1-iscsi devstack@n-api.service[103373]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jun 22 10:07:13.911786 dv-cinder-847131-1-iscsi devstack@n-api.service[103373]: Python main interpreter initialized at 0x559f750349c0 Jun 22 10:07:13.911786 dv-cinder-847131-1-iscsi devstack@n-api.service[103373]: python threads support enabled Jun 22 10:07:13.911786 dv-cinder-847131-1-iscsi devstack@n-api.service[103373]: your server socket listen backlog is limited to 100 connections Jun 22 10:07:13.911786 dv-cinder-847131-1-iscsi devstack@n-api.service[103373]: your mercy for graceful operations on workers is 90 seconds Jun 22 10:07:13.912140 dv-cinder-847131-1-iscsi devstack@n-api.service[103373]: mapped 403077 bytes (393 KB) for 2 cores Jun 22 10:07:13.912213 dv-cinder-847131-1-iscsi devstack@n-api.service[103373]: *** Operational MODE: preforking *** Jun 22 10:07:13.912461 dv-cinder-847131-1-iscsi devstack@n-api.service[103373]: *** uWSGI is running in multiple interpreter mode *** Jun 22 10:07:13.912461 dv-cinder-847131-1-iscsi devstack@n-api.service[103373]: spawned uWSGI master process (pid: 103373) Jun 22 10:07:13.912665 dv-cinder-847131-1-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jun 22 10:07:13.917719 dv-cinder-847131-1-iscsi devstack@n-api.service[103373]: spawned uWSGI worker 1 (pid: 103374, cores: 1) Jun 22 10:07:13.917719 dv-cinder-847131-1-iscsi devstack@n-api.service[103373]: spawned uWSGI worker 2 (pid: 103375, cores: 1) Jun 22 10:07:13.917719 dv-cinder-847131-1-iscsi devstack@n-api.service[103373]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jun 22 10:07:14.583187 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 22 10:07:14.593199 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 22 10:07:15.733107 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 22 10:07:15.733107 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: from cryptography.utils import int_from_bytes Jun 22 10:07:15.733729 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 22 10:07:15.733729 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: from cryptography.utils import int_from_bytes Jun 22 10:07:15.743858 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 22 10:07:15.743858 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: from cryptography.utils import int_from_bytes Jun 22 10:07:15.744303 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 22 10:07:15.744303 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: from cryptography.utils import int_from_bytes Jun 22 10:07:18.293891 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 22 10:07:18.294458 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 22 10:07:18.294734 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 22 10:07:18.295039 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 22 10:07:18.295295 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 22 10:07:18.295684 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:07:18.296009 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:07:18.296335 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:07:18.296656 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:07:18.296992 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:07:18.297303 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:07:18.297625 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:07:18.297976 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:07:18.298306 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:07:18.298567 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:07:18.298790 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 22 10:07:18.299180 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:07:18.299270 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 22 10:07:18.299351 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-847131-1-iscsi {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:07:18.299509 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:07:18.299605 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 22 10:07:18.299816 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:07:18.299924 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 22 10:07:18.300128 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:07:18.300215 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 22 10:07:18.300447 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:07:18.300541 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:07:18.300753 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:07:18.300846 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:07:18.301075 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:07:18.301160 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:07:18.301381 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:07:18.301467 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:07:18.301802 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:07:18.301912 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:07:18.302111 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:07:18.302369 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:07:18.302481 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:07:18.302681 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:07:18.302779 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:07:18.303002 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:07:18.303104 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:07:18.303302 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:07:18.303545 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:07:18.303644 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:07:18.303724 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:07:18.303931 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-847131-1-iscsi {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:07:18.304043 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:07:18.304253 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:07:18.304363 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:07:18.304555 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:07:18.304641 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:07:18.304867 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:07:18.304952 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:07:18.305175 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:07:18.305269 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:07:18.305477 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:07:18.305570 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-847131-1-iscsi {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:07:18.305824 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:07:18.305927 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:07:18.306135 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:07:18.306232 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:07:18.306533 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:07:18.306631 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:07:18.306948 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:07:18.307046 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:07:18.307234 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:07:18.307380 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:07:18.307543 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:07:18.307630 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:07:18.307870 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:07:18.307967 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:07:18.308182 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:07:18.308922 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:07:18.309234 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:07:18.309411 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:07:18.309596 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:07:18.309759 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:07:18.309969 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:07:18.310079 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:07:18.310293 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:07:18.310434 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:07:18.310629 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:07:18.310771 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:07:18.310942 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:07:18.311039 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:07:18.311281 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:07:18.311367 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-847131-1-iscsi {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:07:18.311603 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:07:18.311704 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:07:18.311913 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:07:18.312001 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:07:18.312223 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:07:18.312320 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:07:18.312475 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:07:18.312667 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:07:18.312786 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:07:18.312982 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:07:18.313116 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:07:18.313291 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:07:18.313439 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:07:18.313614 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:07:18.313789 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:07:18.313977 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:07:18.314064 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:07:18.314287 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:07:18.314432 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:07:18.314609 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:07:18.314720 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:07:18.314930 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:07:18.315035 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:07:18.315239 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:07:18.315349 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:07:18.315549 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:07:18.315653 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:07:18.315852 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:07:18.315947 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:07:18.316158 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:07:18.316258 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:07:18.316466 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:07:18.316555 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:07:18.316774 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:07:18.316860 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:07:18.317081 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:07:18.317186 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:07:18.317385 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:07:18.317470 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:07:18.317635 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:07:18.317783 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:07:18.317972 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:07:18.318060 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:07:18.318295 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:07:18.318391 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:07:18.318620 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:07:18.318707 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:07:18.318945 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:07:18.319040 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:07:18.319198 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:07:18.319343 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.43 {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:07:18.319449 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:07:18.319597 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.43 {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:07:18.319768 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:07:18.319907 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:07:18.320091 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:07:18.320250 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:07:18.320436 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:07:18.320573 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:07:18.320706 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:07:18.320885 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:07:18.321013 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:07:18.321206 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:07:18.321309 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:07:18.321529 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:07:18.321645 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:07:18.321863 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:07:18.321979 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:07:18.322323 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:07:18.322480 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:07:18.322567 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:07:18.322645 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:07:18.322782 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:07:18.322868 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:07:18.323117 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:07:18.323211 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:07:18.323423 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:07:18.323510 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:07:18.323676 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:07:18.323771 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:07:18.324106 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:07:18.324423 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:07:18.324574 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:07:18.324748 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:07:18.325000 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.43 {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:07:18.325099 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:07:18.325259 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.43 {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:07:18.325348 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:07:18.325574 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:07:18.325662 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:07:18.325976 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:07:18.326084 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:07:18.326264 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:07:18.326412 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:07:18.326572 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:07:18.326704 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:07:18.326881 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:07:18.327033 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:07:18.327257 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:07:18.327395 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:07:18.327531 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:07:18.327662 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:07:18.327795 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:07:18.327928 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:07:18.328069 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:07:18.328219 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:07:18.328358 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:07:18.328494 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:07:18.328650 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:07:18.328783 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:07:18.328967 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:07:18.329105 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:07:18.329238 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:07:18.329369 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:07:18.329502 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:07:18.329644 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:07:18.329829 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:07:18.329969 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:07:18.330142 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:07:18.330280 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:07:18.330451 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:07:18.330592 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:07:18.330742 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:07:18.330914 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:07:18.331049 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:07:18.331225 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:07:18.331351 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:07:18.331536 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:07:18.331658 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:07:18.331861 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:07:18.331969 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:07:18.332170 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:07:18.332277 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:07:18.332478 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:07:18.332587 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:07:18.332799 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:07:18.332895 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:07:18.333115 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:07:18.333211 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:07:18.333424 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:07:18.333512 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:07:18.333770 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:07:18.333861 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:07:18.334076 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:07:18.334162 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:07:18.334386 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:07:18.334490 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:07:18.334709 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:07:18.334805 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:07:18.335016 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:07:18.335113 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:07:18.335321 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:07:18.335407 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:07:18.335623 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:07:18.335709 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:07:18.335926 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:07:18.336011 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:07:18.336231 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:07:18.336317 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:07:18.336538 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:07:18.336628 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:07:18.336843 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:07:18.336938 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:07:18.337150 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:07:18.337256 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:07:18.337454 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:07:18.337546 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:07:18.337782 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:07:18.337884 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:07:18.338107 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:07:18.338196 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:07:18.338417 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:07:18.338554 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:07:18.338725 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:07:18.338822 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:07:18.339034 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:07:18.339120 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:07:18.339336 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:07:18.339422 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:07:18.339707 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.340044 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.340130 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:07:18.340393 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.340486 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:07:18.340709 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:07:18.340802 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.341021 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:07:18.341107 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.341330 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:07:18.341423 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.341638 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:07:18.341756 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.341980 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:07:18.342067 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.342290 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:07:18.342376 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.342596 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:07:18.342691 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.342902 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:07:18.342990 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.343208 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:07:18.343294 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.343524 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.343611 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:07:18.343845 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:07:18.343930 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.344156 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:07:18.344243 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.344466 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:07:18.344556 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.344776 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:07:18.344873 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.345095 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.345182 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:07:18.345417 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.345506 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.345750 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.345842 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.346073 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.346159 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.346405 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.346532 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.346728 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.346823 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.347043 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.347154 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.347366 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.347497 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.347686 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.347772 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.348006 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.348094 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.348332 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.348420 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.348645 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.348731 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.348957 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.349054 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.349267 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.349353 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.349577 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.349676 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.349924 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.350022 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.350255 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.350350 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.350570 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.350917 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.351147 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.351239 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.351458 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.351551 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.351772 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.351860 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.352083 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.352246 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.352398 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.352486 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.352709 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.352804 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.353023 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.353109 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.353354 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.353439 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.353748 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.353843 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.354012 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.354110 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.354331 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.354418 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.354646 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.354732 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.354961 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.355059 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.355914 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.356113 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.356253 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.356421 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.356580 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.356730 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.356912 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.357042 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.357257 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.357353 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.357573 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.357669 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.357926 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.358013 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.358246 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.358355 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.358564 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.358651 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.358878 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.358971 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.359194 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.359296 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.359505 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.359593 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.359817 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.359904 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.360128 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.360230 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.360445 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.360532 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.360758 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.360843 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.361067 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.361161 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.361379 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.361466 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.361746 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.361838 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.362006 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.362094 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.362333 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.362421 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.362638 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.362723 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.362943 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.363037 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.363269 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.363356 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.363558 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.363644 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.363868 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.363955 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.364182 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.364269 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.364491 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.364585 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.364815 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.364903 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.365125 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.365222 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.365435 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.365535 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.365769 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.365871 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.366084 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.366184 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.366394 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.366494 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.366707 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.366801 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.367020 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.367107 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.367327 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.367422 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.367643 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.367729 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.367956 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.368044 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.368260 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.368355 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.368569 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.368655 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.368878 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.368972 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.369183 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.369269 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.369488 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.369574 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.369820 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.369961 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.370129 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.370226 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.370438 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.370526 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.371362 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.371669 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.371832 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.371984 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.372187 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.372295 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.372519 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.372608 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.372838 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.372934 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.373184 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.373271 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.373523 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.373617 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.373863 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.373952 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.374197 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.374283 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.374530 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.374626 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.374848 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.374936 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.375161 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.375282 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.375475 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.375591 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.375784 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.375888 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.376088 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.376185 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.376396 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.376503 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.376706 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.376818 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.377009 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.377115 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.377311 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.377400 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.377616 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.377820 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.377950 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.378041 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.378256 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.378352 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.378574 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.378661 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.378884 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.379032 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.379181 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.379325 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.379468 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.379609 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.379793 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.379952 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.380119 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.380252 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.380427 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.380571 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.380756 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.380904 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.381071 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.381203 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.381386 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.381530 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.381728 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.381839 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.382032 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.382120 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.382345 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.382439 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.382655 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.382817 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.382970 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.383056 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.383284 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.383371 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.383597 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.383692 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.383906 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.383999 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.384216 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.384303 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.384530 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.384631 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.384838 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.384930 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.385143 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.385248 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.385459 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.385552 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.385802 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.385893 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.386111 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.386197 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.386474 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.386578 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.387006 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.387196 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.387342 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.387539 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.387663 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.387862 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.387981 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.388189 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.388298 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.388508 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.388610 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.388827 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.388921 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.389141 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.389245 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.389455 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.389544 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.389799 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.389890 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.390116 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.390216 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.390424 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.390512 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.390737 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.390823 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.391048 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.391134 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.391355 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.391443 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.391663 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.391751 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.391978 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.392073 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.392302 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.392400 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.392610 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.392698 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.392924 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.393011 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.393252 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.393353 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.393594 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.393749 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.393900 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.394001 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.394213 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.394298 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.394532 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.394625 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.394842 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.394987 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.395149 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.395244 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.395456 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.395545 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.395762 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.395857 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.396071 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.396159 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.396385 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.396479 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.396702 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.396797 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.397019 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.397146 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.397331 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.397440 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.397638 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.397781 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.397979 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.398125 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.398288 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.398423 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.398594 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.398732 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.398885 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.399022 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.399199 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.399341 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.399523 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.399659 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.399836 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.399977 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.400148 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.400283 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.400464 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.400601 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.400769 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.400918 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.401076 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.401222 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.401394 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.401541 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.401735 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.401827 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.402071 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.402174 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.402612 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.402902 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.402996 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.403220 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.403571 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.403713 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.403887 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.403974 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.404202 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.404314 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.404519 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.404621 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.404843 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.404930 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.405158 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.405245 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.405476 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.405610 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.405828 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.405917 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.406142 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.406228 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.406468 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.406573 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.406785 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.406872 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.407100 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.407225 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.407414 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.407515 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.407727 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.407815 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.408047 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.408136 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.408348 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.408455 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.408657 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.408747 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.408966 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.409053 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.409272 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.409418 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.409581 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.409831 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.409926 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.410146 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.410309 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.410462 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.410541 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.410781 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.410920 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.411113 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.411364 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.411444 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.411708 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.411793 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.412030 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.412122 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.412336 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.412415 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.412647 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.412734 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.412959 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.413046 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.413295 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.413372 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.413612 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.413717 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.413987 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.414100 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.414294 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.414384 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.414610 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.414702 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.414921 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.415008 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.415228 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.415315 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.415539 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.415631 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.415848 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.415938 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.416156 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.416235 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.416463 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.416539 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.416775 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.416860 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.417080 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.417159 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.418123 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.418232 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.418348 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.418433 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.418722 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.419054 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.419227 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.419372 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.419685 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.419773 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.420003 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.420313 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.420401 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.420634 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.420895 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.420993 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.421242 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.421440 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.421550 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.421888 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.422082 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.422203 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.422510 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.422681 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.422824 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.423132 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.423228 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.423451 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.423765 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.423860 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.424076 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.424361 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.424457 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.424684 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.425001 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.425169 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.425480 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.425636 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.425884 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.426054 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.426202 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.426344 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.426509 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.426654 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.426811 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.426944 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.427032 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.427112 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.427450 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.427760 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.428074 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.428388 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.428484 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.428705 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.428794 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.429021 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.429122 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.429332 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.429422 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.429649 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.429988 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.430310 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.430500 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.430662 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.430814 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.430965 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.431130 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.431293 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.431432 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.431591 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.431742 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.431894 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.432046 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.432218 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.432371 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.432520 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.432664 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.432810 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.432960 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.433127 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.433362 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.434368 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.434706 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.435030 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.435346 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.435673 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.435991 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.436287 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.436554 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.436659 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.436967 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.437101 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.437450 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.437591 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.437791 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.438082 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.438190 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.438428 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.438672 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.438760 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.439045 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.439275 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.439374 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.439655 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.439943 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.440033 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.440260 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.440466 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.440754 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.440842 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.441207 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.441366 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.441549 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.441918 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.442010 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.442248 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.442504 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.442592 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.442887 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.442984 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.443205 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.443303 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.443535 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.443632 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.443858 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.444031 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.444172 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.444332 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.444483 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.444573 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.444793 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.444883 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.445100 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.445189 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.445410 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.445505 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.445739 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.445851 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.446070 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.446207 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.446384 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.446474 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.446696 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.446785 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.447005 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.447106 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.447316 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.447404 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.447639 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.447728 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.447954 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.448044 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.448272 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.448370 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.448587 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.448675 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.448940 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.449071 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.449366 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.449721 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.449814 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.450039 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.450141 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.450360 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.450450 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.450679 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.450769 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.451002 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.451125 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.451314 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.451404 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.451630 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.451720 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.451963 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.452059 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.452278 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.452381 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.452588 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.452676 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.452904 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.452991 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.453214 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.453311 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.453534 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.453622 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.453870 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.453960 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.454217 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.454317 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.454550 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.454642 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.454860 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.454956 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.455176 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.455275 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.455491 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.455579 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.455803 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.455891 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.456120 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.456211 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.456415 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.456519 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.456728 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.456817 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.457043 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.457133 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.457358 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.457468 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.457671 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.457867 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.458006 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.458188 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.458318 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.458501 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.458630 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.458814 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.458941 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.459131 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.459250 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.459462 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.459578 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.459775 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.459878 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.460085 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.460170 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.460397 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.460495 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.460725 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.460816 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.461037 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.461143 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.461362 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.461451 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.461811 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.461924 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.462129 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.462218 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.462441 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.462527 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.462751 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.462865 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.463065 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.463185 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.463380 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.463502 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.463700 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.463837 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.464327 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.464456 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.464567 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.464669 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.464805 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.465126 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.465296 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.465440 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.465634 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.465795 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.466004 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.466127 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.466334 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.466442 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.466652 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.466757 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.466970 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.467055 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.467287 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.467523 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.467668 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.467802 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.467935 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.468020 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.468218 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.468307 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.468530 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.468707 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.468860 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.469038 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.469238 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.469339 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.469492 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.469668 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.469944 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.470043 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.470262 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.470352 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.470574 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.470661 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.470913 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.471002 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.471222 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.471313 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.471533 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.471622 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.471863 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.471960 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.472174 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.472265 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.472489 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.472587 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.472803 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.472892 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.473115 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.473211 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.473426 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.473524 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.473753 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.473848 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.474086 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.474175 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.474394 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.474491 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.474714 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.474801 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.475025 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.475112 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.475353 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.475463 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.475931 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.476024 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.476241 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.476330 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.476567 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.476662 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.476879 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.476968 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.477196 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.477293 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.477507 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.477605 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.477841 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.477933 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.478190 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.478304 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.478500 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.478598 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.478826 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.478916 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.479134 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.479235 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.479444 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.479544 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.479750 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.479848 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.480597 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.480767 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.480951 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.481275 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.481427 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.481598 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.481800 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.481947 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.482055 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.482258 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.482379 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.482567 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.482694 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.482879 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.483012 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.483187 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.483341 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.483495 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.483655 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.483803 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.483985 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.484113 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.484305 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.484422 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.484634 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.484731 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.484961 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.485050 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.485272 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.485359 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.485601 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.485734 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.485944 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.486052 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.486255 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.486351 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.486564 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.486652 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.486871 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.486958 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.487176 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.487270 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.487511 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.487600 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.487822 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.487910 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.488154 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.488254 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.488476 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.488564 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.488788 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.488876 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.489119 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.489219 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.489434 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.489596 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.489774 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.489879 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.490097 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.490196 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.490425 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.490514 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.490735 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.490824 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.491042 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.491143 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.491354 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.491443 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.491661 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.491748 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.491967 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.492057 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.492274 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.492372 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.492590 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.492679 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.492895 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.492985 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.493199 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.493288 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.493504 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.493809 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.493916 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.494145 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.494234 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.494464 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.494551 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.494776 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.494872 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.495083 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.495180 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.495390 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.495491 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.495723 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.496499 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.496766 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.497099 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.497216 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.497421 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.497524 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.497772 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.497893 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.498118 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.498209 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.498449 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.498548 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.498781 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.498870 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.499125 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.499213 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.499450 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.499549 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.499772 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.499865 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.500091 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.500186 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.500409 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.500498 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.500728 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.500815 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.501049 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.501138 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.501369 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.501467 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.501707 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.501810 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.502023 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.502120 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.502340 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.502428 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.502655 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.502742 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.502968 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.503065 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.503285 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.503530 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.503627 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.503863 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.503961 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.504181 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.504277 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.504496 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.504584 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.504812 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.504909 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.505130 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.505221 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.505448 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.505537 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.505782 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.505888 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.506098 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.506186 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.506411 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.506501 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.506724 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.506862 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.507056 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.507246 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.507381 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.507571 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.507710 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.507910 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.508045 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.508242 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.508362 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.508573 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.508670 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.508894 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.508982 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.509213 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.509301 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.509544 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.509651 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.509880 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.509973 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.510192 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.510281 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.510506 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.510597 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.510819 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.510965 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.511128 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.511230 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.511483 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.511796 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.511914 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.512106 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.512252 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.512431 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.512610 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.512743 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.512932 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.513256 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.513406 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.513577 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.513680 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.513925 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.514015 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.514245 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.514333 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.514575 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.514666 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.514895 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.514984 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.515207 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.515295 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.515531 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.515619 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.515839 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.515927 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.516148 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.516236 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.516466 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.516662 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.516780 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.516987 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.517108 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.517322 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.517424 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.517652 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.517774 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.518008 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.518099 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.518313 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.518401 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.518627 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.518713 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.518936 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.519021 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.519250 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.519336 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.519559 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.519653 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.519864 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.519961 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.520171 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.520258 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.520476 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.520561 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.520779 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.520873 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.521085 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.521172 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.521391 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.521476 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.521712 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.521813 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.522031 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.522119 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.522341 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.522565 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.522651 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.522916 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.523003 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.523244 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.523349 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.523551 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.523637 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.523862 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.523950 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.524192 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.524277 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.524504 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.524598 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.524824 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.524909 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.525131 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.525218 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.525437 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.525529 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.525771 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.525869 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.526084 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.526182 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.526393 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.526488 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.526701 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.526793 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.527048 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.527245 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.527473 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.527846 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.528020 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.528161 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.528366 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.528514 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.528696 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.528835 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.529036 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.529175 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.529375 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.529530 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.529682 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.529868 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.530038 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.530138 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.530311 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.530400 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.530620 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.530709 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.530927 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.531023 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.531234 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.531322 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.531541 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.531640 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.531853 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.531941 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.532159 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.532256 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.532469 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.532558 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.532775 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.532863 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.533086 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.533188 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.533396 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.533542 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.533717 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.533859 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.534028 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.534178 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.534343 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.534482 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.534657 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.534803 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.534948 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.535083 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.535267 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.535416 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.535581 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.535720 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.535908 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.536001 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.536222 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.536310 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.536535 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.536631 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.536847 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.536936 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.537170 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.537258 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.537485 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.537726 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.537832 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.538072 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.538162 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.538398 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.538494 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.538735 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.538828 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.539049 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.539137 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.539381 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.539539 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.539697 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.539858 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.540007 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.540180 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.540331 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.540504 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.540645 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.540818 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.540958 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.541144 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.541269 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.541471 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.541582 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.541808 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.541927 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.542135 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.542224 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.542450 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.542551 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.543369 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.543721 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.543824 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.544052 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.544152 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.544382 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.544472 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.544695 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.544793 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.545006 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.545104 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.545316 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.545406 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.545630 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.545909 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.546033 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.546227 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.546317 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.546557 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.546645 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.546859 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.546957 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.547178 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.547314 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.547485 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.547583 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.547791 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.547891 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.548099 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.548189 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.548406 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.548503 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.548716 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.548805 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.549021 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.549109 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.549330 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.549418 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.549637 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.549749 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.549969 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.550060 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.550276 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.550396 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.550581 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.550711 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.550892 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.551030 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.551199 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.551351 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.551505 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.551661 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.551811 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.551986 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.552117 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.552311 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.552422 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.552627 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.552759 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.552950 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.553095 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.553267 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.553415 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.553602 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.553763 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.553971 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.554075 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.554304 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.554401 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.554632 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.554721 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.554942 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.555039 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.555252 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.555346 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.555560 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.555646 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.555872 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.555981 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.556207 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.556303 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.556506 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.556592 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.556812 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.556907 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.557119 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.557205 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.557432 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.557530 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.557756 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.557865 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.558063 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.558162 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.559041 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.559417 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.559514 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.559747 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.559834 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.560081 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.560166 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.560399 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.560511 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.560711 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.560798 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.561022 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.561108 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.561334 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.561428 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.561645 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.561746 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.561981 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.562067 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.562297 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.562392 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.562606 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.562692 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.562915 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.563001 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.563223 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.563311 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.563539 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.563642 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.563851 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.563946 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.564180 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.564275 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.564513 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.564601 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.564824 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.564922 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.565149 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.565234 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.565464 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.565551 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.565815 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.565918 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.566132 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.566219 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.566458 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.566544 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.566784 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.566883 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.567104 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.567189 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.567482 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.567589 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.567727 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.567830 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.567974 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103375) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 22 10:07:18.568063 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.568346 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.568661 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.568975 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.569285 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.569598 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.569961 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.570285 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.570599 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.570928 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.571248 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.571569 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.571887 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.572201 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.572534 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.572848 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.573166 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.573488 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.573849 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.574724 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.575063 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.575393 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.575732 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.576068 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.576386 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.576718 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.577052 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.577406 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.577749 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.578101 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.578436 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.578755 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.579070 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.579379 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:07:18.579626 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103374) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 22 10:07:18.645942 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: INFO dbcounter [None req-abd0de59-7448-4124-9902-f8ee1574edac None None] Registered counter for database nova_api Jun 22 10:07:18.722625 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: INFO dbcounter [None req-39dd292d-a369-48ed-b088-3922053bf5f4 None None] Registered counter for database nova_api Jun 22 10:07:18.746383 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG oslo_db.sqlalchemy.engines [None req-39dd292d-a369-48ed-b088-3922053bf5f4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103375) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 22 10:07:18.753466 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG dbcounter [-] [103375] Writer thread running {{(pid=103375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 22 10:07:18.760438 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG oslo_db.sqlalchemy.engines [None req-abd0de59-7448-4124-9902-f8ee1574edac None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103374) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 22 10:07:18.768233 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG dbcounter [-] [103374] Writer thread running {{(pid=103374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 22 10:07:18.811617 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.context [None req-39dd292d-a369-48ed-b088-3922053bf5f4 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),3a2aa31d-c4ea-4d33-acd1-474d1dd4c687(cell1) {{(pid=103375) load_cells /opt/stack/nova/nova/context.py:464}} Jun 22 10:07:18.815635 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG oslo_concurrency.lockutils [None req-39dd292d-a369-48ed-b088-3922053bf5f4 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:07:18.817320 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG oslo_concurrency.lockutils [None req-39dd292d-a369-48ed-b088-3922053bf5f4 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:07:18.818291 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG oslo_concurrency.lockutils [None req-39dd292d-a369-48ed-b088-3922053bf5f4 None None] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:07:18.820781 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG oslo_concurrency.lockutils [None req-39dd292d-a369-48ed-b088-3922053bf5f4 None None] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:07:18.823548 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: INFO dbcounter [None req-39dd292d-a369-48ed-b088-3922053bf5f4 None None] Registered counter for database nova_cell0 Jun 22 10:07:18.826896 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.context [None req-abd0de59-7448-4124-9902-f8ee1574edac None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),3a2aa31d-c4ea-4d33-acd1-474d1dd4c687(cell1) {{(pid=103374) load_cells /opt/stack/nova/nova/context.py:464}} Jun 22 10:07:18.829095 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: INFO dbcounter [None req-39dd292d-a369-48ed-b088-3922053bf5f4 None None] Registered counter for database nova_cell1 Jun 22 10:07:18.830958 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG oslo_concurrency.lockutils [None req-abd0de59-7448-4124-9902-f8ee1574edac None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:07:18.832548 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG oslo_concurrency.lockutils [None req-abd0de59-7448-4124-9902-f8ee1574edac None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:07:18.833354 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG oslo_concurrency.lockutils [None req-abd0de59-7448-4124-9902-f8ee1574edac None None] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:07:18.835503 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG oslo_concurrency.lockutils [None req-abd0de59-7448-4124-9902-f8ee1574edac None None] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103374) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:07:18.836829 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG oslo_db.sqlalchemy.engines [None req-39dd292d-a369-48ed-b088-3922053bf5f4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103375) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 22 10:07:18.837560 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: INFO dbcounter [None req-abd0de59-7448-4124-9902-f8ee1574edac None None] Registered counter for database nova_cell0 Jun 22 10:07:18.839273 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG oslo_db.sqlalchemy.engines [None req-39dd292d-a369-48ed-b088-3922053bf5f4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103375) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 22 10:07:18.842106 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: INFO dbcounter [None req-abd0de59-7448-4124-9902-f8ee1574edac None None] Registered counter for database nova_cell1 Jun 22 10:07:18.844202 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG dbcounter [-] [103375] Writer thread running {{(pid=103375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 22 10:07:18.849454 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG oslo_db.sqlalchemy.engines [None req-abd0de59-7448-4124-9902-f8ee1574edac None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103374) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 22 10:07:18.851938 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG oslo_db.sqlalchemy.engines [None req-abd0de59-7448-4124-9902-f8ee1574edac None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103374) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 22 10:07:18.858240 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG dbcounter [-] [103374] Writer thread running {{(pid=103374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 22 10:07:18.859525 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG dbcounter [-] [103374] Writer thread running {{(pid=103374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 22 10:07:18.987666 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG dbcounter [-] [103375] Writer thread running {{(pid=103375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 22 10:07:18.998204 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: INFO dbcounter [None req-39dd292d-a369-48ed-b088-3922053bf5f4 None None] Registered counter for database nova_cell0 Jun 22 10:07:19.007019 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG oslo_db.sqlalchemy.engines [None req-39dd292d-a369-48ed-b088-3922053bf5f4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103375) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 22 10:07:19.011397 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG dbcounter [-] [103375] Writer thread running {{(pid=103375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 22 10:07:19.012713 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: INFO dbcounter [None req-abd0de59-7448-4124-9902-f8ee1574edac None None] Registered counter for database nova_cell0 Jun 22 10:07:19.021229 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG oslo_db.sqlalchemy.engines [None req-abd0de59-7448-4124-9902-f8ee1574edac None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103374) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 22 10:07:19.025488 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG dbcounter [-] [103374] Writer thread running {{(pid=103374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 22 10:07:19.354324 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: WARNING keystonemiddleware.auth_token [None req-39dd292d-a369-48ed-b088-3922053bf5f4 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 22 10:07:19.362220 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: WARNING keystonemiddleware.auth_token [None req-39dd292d-a369-48ed-b088-3922053bf5f4 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 22 10:07:19.363711 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: WARNING keystonemiddleware.auth_token [None req-abd0de59-7448-4124-9902-f8ee1574edac None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 22 10:07:19.371492 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: WARNING keystonemiddleware.auth_token [None req-abd0de59-7448-4124-9902-f8ee1574edac None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 22 10:07:19.704297 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: WARNING keystonemiddleware.auth_token [None req-39dd292d-a369-48ed-b088-3922053bf5f4 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 22 10:07:19.710303 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: WARNING keystonemiddleware.auth_token [None req-39dd292d-a369-48ed-b088-3922053bf5f4 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 22 10:07:19.716101 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x559f750349c0 pid: 103375 (default app) Jun 22 10:07:19.718183 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi [None req-39dd292d-a369-48ed-b088-3922053bf5f4 None None] Calling method '>' {{(pid=103375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:07:19.719380 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: INFO nova.api.openstack.requestlog [None req-39dd292d-a369-48ed-b088-3922053bf5f4 None None] 10.222.0.43 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001766 Jun 22 10:07:19.719795 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: [pid: 103375|app: 0|req: 1/1] 10.222.0.43 () {50 vars in 788 bytes} [Wed Jun 22 10:07:19 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 10:07:19.722315 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: WARNING keystonemiddleware.auth_token [None req-abd0de59-7448-4124-9902-f8ee1574edac None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 22 10:07:19.728513 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: WARNING keystonemiddleware.auth_token [None req-abd0de59-7448-4124-9902-f8ee1574edac None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 22 10:07:19.735183 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x559f750349c0 pid: 103374 (default app) Jun 22 10:08:36.080971 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi [None req-39dd292d-a369-48ed-b088-3922053bf5f4 None None] Calling method '>' {{(pid=103375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:08:36.081983 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: INFO nova.api.openstack.requestlog [None req-39dd292d-a369-48ed-b088-3922053bf5f4 None None] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001454 Jun 22 10:08:36.082578 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: [pid: 103375|app: 0|req: 2/2] 10.222.0.43 () {54 vars in 930 bytes} [Wed Jun 22 10:08:36 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 10:08:36.107709 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG dbcounter [-] [103374] Writing DB stats nova_api:SELECT=3 {{(pid=103374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:08:36.108690 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG dbcounter [-] [103374] Writing DB stats nova_cell0:SELECT=3 {{(pid=103374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:08:36.109734 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG dbcounter [-] [103374] Writing DB stats nova_cell1:SELECT=3 {{(pid=103374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:08:36.110510 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG dbcounter [-] [103374] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:08:36.539734 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi [None req-b04cbeb1-eaad-447d-a233-9f26532d5113 admin admin] Calling method '>' {{(pid=103374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:08:36.569736 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: INFO nova.api.openstack.requestlog [None req-b04cbeb1-eaad-447d-a233-9f26532d5113 admin admin] 10.222.0.43 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.478332 Jun 22 10:08:36.571161 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: [pid: 103374|app: 0|req: 1/3] 10.222.0.43 () {60 vars in 1291 bytes} [Wed Jun 22 10:08:36 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:08:38.692839 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi [None req-39dd292d-a369-48ed-b088-3922053bf5f4 None None] Calling method '>' {{(pid=103375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:08:38.693867 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: INFO nova.api.openstack.requestlog [None req-39dd292d-a369-48ed-b088-3922053bf5f4 None None] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001429 Jun 22 10:08:38.694274 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: [pid: 103375|app: 0|req: 3/4] 10.222.0.43 () {54 vars in 930 bytes} [Wed Jun 22 10:08:38 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 10:08:38.757126 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi [None req-59e54cb0-a8ff-4fd6-9632-3c24f8fc0bd4 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "ram": 256, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "c1", "rxtx_factor": 1.0, "swap": 0, "name": "cirros256", "vcpus": 1, "disk": 1}} {{(pid=103374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:08:38.775814 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 22 10:08:38.775814 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: warnings.warn(msg) Jun 22 10:08:38.805265 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: INFO nova.api.openstack.requestlog [None req-59e54cb0-a8ff-4fd6-9632-3c24f8fc0bd4 admin admin] 10.222.0.43 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.103699 Jun 22 10:08:38.805846 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: [pid: 103374|app: 0|req: 2/5] 10.222.0.43 () {64 vars in 1282 bytes} [Wed Jun 22 10:08:38 2022] POST /compute/v2.1/flavors => generated 407 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 22 10:08:38.819723 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG dbcounter [-] [103375] Writing DB stats nova_api:SELECT=3 {{(pid=103375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:08:38.821357 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG dbcounter [-] [103375] Writing DB stats nova_cell1:SELECT=3 {{(pid=103375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:08:38.822655 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG dbcounter [-] [103375] Writing DB stats nova_cell0:SELECT=3 {{(pid=103375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:08:38.823437 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG dbcounter [-] [103375] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:08:39.031830 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi [None req-44932916-e254-4d33-8dc1-2edbd78c52b9 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:08:39.034246 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 22 10:08:39.034246 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: warnings.warn(msg) Jun 22 10:08:39.094363 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: INFO nova.api.openstack.requestlog [None req-44932916-e254-4d33-8dc1-2edbd78c52b9 admin admin] 10.222.0.43 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.280265 Jun 22 10:08:39.097768 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: [pid: 103375|app: 0|req: 4/6] 10.222.0.43 () {64 vars in 1335 bytes} [Wed Jun 22 10:08:38 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:08:41.223408 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi [None req-59e54cb0-a8ff-4fd6-9632-3c24f8fc0bd4 admin admin] Calling method '>' {{(pid=103374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:08:41.225353 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: INFO nova.api.openstack.requestlog [None req-59e54cb0-a8ff-4fd6-9632-3c24f8fc0bd4 admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002474 Jun 22 10:08:41.226485 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: [pid: 103374|app: 0|req: 3/7] 10.222.0.43 () {54 vars in 930 bytes} [Wed Jun 22 10:08:41 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 10:08:41.340021 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi [None req-002bc317-fed5-4f4a-8878-05ba02d5e23e admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds512M", "id": "d1", "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "disk": 5, "swap": 0, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 512}} {{(pid=103375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:08:41.358393 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 22 10:08:41.358393 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: warnings.warn(msg) Jun 22 10:08:41.376610 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: INFO nova.api.openstack.requestlog [None req-002bc317-fed5-4f4a-8878-05ba02d5e23e admin admin] 10.222.0.43 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.143597 Jun 22 10:08:41.377161 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: [pid: 103375|app: 0|req: 5/8] 10.222.0.43 () {64 vars in 1282 bytes} [Wed Jun 22 10:08:41 2022] POST /compute/v2.1/flavors => generated 404 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 22 10:08:41.389282 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi [None req-884df0ad-b096-45b0-9809-97336211b751 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:08:41.390883 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 22 10:08:41.390883 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: warnings.warn(msg) Jun 22 10:08:41.422527 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: INFO nova.api.openstack.requestlog [None req-884df0ad-b096-45b0-9809-97336211b751 admin admin] 10.222.0.43 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.037045 Jun 22 10:08:41.423100 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: [pid: 103374|app: 0|req: 4/9] 10.222.0.43 () {64 vars in 1335 bytes} [Wed Jun 22 10:08:41 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:08:43.523781 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi [None req-002bc317-fed5-4f4a-8878-05ba02d5e23e admin admin] Calling method '>' {{(pid=103375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:08:43.524801 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: INFO nova.api.openstack.requestlog [None req-002bc317-fed5-4f4a-8878-05ba02d5e23e admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001550 Jun 22 10:08:43.525196 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: [pid: 103375|app: 0|req: 6/10] 10.222.0.43 () {54 vars in 930 bytes} [Wed Jun 22 10:08:43 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 10:08:43.589002 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi [None req-e96e0d44-8fdd-4ff8-9bc8-9a81838cd541 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "name": "ds1G", "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 1024, "disk": 10, "swap": 0, "id": "d2", "os-flavor-access:is_public": true, "rxtx_factor": 1.0}} {{(pid=103374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:08:43.607938 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: INFO nova.api.openstack.requestlog [None req-e96e0d44-8fdd-4ff8-9bc8-9a81838cd541 admin admin] 10.222.0.43 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.076706 Jun 22 10:08:43.608734 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: [pid: 103374|app: 0|req: 5/11] 10.222.0.43 () {64 vars in 1282 bytes} [Wed Jun 22 10:08:43 2022] POST /compute/v2.1/flavors => generated 404 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 22 10:08:43.621965 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi [None req-66604c77-68c1-4186-89b6-dab253b80e12 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:08:43.646733 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: INFO nova.api.openstack.requestlog [None req-66604c77-68c1-4186-89b6-dab253b80e12 admin admin] 10.222.0.43 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029804 Jun 22 10:08:43.647540 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: [pid: 103375|app: 0|req: 7/12] 10.222.0.43 () {64 vars in 1335 bytes} [Wed Jun 22 10:08:43 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 10:08:45.750009 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi [None req-e96e0d44-8fdd-4ff8-9bc8-9a81838cd541 admin admin] Calling method '>' {{(pid=103374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:08:45.751389 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: INFO nova.api.openstack.requestlog [None req-e96e0d44-8fdd-4ff8-9bc8-9a81838cd541 admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001588 Jun 22 10:08:45.751550 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: [pid: 103374|app: 0|req: 6/13] 10.222.0.43 () {54 vars in 930 bytes} [Wed Jun 22 10:08:45 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 10:08:45.814077 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi [None req-938cc75d-aadb-4aab-9efa-b2fe1a7bd7bb admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "ram": 2048, "vcpus": 2, "swap": 0, "id": "d3", "disk": 10, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "name": "ds2G"}} {{(pid=103375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:08:45.833114 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: INFO nova.api.openstack.requestlog [None req-938cc75d-aadb-4aab-9efa-b2fe1a7bd7bb admin admin] 10.222.0.43 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.075650 Jun 22 10:08:45.833858 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: [pid: 103375|app: 0|req: 8/14] 10.222.0.43 () {64 vars in 1282 bytes} [Wed Jun 22 10:08:45 2022] POST /compute/v2.1/flavors => generated 404 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 22 10:08:45.845641 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi [None req-312d321c-5610-4557-9754-8ae3e807bfd4 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:08:45.870482 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: INFO nova.api.openstack.requestlog [None req-312d321c-5610-4557-9754-8ae3e807bfd4 admin admin] 10.222.0.43 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028408 Jun 22 10:08:45.870989 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: [pid: 103374|app: 0|req: 7/15] 10.222.0.43 () {64 vars in 1335 bytes} [Wed Jun 22 10:08:45 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:08:47.943427 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi [None req-938cc75d-aadb-4aab-9efa-b2fe1a7bd7bb admin admin] Calling method '>' {{(pid=103375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:08:47.944631 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: INFO nova.api.openstack.requestlog [None req-938cc75d-aadb-4aab-9efa-b2fe1a7bd7bb admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001620 Jun 22 10:08:47.945104 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: [pid: 103375|app: 0|req: 9/16] 10.222.0.43 () {54 vars in 930 bytes} [Wed Jun 22 10:08:47 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 10:08:48.010589 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi [None req-10ef6951-edc2-4245-9bd4-7116f4e9db41 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d4", "ram": 4096, "disk": 20, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "name": "ds4G", "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "vcpus": 4}} {{(pid=103374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:08:48.028102 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: INFO nova.api.openstack.requestlog [None req-10ef6951-edc2-4245-9bd4-7116f4e9db41 admin admin] 10.222.0.43 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.075146 Jun 22 10:08:48.028672 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: [pid: 103374|app: 0|req: 8/17] 10.222.0.43 () {64 vars in 1282 bytes} [Wed Jun 22 10:08:47 2022] POST /compute/v2.1/flavors => generated 404 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 22 10:08:48.040987 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi [None req-e422ee46-bf65-4e98-be6a-c0cbeea4e253 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:08:48.070422 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: INFO nova.api.openstack.requestlog [None req-e422ee46-bf65-4e98-be6a-c0cbeea4e253 admin admin] 10.222.0.43 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.033605 Jun 22 10:08:48.071211 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: [pid: 103375|app: 0|req: 10/18] 10.222.0.43 () {64 vars in 1335 bytes} [Wed Jun 22 10:08:48 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 10:08:50.199908 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi [None req-10ef6951-edc2-4245-9bd4-7116f4e9db41 admin admin] Calling method '>' {{(pid=103374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:08:50.200928 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: INFO nova.api.openstack.requestlog [None req-10ef6951-edc2-4245-9bd4-7116f4e9db41 admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001451 Jun 22 10:08:50.201483 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: [pid: 103374|app: 0|req: 9/19] 10.222.0.43 () {54 vars in 930 bytes} [Wed Jun 22 10:08:50 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 10:08:50.263507 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi [None req-fe61287b-aa9a-467f-afb4-baa313ae22d9 admin admin] Calling method '>' {{(pid=103375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:08:50.289010 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: INFO nova.api.openstack.requestlog [None req-fe61287b-aa9a-467f-afb4-baa313ae22d9 admin admin] 10.222.0.43 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.081659 Jun 22 10:08:50.289899 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: [pid: 103375|app: 0|req: 11/20] 10.222.0.43 () {60 vars in 1291 bytes} [Wed Jun 22 10:08:50 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 10:08:52.414985 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi [None req-10ef6951-edc2-4245-9bd4-7116f4e9db41 admin admin] Calling method '>' {{(pid=103374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:08:52.415950 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: INFO nova.api.openstack.requestlog [None req-10ef6951-edc2-4245-9bd4-7116f4e9db41 admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002531 Jun 22 10:08:52.418225 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: [pid: 103374|app: 0|req: 10/21] 10.222.0.43 () {54 vars in 930 bytes} [Wed Jun 22 10:08:52 2022] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 10:08:52.486663 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi [None req-e6e38d46-5881-4d83-8d04-a4596e3d60f1 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "name": "m1.tiny", "OS-FLV-EXT-DATA:ephemeral": 0, "id": "1", "ram": 512, "disk": 1, "os-flavor-access:is_public": true, "vcpus": 1, "swap": 0}} {{(pid=103375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:08:52.504578 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: INFO nova.api.openstack.requestlog [None req-e6e38d46-5881-4d83-8d04-a4596e3d60f1 admin admin] 10.222.0.43 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.082676 Jun 22 10:08:52.505135 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: [pid: 103375|app: 0|req: 12/22] 10.222.0.43 () {64 vars in 1282 bytes} [Wed Jun 22 10:08:52 2022] POST /compute/v2.1/flavors => generated 402 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 22 10:08:52.518626 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi [None req-c28fb1bd-df26-4157-8ec6-4b524ba9d53f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:08:52.542304 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: INFO nova.api.openstack.requestlog [None req-c28fb1bd-df26-4157-8ec6-4b524ba9d53f admin admin] 10.222.0.43 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027480 Jun 22 10:08:52.543047 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: [pid: 103374|app: 0|req: 11/23] 10.222.0.43 () {64 vars in 1332 bytes} [Wed Jun 22 10:08:52 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:08:54.657241 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi [None req-e6e38d46-5881-4d83-8d04-a4596e3d60f1 admin admin] Calling method '>' {{(pid=103375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:08:54.658262 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: INFO nova.api.openstack.requestlog [None req-e6e38d46-5881-4d83-8d04-a4596e3d60f1 admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001506 Jun 22 10:08:54.658666 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: [pid: 103375|app: 0|req: 13/24] 10.222.0.43 () {54 vars in 930 bytes} [Wed Jun 22 10:08:54 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 10:08:54.721307 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi [None req-267ab13f-76da-41b6-805b-8ce5405486a2 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "os-flavor-access:is_public": true, "ram": 2048, "id": "2", "disk": 20, "rxtx_factor": 1.0, "name": "m1.small", "swap": 0}} {{(pid=103374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:08:54.744051 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: INFO nova.api.openstack.requestlog [None req-267ab13f-76da-41b6-805b-8ce5405486a2 admin admin] 10.222.0.43 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.078856 Jun 22 10:08:54.747041 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: [pid: 103374|app: 0|req: 12/25] 10.222.0.43 () {64 vars in 1282 bytes} [Wed Jun 22 10:08:54 2022] POST /compute/v2.1/flavors => generated 405 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 22 10:08:54.759112 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi [None req-3e8a5069-083c-4a84-9e70-9c76ef44a96d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:08:54.784808 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: INFO nova.api.openstack.requestlog [None req-3e8a5069-083c-4a84-9e70-9c76ef44a96d admin admin] 10.222.0.43 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029344 Jun 22 10:08:54.785570 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: [pid: 103375|app: 0|req: 14/26] 10.222.0.43 () {64 vars in 1332 bytes} [Wed Jun 22 10:08:54 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:08:56.882228 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi [None req-267ab13f-76da-41b6-805b-8ce5405486a2 admin admin] Calling method '>' {{(pid=103374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:08:56.883269 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: INFO nova.api.openstack.requestlog [None req-267ab13f-76da-41b6-805b-8ce5405486a2 admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002055 Jun 22 10:08:56.883690 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: [pid: 103374|app: 0|req: 13/27] 10.222.0.43 () {54 vars in 930 bytes} [Wed Jun 22 10:08:56 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 10:08:56.945752 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi [None req-f19296df-b3e5-4bca-b26b-4f67ac86e2e9 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "id": "3", "vcpus": 2, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.medium", "ram": 4096, "disk": 40, "rxtx_factor": 1.0, "swap": 0}} {{(pid=103375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:08:56.967110 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: INFO nova.api.openstack.requestlog [None req-f19296df-b3e5-4bca-b26b-4f67ac86e2e9 admin admin] 10.222.0.43 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.077218 Jun 22 10:08:56.968004 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: [pid: 103375|app: 0|req: 15/28] 10.222.0.43 () {64 vars in 1282 bytes} [Wed Jun 22 10:08:56 2022] POST /compute/v2.1/flavors => generated 406 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 22 10:08:56.979909 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi [None req-6c6be04e-698e-43e6-ba97-0eb84b7d27d0 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:08:57.003302 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: INFO nova.api.openstack.requestlog [None req-6c6be04e-698e-43e6-ba97-0eb84b7d27d0 admin admin] 10.222.0.43 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027059 Jun 22 10:08:57.003881 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: [pid: 103374|app: 0|req: 14/29] 10.222.0.43 () {64 vars in 1332 bytes} [Wed Jun 22 10:08:56 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 10:08:59.126398 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi [None req-f19296df-b3e5-4bca-b26b-4f67ac86e2e9 admin admin] Calling method '>' {{(pid=103375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:08:59.127544 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: INFO nova.api.openstack.requestlog [None req-f19296df-b3e5-4bca-b26b-4f67ac86e2e9 admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001621 Jun 22 10:08:59.128018 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: [pid: 103375|app: 0|req: 16/30] 10.222.0.43 () {54 vars in 930 bytes} [Wed Jun 22 10:08:59 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 10:08:59.187213 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi [None req-a814b641-652a-47e4-86a3-40d8a3f6f21b admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "4", "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "name": "m1.large", "ram": 8192, "swap": 0, "disk": 80, "vcpus": 4, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=103374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:08:59.206349 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: INFO nova.api.openstack.requestlog [None req-a814b641-652a-47e4-86a3-40d8a3f6f21b admin admin] 10.222.0.43 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.071689 Jun 22 10:08:59.206896 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: [pid: 103374|app: 0|req: 15/31] 10.222.0.43 () {64 vars in 1282 bytes} [Wed Jun 22 10:08:59 2022] POST /compute/v2.1/flavors => generated 405 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 22 10:08:59.219097 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi [None req-4ccf505f-2d12-4734-b61b-739e1881ebda admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:08:59.244628 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: INFO nova.api.openstack.requestlog [None req-4ccf505f-2d12-4734-b61b-739e1881ebda admin admin] 10.222.0.43 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029323 Jun 22 10:08:59.245326 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: [pid: 103375|app: 0|req: 17/32] 10.222.0.43 () {64 vars in 1332 bytes} [Wed Jun 22 10:08:59 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:09:01.363624 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi [None req-a814b641-652a-47e4-86a3-40d8a3f6f21b admin admin] Calling method '>' {{(pid=103374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:09:01.364660 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: INFO nova.api.openstack.requestlog [None req-a814b641-652a-47e4-86a3-40d8a3f6f21b admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001449 Jun 22 10:09:01.365046 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: [pid: 103374|app: 0|req: 16/33] 10.222.0.43 () {54 vars in 930 bytes} [Wed Jun 22 10:09:01 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 10:09:01.428190 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi [None req-84b76695-3c11-4b24-ac4c-2699eaafcf5b admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "5", "name": "m1.xlarge", "os-flavor-access:is_public": true, "disk": 160, "ram": 16384, "swap": 0, "vcpus": 8}} {{(pid=103375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:09:01.446279 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: INFO nova.api.openstack.requestlog [None req-84b76695-3c11-4b24-ac4c-2699eaafcf5b admin admin] 10.222.0.43 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.074814 Jun 22 10:09:01.447350 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: [pid: 103375|app: 0|req: 18/34] 10.222.0.43 () {64 vars in 1282 bytes} [Wed Jun 22 10:09:01 2022] POST /compute/v2.1/flavors => generated 408 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 22 10:09:01.459126 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi [None req-4b109702-53ae-4b57-b2ad-f4457b5fcfff admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:09:01.482353 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: INFO nova.api.openstack.requestlog [None req-4b109702-53ae-4b57-b2ad-f4457b5fcfff admin admin] 10.222.0.43 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026787 Jun 22 10:09:01.483197 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: [pid: 103374|app: 0|req: 17/35] 10.222.0.43 () {64 vars in 1332 bytes} [Wed Jun 22 10:09:01 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:09:27.043018 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi [None req-84b76695-3c11-4b24-ac4c-2699eaafcf5b admin admin] Calling method '>' {{(pid=103375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:09:27.044028 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: INFO nova.api.openstack.requestlog [None req-84b76695-3c11-4b24-ac4c-2699eaafcf5b admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001469 Jun 22 10:09:27.044421 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: [pid: 103375|app: 0|req: 19/36] 10.222.0.43 () {54 vars in 930 bytes} [Wed Jun 22 10:09:27 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 10:09:27.055113 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG dbcounter [-] [103374] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=10,nova_api:SAVEPOINT=5,nova_api:RELEASE=5 {{(pid=103374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:09:27.105940 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi [None req-3baffc21-0882-4197-893c-845b570f9c28 admin admin] Calling method '>' {{(pid=103374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:09:27.122574 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: INFO nova.api.openstack.requestlog [None req-3baffc21-0882-4197-893c-845b570f9c28 admin admin] 10.222.0.43 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.072234 Jun 22 10:09:27.123107 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: [pid: 103374|app: 0|req: 18/37] 10.222.0.43 () {60 vars in 1291 bytes} [Wed Jun 22 10:09:27 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 10:09:28.080839 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi [None req-84b76695-3c11-4b24-ac4c-2699eaafcf5b admin admin] Calling method '>' {{(pid=103375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:09:28.081876 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: INFO nova.api.openstack.requestlog [None req-84b76695-3c11-4b24-ac4c-2699eaafcf5b admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001444 Jun 22 10:09:28.082273 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: [pid: 103375|app: 0|req: 20/38] 10.222.0.43 () {56 vars in 1074 bytes} [Wed Jun 22 10:09:28 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 10:09:28.294575 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi [None req-1e37c97c-c603-4af5-8089-768a722b371b admin admin] Calling method '>' {{(pid=103374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:09:28.300947 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: INFO nova.api.openstack.wsgi [None req-1e37c97c-c603-4af5-8089-768a722b371b admin admin] HTTP exception thrown: Flavor 42 could not be found. Jun 22 10:09:28.306492 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi [None req-1e37c97c-c603-4af5-8089-768a722b371b admin admin] Request method failure captured: Jun 22 10:09:28.306492 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jun 22 10:09:28.306492 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: Accept: application/json Jun 22 10:09:28.306492 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: Accept-Encoding: gzip, deflate Jun 22 10:09:28.306492 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: Connection: keep-alive Jun 22 10:09:28.306492 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: Content-Length: 0 Jun 22 10:09:28.306492 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: Host: 10.222.0.43 Jun 22 10:09:28.306492 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: Openstack-Api-Version: compute 2.90 Jun 22 10:09:28.306492 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: Openstack-System-Scope: None Jun 22 10:09:28.306492 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: User-Agent: python-novaclient Jun 22 10:09:28.306492 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: X-Auth-Token: gAAAAABisupY3N65C6lutGZIjTNnINdU9cLfTRMe9fE4FQ0SI8KPwKlAXfFUh8bhmTT-3rINr2UqTDRsDfJvNPviJ65ilbWASdA6wy0p6rf2kobHIuUonZwvQUT75McZsEYpH_pXdPFpEgP0I3ZxJ0UIYx9qKyU6RnurJEnn8_QPM04Rxl-dk20 Jun 22 10:09:28.306492 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: X-Domain-Id: None Jun 22 10:09:28.306492 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: X-Domain-Name: None Jun 22 10:09:28.306492 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: X-Identity-Status: Confirmed Jun 22 10:09:28.306492 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: X-Is-Admin-Project: True Jun 22 10:09:28.306492 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: X-Openstack-Nova-Api-Version: 2.90 Jun 22 10:09:28.306492 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: X-Project-Domain-Id: default Jun 22 10:09:28.306492 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: X-Project-Domain-Name: Default Jun 22 10:09:28.306492 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: X-Project-Id: 24726cc2fba44a5087e961da4a7cd653 Jun 22 10:09:28.306492 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: X-Project-Name: admin Jun 22 10:09:28.306492 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: X-Role: reader,member,admin Jun 22 10:09:28.306492 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: X-Roles: reader,member,admin Jun 22 10:09:28.308284 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/24726cc2fba44a5087e961da4a7cd653"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/24726cc2fba44a5087e961da4a7cd653"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_24726cc2fba44a5087e961da4a7cd653", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/24726cc2fba44a5087e961da4a7cd653"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}] Jun 22 10:09:28.308284 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: X-Tenant: admin Jun 22 10:09:28.308284 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: X-Tenant-Id: 24726cc2fba44a5087e961da4a7cd653 Jun 22 10:09:28.308284 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: X-Tenant-Name: admin Jun 22 10:09:28.308284 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: X-User: admin Jun 22 10:09:28.308284 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: X-User-Domain-Id: default Jun 22 10:09:28.308284 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: X-User-Domain-Name: Default Jun 22 10:09:28.308284 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: X-User-Id: 3557bebdc4d94a16b885094566c2bc9a Jun 22 10:09:28.308284 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: X-User-Name: admin Jun 22 10:09:28.308284 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: method: > Jun 22 10:09:28.308284 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: exception: Flavor 42 could not be found. Jun 22 10:09:28.308284 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: action_args: {'id': '42'} Jun 22 10:09:28.308284 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: {{(pid=103374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 10:09:28.308284 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:09:28.309211 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 22 10:09:28.309211 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 22 10:09:28.309211 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 22 10:09:28.309211 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 22 10:09:28.309211 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 22 10:09:28.309211 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 22 10:09:28.309211 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 22 10:09:28.309211 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 22 10:09:28.309211 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 22 10:09:28.309211 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 10:09:28.309211 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 22 10:09:28.309211 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 22 10:09:28.309211 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jun 22 10:09:28.309211 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: ERROR nova.api.openstack.wsgi Jun 22 10:09:28.309211 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 10:09:28.309211 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: ERROR nova.api.openstack.wsgi Jun 22 10:09:28.309211 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:09:28.309211 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 10:09:28.309211 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 10:09:28.310383 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 10:09:28.310383 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 10:09:28.310383 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 10:09:28.310383 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 10:09:28.310383 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 22 10:09:28.310383 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 22 10:09:28.310383 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jun 22 10:09:28.310383 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: ERROR nova.api.openstack.wsgi Jun 22 10:09:28.310383 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 10:09:28.310383 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: ERROR nova.api.openstack.wsgi Jun 22 10:09:28.310383 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:09:28.310383 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 10:09:28.310383 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 10:09:28.310383 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 10:09:28.310383 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 10:09:28.310383 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jun 22 10:09:28.310383 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: ERROR nova.api.openstack.wsgi Jun 22 10:09:28.310383 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi [None req-1e37c97c-c603-4af5-8089-768a722b371b admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103374) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 10:09:28.311437 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: INFO nova.api.openstack.requestlog [None req-1e37c97c-c603-4af5-8089-768a722b371b admin admin] 10.222.0.43 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.080436 Jun 22 10:09:28.311437 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: [pid: 103374|app: 0|req: 19/39] 10.222.0.43 () {60 vars in 1190 bytes} [Wed Jun 22 10:09:28 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 22 10:09:28.319106 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi [None req-27c409a1-d834-4838-98fd-9157a712bacb admin admin] Calling method '>' {{(pid=103375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:09:28.322111 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG dbcounter [-] [103375] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=103375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:09:28.346738 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: INFO nova.api.openstack.requestlog [None req-27c409a1-d834-4838-98fd-9157a712bacb admin admin] 10.222.0.43 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.031251 Jun 22 10:09:28.347387 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: [pid: 103375|app: 0|req: 21/40] 10.222.0.43 () {60 vars in 1210 bytes} [Wed Jun 22 10:09:28 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 10:09:28.358137 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi [None req-f77db462-317d-4e53-bab1-e08a03e3af66 admin admin] Calling method '>' {{(pid=103374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:09:28.380543 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: INFO nova.api.openstack.requestlog [None req-f77db462-317d-4e53-bab1-e08a03e3af66 admin admin] 10.222.0.43 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.025903 Jun 22 10:09:28.381682 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: [pid: 103374|app: 0|req: 20/41] 10.222.0.43 () {60 vars in 1210 bytes} [Wed Jun 22 10:09:28 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 10:09:28.391539 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi [None req-b5603939-a31b-4f35-a565-d7087dcdf96a admin admin] Calling method '>' {{(pid=103375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:09:28.398450 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: INFO nova.api.openstack.wsgi [None req-b5603939-a31b-4f35-a565-d7087dcdf96a admin admin] HTTP exception thrown: Flavor 42 could not be found. Jun 22 10:09:28.401743 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi [None req-b5603939-a31b-4f35-a565-d7087dcdf96a admin admin] Request method failure captured: Jun 22 10:09:28.401743 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jun 22 10:09:28.401743 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: Accept: application/json Jun 22 10:09:28.401743 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: Accept-Encoding: gzip, deflate Jun 22 10:09:28.401743 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: Connection: keep-alive Jun 22 10:09:28.401743 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: Content-Length: 0 Jun 22 10:09:28.401743 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: Host: 10.222.0.43 Jun 22 10:09:28.401743 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: Openstack-Api-Version: compute 2.90 Jun 22 10:09:28.401743 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: Openstack-System-Scope: None Jun 22 10:09:28.401743 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: User-Agent: python-novaclient Jun 22 10:09:28.401743 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: X-Auth-Token: gAAAAABisupY3N65C6lutGZIjTNnINdU9cLfTRMe9fE4FQ0SI8KPwKlAXfFUh8bhmTT-3rINr2UqTDRsDfJvNPviJ65ilbWASdA6wy0p6rf2kobHIuUonZwvQUT75McZsEYpH_pXdPFpEgP0I3ZxJ0UIYx9qKyU6RnurJEnn8_QPM04Rxl-dk20 Jun 22 10:09:28.401743 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: X-Domain-Id: None Jun 22 10:09:28.401743 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: X-Domain-Name: None Jun 22 10:09:28.401743 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: X-Identity-Status: Confirmed Jun 22 10:09:28.401743 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: X-Is-Admin-Project: True Jun 22 10:09:28.401743 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: X-Openstack-Nova-Api-Version: 2.90 Jun 22 10:09:28.401743 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: X-Project-Domain-Id: default Jun 22 10:09:28.401743 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: X-Project-Domain-Name: Default Jun 22 10:09:28.401743 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: X-Project-Id: 24726cc2fba44a5087e961da4a7cd653 Jun 22 10:09:28.401743 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: X-Project-Name: admin Jun 22 10:09:28.401743 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: X-Role: reader,member,admin Jun 22 10:09:28.401743 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: X-Roles: reader,member,admin Jun 22 10:09:28.403255 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/24726cc2fba44a5087e961da4a7cd653"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/24726cc2fba44a5087e961da4a7cd653"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_24726cc2fba44a5087e961da4a7cd653", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/24726cc2fba44a5087e961da4a7cd653"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}] Jun 22 10:09:28.403255 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: X-Tenant: admin Jun 22 10:09:28.403255 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: X-Tenant-Id: 24726cc2fba44a5087e961da4a7cd653 Jun 22 10:09:28.403255 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: X-Tenant-Name: admin Jun 22 10:09:28.403255 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: X-User: admin Jun 22 10:09:28.403255 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: X-User-Domain-Id: default Jun 22 10:09:28.403255 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: X-User-Domain-Name: Default Jun 22 10:09:28.403255 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: X-User-Id: 3557bebdc4d94a16b885094566c2bc9a Jun 22 10:09:28.403255 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: X-User-Name: admin Jun 22 10:09:28.403255 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: method: > Jun 22 10:09:28.403255 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: exception: Flavor 42 could not be found. Jun 22 10:09:28.403255 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: action_args: {'id': '42'} Jun 22 10:09:28.403255 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: {{(pid=103375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 10:09:28.403255 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:09:28.404232 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 22 10:09:28.404232 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 22 10:09:28.404232 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 22 10:09:28.404232 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 22 10:09:28.404232 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 22 10:09:28.404232 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 22 10:09:28.404232 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 22 10:09:28.404232 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 22 10:09:28.404232 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 22 10:09:28.404232 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 10:09:28.404232 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 22 10:09:28.404232 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 22 10:09:28.404232 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jun 22 10:09:28.404232 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: ERROR nova.api.openstack.wsgi Jun 22 10:09:28.404232 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 10:09:28.404232 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: ERROR nova.api.openstack.wsgi Jun 22 10:09:28.404232 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:09:28.404232 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 10:09:28.404232 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 10:09:28.405414 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 10:09:28.405414 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 10:09:28.405414 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 10:09:28.405414 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 10:09:28.405414 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 22 10:09:28.405414 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 22 10:09:28.405414 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jun 22 10:09:28.405414 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: ERROR nova.api.openstack.wsgi Jun 22 10:09:28.405414 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 10:09:28.405414 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: ERROR nova.api.openstack.wsgi Jun 22 10:09:28.405414 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:09:28.405414 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 10:09:28.405414 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 10:09:28.405414 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 10:09:28.405414 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 10:09:28.405414 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jun 22 10:09:28.405414 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: ERROR nova.api.openstack.wsgi Jun 22 10:09:28.405414 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi [None req-b5603939-a31b-4f35-a565-d7087dcdf96a admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103375) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 10:09:28.407098 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: INFO nova.api.openstack.requestlog [None req-b5603939-a31b-4f35-a565-d7087dcdf96a admin admin] 10.222.0.43 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.015397 Jun 22 10:09:28.407098 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: [pid: 103375|app: 0|req: 22/42] 10.222.0.43 () {60 vars in 1190 bytes} [Wed Jun 22 10:09:28 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 22 10:09:29.237895 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi [None req-f77db462-317d-4e53-bab1-e08a03e3af66 admin admin] Calling method '>' {{(pid=103374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:09:29.238959 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: INFO nova.api.openstack.requestlog [None req-f77db462-317d-4e53-bab1-e08a03e3af66 admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001523 Jun 22 10:09:29.239358 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: [pid: 103374|app: 0|req: 21/43] 10.222.0.43 () {56 vars in 1074 bytes} [Wed Jun 22 10:09:29 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 10:09:29.430341 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi [None req-799bbe65-5c92-447a-a665-fcbb4a47443f admin admin] Calling method '>' {{(pid=103375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:09:29.437636 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: INFO nova.api.openstack.wsgi [None req-799bbe65-5c92-447a-a665-fcbb4a47443f admin admin] HTTP exception thrown: Flavor 84 could not be found. Jun 22 10:09:29.439155 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi [None req-799bbe65-5c92-447a-a665-fcbb4a47443f admin admin] Request method failure captured: Jun 22 10:09:29.439155 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jun 22 10:09:29.439155 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: Accept: application/json Jun 22 10:09:29.439155 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: Accept-Encoding: gzip, deflate Jun 22 10:09:29.439155 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: Connection: keep-alive Jun 22 10:09:29.439155 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: Content-Length: 0 Jun 22 10:09:29.439155 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: Host: 10.222.0.43 Jun 22 10:09:29.439155 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: Openstack-Api-Version: compute 2.90 Jun 22 10:09:29.439155 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: Openstack-System-Scope: None Jun 22 10:09:29.439155 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: User-Agent: python-novaclient Jun 22 10:09:29.439155 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: X-Auth-Token: gAAAAABisupZamKxQw6qVZHos7C4FaAwHtWuOeCFWFy1Yzt_D1EYliSHFyvteZrXhJFg-OzpDDH3URwh1ckrKaB6oHpuvw0_5F3O-B7AjXadggU94UX0-FPe7M1nfIewGDt__aX-20J2wrGoja3x_hwiQBz1iQulxOIn6m0jq0VtieMFpBuT3KA Jun 22 10:09:29.439155 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: X-Domain-Id: None Jun 22 10:09:29.439155 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: X-Domain-Name: None Jun 22 10:09:29.439155 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: X-Identity-Status: Confirmed Jun 22 10:09:29.439155 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: X-Is-Admin-Project: True Jun 22 10:09:29.439155 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: X-Openstack-Nova-Api-Version: 2.90 Jun 22 10:09:29.439155 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: X-Project-Domain-Id: default Jun 22 10:09:29.439155 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: X-Project-Domain-Name: Default Jun 22 10:09:29.439155 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: X-Project-Id: 24726cc2fba44a5087e961da4a7cd653 Jun 22 10:09:29.439155 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: X-Project-Name: admin Jun 22 10:09:29.439155 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: X-Role: reader,member,admin Jun 22 10:09:29.439155 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: X-Roles: reader,member,admin Jun 22 10:09:29.440682 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/24726cc2fba44a5087e961da4a7cd653"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/24726cc2fba44a5087e961da4a7cd653"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_24726cc2fba44a5087e961da4a7cd653", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/24726cc2fba44a5087e961da4a7cd653"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}] Jun 22 10:09:29.440682 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: X-Tenant: admin Jun 22 10:09:29.440682 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: X-Tenant-Id: 24726cc2fba44a5087e961da4a7cd653 Jun 22 10:09:29.440682 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: X-Tenant-Name: admin Jun 22 10:09:29.440682 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: X-User: admin Jun 22 10:09:29.440682 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: X-User-Domain-Id: default Jun 22 10:09:29.440682 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: X-User-Domain-Name: Default Jun 22 10:09:29.440682 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: X-User-Id: 3557bebdc4d94a16b885094566c2bc9a Jun 22 10:09:29.440682 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: X-User-Name: admin Jun 22 10:09:29.440682 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: method: > Jun 22 10:09:29.440682 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: exception: Flavor 84 could not be found. Jun 22 10:09:29.440682 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: action_args: {'id': '84'} Jun 22 10:09:29.440682 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: {{(pid=103375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 10:09:29.440682 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:09:29.441513 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 22 10:09:29.441513 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 22 10:09:29.441513 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 22 10:09:29.441513 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 22 10:09:29.441513 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 22 10:09:29.441513 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 22 10:09:29.441513 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 22 10:09:29.441513 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 22 10:09:29.441513 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 22 10:09:29.441513 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 10:09:29.441513 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 22 10:09:29.441513 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 22 10:09:29.441513 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jun 22 10:09:29.441513 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: ERROR nova.api.openstack.wsgi Jun 22 10:09:29.441513 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 10:09:29.441513 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: ERROR nova.api.openstack.wsgi Jun 22 10:09:29.441513 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:09:29.441513 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 10:09:29.441513 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 10:09:29.442928 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 10:09:29.442928 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 10:09:29.442928 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 10:09:29.442928 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 10:09:29.442928 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 22 10:09:29.442928 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 22 10:09:29.442928 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jun 22 10:09:29.442928 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: ERROR nova.api.openstack.wsgi Jun 22 10:09:29.442928 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 10:09:29.442928 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: ERROR nova.api.openstack.wsgi Jun 22 10:09:29.442928 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:09:29.442928 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 10:09:29.442928 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 10:09:29.442928 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 10:09:29.442928 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 10:09:29.442928 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jun 22 10:09:29.442928 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: ERROR nova.api.openstack.wsgi Jun 22 10:09:29.442928 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi [None req-799bbe65-5c92-447a-a665-fcbb4a47443f admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103375) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 10:09:29.444740 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: INFO nova.api.openstack.requestlog [None req-799bbe65-5c92-447a-a665-fcbb4a47443f admin admin] 10.222.0.43 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.063586 Jun 22 10:09:29.444740 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: [pid: 103375|app: 0|req: 23/44] 10.222.0.43 () {60 vars in 1190 bytes} [Wed Jun 22 10:09:29 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 22 10:09:29.450866 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi [None req-64d90d15-9bbf-47df-81e5-46b4af95cc58 admin admin] Calling method '>' {{(pid=103374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:09:29.464892 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: INFO nova.api.openstack.requestlog [None req-64d90d15-9bbf-47df-81e5-46b4af95cc58 admin admin] 10.222.0.43 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017556 Jun 22 10:09:29.465408 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: [pid: 103374|app: 0|req: 22/45] 10.222.0.43 () {60 vars in 1210 bytes} [Wed Jun 22 10:09:29 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 22 10:09:29.474685 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi [None req-09d10fa8-f618-4618-aba1-191d9b58f4a5 admin admin] Calling method '>' {{(pid=103375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:09:29.489101 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: INFO nova.api.openstack.requestlog [None req-09d10fa8-f618-4618-aba1-191d9b58f4a5 admin admin] 10.222.0.43 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017915 Jun 22 10:09:29.489618 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: [pid: 103375|app: 0|req: 24/46] 10.222.0.43 () {60 vars in 1210 bytes} [Wed Jun 22 10:09:29 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 10:09:29.499033 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi [None req-ea58775b-a230-466e-8846-976ce5a2d984 admin admin] Calling method '>' {{(pid=103374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:09:29.504238 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: INFO nova.api.openstack.wsgi [None req-ea58775b-a230-466e-8846-976ce5a2d984 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jun 22 10:09:29.505752 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi [None req-ea58775b-a230-466e-8846-976ce5a2d984 admin admin] Request method failure captured: Jun 22 10:09:29.505752 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jun 22 10:09:29.505752 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: Accept: application/json Jun 22 10:09:29.505752 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: Accept-Encoding: gzip, deflate Jun 22 10:09:29.505752 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: Connection: keep-alive Jun 22 10:09:29.505752 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: Content-Length: 0 Jun 22 10:09:29.505752 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: Host: 10.222.0.43 Jun 22 10:09:29.505752 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: Openstack-Api-Version: compute 2.90 Jun 22 10:09:29.505752 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: Openstack-System-Scope: None Jun 22 10:09:29.505752 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: User-Agent: python-novaclient Jun 22 10:09:29.505752 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: X-Auth-Token: gAAAAABisupZamKxQw6qVZHos7C4FaAwHtWuOeCFWFy1Yzt_D1EYliSHFyvteZrXhJFg-OzpDDH3URwh1ckrKaB6oHpuvw0_5F3O-B7AjXadggU94UX0-FPe7M1nfIewGDt__aX-20J2wrGoja3x_hwiQBz1iQulxOIn6m0jq0VtieMFpBuT3KA Jun 22 10:09:29.505752 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: X-Domain-Id: None Jun 22 10:09:29.505752 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: X-Domain-Name: None Jun 22 10:09:29.505752 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: X-Identity-Status: Confirmed Jun 22 10:09:29.505752 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: X-Is-Admin-Project: True Jun 22 10:09:29.505752 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: X-Openstack-Nova-Api-Version: 2.90 Jun 22 10:09:29.505752 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: X-Project-Domain-Id: default Jun 22 10:09:29.505752 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: X-Project-Domain-Name: Default Jun 22 10:09:29.505752 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: X-Project-Id: 24726cc2fba44a5087e961da4a7cd653 Jun 22 10:09:29.505752 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: X-Project-Name: admin Jun 22 10:09:29.505752 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: X-Role: reader,member,admin Jun 22 10:09:29.505752 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: X-Roles: reader,member,admin Jun 22 10:09:29.508008 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/24726cc2fba44a5087e961da4a7cd653"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/24726cc2fba44a5087e961da4a7cd653"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_24726cc2fba44a5087e961da4a7cd653", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/24726cc2fba44a5087e961da4a7cd653"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}] Jun 22 10:09:29.508008 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: X-Tenant: admin Jun 22 10:09:29.508008 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: X-Tenant-Id: 24726cc2fba44a5087e961da4a7cd653 Jun 22 10:09:29.508008 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: X-Tenant-Name: admin Jun 22 10:09:29.508008 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: X-User: admin Jun 22 10:09:29.508008 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: X-User-Domain-Id: default Jun 22 10:09:29.508008 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: X-User-Domain-Name: Default Jun 22 10:09:29.508008 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: X-User-Id: 3557bebdc4d94a16b885094566c2bc9a Jun 22 10:09:29.508008 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: X-User-Name: admin Jun 22 10:09:29.508008 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: method: > Jun 22 10:09:29.508008 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: exception: Flavor 84 could not be found. Jun 22 10:09:29.508008 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: action_args: {'id': '84'} Jun 22 10:09:29.508008 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: {{(pid=103374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 10:09:29.508008 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:09:29.508792 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 22 10:09:29.508792 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 22 10:09:29.508792 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 22 10:09:29.508792 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 22 10:09:29.508792 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 22 10:09:29.508792 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 22 10:09:29.508792 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 22 10:09:29.508792 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 22 10:09:29.508792 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 22 10:09:29.508792 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 10:09:29.508792 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 22 10:09:29.508792 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 22 10:09:29.508792 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jun 22 10:09:29.508792 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: ERROR nova.api.openstack.wsgi Jun 22 10:09:29.508792 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 10:09:29.508792 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: ERROR nova.api.openstack.wsgi Jun 22 10:09:29.508792 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:09:29.508792 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 10:09:29.508792 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 10:09:29.509881 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 10:09:29.509881 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 10:09:29.509881 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 10:09:29.509881 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 10:09:29.509881 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 22 10:09:29.509881 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 22 10:09:29.509881 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jun 22 10:09:29.509881 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: ERROR nova.api.openstack.wsgi Jun 22 10:09:29.509881 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 10:09:29.509881 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: ERROR nova.api.openstack.wsgi Jun 22 10:09:29.509881 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:09:29.509881 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 10:09:29.509881 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 10:09:29.509881 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 10:09:29.509881 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 10:09:29.509881 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jun 22 10:09:29.509881 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: ERROR nova.api.openstack.wsgi Jun 22 10:09:29.509881 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi [None req-ea58775b-a230-466e-8846-976ce5a2d984 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103374) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 10:09:29.511455 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: INFO nova.api.openstack.requestlog [None req-ea58775b-a230-466e-8846-976ce5a2d984 admin admin] 10.222.0.43 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.012150 Jun 22 10:09:29.511455 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: [pid: 103374|app: 0|req: 23/47] 10.222.0.43 () {60 vars in 1190 bytes} [Wed Jun 22 10:09:29 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Jun 22 10:09:30.322462 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi [None req-09d10fa8-f618-4618-aba1-191d9b58f4a5 admin admin] Calling method '>' {{(pid=103375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:09:30.323467 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: INFO nova.api.openstack.requestlog [None req-09d10fa8-f618-4618-aba1-191d9b58f4a5 admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001462 Jun 22 10:09:30.323860 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: [pid: 103375|app: 0|req: 25/48] 10.222.0.43 () {56 vars in 1074 bytes} [Wed Jun 22 10:09:30 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 10:09:30.515314 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi [None req-65bba7ca-3319-409a-91de-c1af2f916c8b admin admin] Calling method '>' {{(pid=103374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:09:30.521030 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: INFO nova.api.openstack.wsgi [None req-65bba7ca-3319-409a-91de-c1af2f916c8b admin admin] HTTP exception thrown: Flavor 451 could not be found. Jun 22 10:09:30.522963 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi [None req-65bba7ca-3319-409a-91de-c1af2f916c8b admin admin] Request method failure captured: Jun 22 10:09:30.522963 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jun 22 10:09:30.522963 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: Accept: application/json Jun 22 10:09:30.522963 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: Accept-Encoding: gzip, deflate Jun 22 10:09:30.522963 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: Connection: keep-alive Jun 22 10:09:30.522963 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: Content-Length: 0 Jun 22 10:09:30.522963 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: Host: 10.222.0.43 Jun 22 10:09:30.522963 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: Openstack-Api-Version: compute 2.90 Jun 22 10:09:30.522963 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: Openstack-System-Scope: None Jun 22 10:09:30.522963 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: User-Agent: python-novaclient Jun 22 10:09:30.522963 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: X-Auth-Token: gAAAAABisupacGY2cnU3vdrgvZIpgTjLDxJFl_H-oPPMDtDMriS9lT41YFimYnilch7BYD5NNfctw1zPMR9ERP-nC8-D8alfVe89nbqW6snnpq6a1y-agRPhqzua70EF5JbqEgOjK_WjoLHiOFqhoaugVsuXxqADJfIMX67fKobMT1tHOio9zaM Jun 22 10:09:30.522963 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: X-Domain-Id: None Jun 22 10:09:30.522963 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: X-Domain-Name: None Jun 22 10:09:30.522963 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: X-Identity-Status: Confirmed Jun 22 10:09:30.522963 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: X-Is-Admin-Project: True Jun 22 10:09:30.522963 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: X-Openstack-Nova-Api-Version: 2.90 Jun 22 10:09:30.522963 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: X-Project-Domain-Id: default Jun 22 10:09:30.522963 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: X-Project-Domain-Name: Default Jun 22 10:09:30.522963 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: X-Project-Id: 24726cc2fba44a5087e961da4a7cd653 Jun 22 10:09:30.522963 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: X-Project-Name: admin Jun 22 10:09:30.522963 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: X-Role: reader,member,admin Jun 22 10:09:30.522963 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: X-Roles: reader,member,admin Jun 22 10:09:30.524523 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/24726cc2fba44a5087e961da4a7cd653"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/24726cc2fba44a5087e961da4a7cd653"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_24726cc2fba44a5087e961da4a7cd653", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/24726cc2fba44a5087e961da4a7cd653"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}] Jun 22 10:09:30.524523 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: X-Tenant: admin Jun 22 10:09:30.524523 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: X-Tenant-Id: 24726cc2fba44a5087e961da4a7cd653 Jun 22 10:09:30.524523 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: X-Tenant-Name: admin Jun 22 10:09:30.524523 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: X-User: admin Jun 22 10:09:30.524523 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: X-User-Domain-Id: default Jun 22 10:09:30.524523 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: X-User-Domain-Name: Default Jun 22 10:09:30.524523 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: X-User-Id: 3557bebdc4d94a16b885094566c2bc9a Jun 22 10:09:30.524523 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: X-User-Name: admin Jun 22 10:09:30.524523 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: method: > Jun 22 10:09:30.524523 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: exception: Flavor 451 could not be found. Jun 22 10:09:30.524523 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: action_args: {'id': '451'} Jun 22 10:09:30.524523 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: {{(pid=103374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 10:09:30.524523 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:09:30.525473 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 22 10:09:30.525473 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 22 10:09:30.525473 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 22 10:09:30.525473 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 22 10:09:30.525473 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 22 10:09:30.525473 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 22 10:09:30.525473 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 22 10:09:30.525473 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 22 10:09:30.525473 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 22 10:09:30.525473 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 10:09:30.525473 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 22 10:09:30.525473 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 22 10:09:30.525473 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jun 22 10:09:30.525473 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: ERROR nova.api.openstack.wsgi Jun 22 10:09:30.525473 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 10:09:30.525473 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: ERROR nova.api.openstack.wsgi Jun 22 10:09:30.525473 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:09:30.525473 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 10:09:30.525473 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 10:09:30.526842 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 10:09:30.526842 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 10:09:30.526842 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 10:09:30.526842 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 10:09:30.526842 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 22 10:09:30.526842 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 22 10:09:30.526842 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jun 22 10:09:30.526842 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: ERROR nova.api.openstack.wsgi Jun 22 10:09:30.526842 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 10:09:30.526842 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: ERROR nova.api.openstack.wsgi Jun 22 10:09:30.526842 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:09:30.526842 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 10:09:30.526842 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 10:09:30.526842 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 10:09:30.526842 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 10:09:30.526842 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jun 22 10:09:30.526842 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: ERROR nova.api.openstack.wsgi Jun 22 10:09:30.526842 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi [None req-65bba7ca-3319-409a-91de-c1af2f916c8b admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103374) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 10:09:30.528076 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: INFO nova.api.openstack.requestlog [None req-65bba7ca-3319-409a-91de-c1af2f916c8b admin admin] 10.222.0.43 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.061886 Jun 22 10:09:30.528076 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: [pid: 103374|app: 0|req: 24/49] 10.222.0.43 () {60 vars in 1193 bytes} [Wed Jun 22 10:09:30 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 22 10:09:30.533923 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi [None req-0ef860ac-ce66-4acd-b566-a782c8feb9f9 admin admin] Calling method '>' {{(pid=103375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:09:30.547556 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: INFO nova.api.openstack.requestlog [None req-0ef860ac-ce66-4acd-b566-a782c8feb9f9 admin admin] 10.222.0.43 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017158 Jun 22 10:09:30.548068 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: [pid: 103375|app: 0|req: 26/50] 10.222.0.43 () {60 vars in 1210 bytes} [Wed Jun 22 10:09:30 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 10:09:30.557818 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi [None req-6ca3ba13-59c3-4be6-bf72-f25c6e054ab4 admin admin] Calling method '>' {{(pid=103374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:09:30.573267 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: INFO nova.api.openstack.requestlog [None req-6ca3ba13-59c3-4be6-bf72-f25c6e054ab4 admin admin] 10.222.0.43 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019016 Jun 22 10:09:30.573817 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: [pid: 103374|app: 0|req: 25/51] 10.222.0.43 () {60 vars in 1210 bytes} [Wed Jun 22 10:09:30 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 10:09:30.582856 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi [None req-b9a534f3-2f3d-4d29-84f5-de3f7801abfe admin admin] Calling method '>' {{(pid=103375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:09:30.588367 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: INFO nova.api.openstack.wsgi [None req-b9a534f3-2f3d-4d29-84f5-de3f7801abfe admin admin] HTTP exception thrown: Flavor 451 could not be found. Jun 22 10:09:30.589884 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi [None req-b9a534f3-2f3d-4d29-84f5-de3f7801abfe admin admin] Request method failure captured: Jun 22 10:09:30.589884 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jun 22 10:09:30.589884 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: Accept: application/json Jun 22 10:09:30.589884 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: Accept-Encoding: gzip, deflate Jun 22 10:09:30.589884 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: Connection: keep-alive Jun 22 10:09:30.589884 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: Content-Length: 0 Jun 22 10:09:30.589884 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: Host: 10.222.0.43 Jun 22 10:09:30.589884 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: Openstack-Api-Version: compute 2.90 Jun 22 10:09:30.589884 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: Openstack-System-Scope: None Jun 22 10:09:30.589884 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: User-Agent: python-novaclient Jun 22 10:09:30.589884 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: X-Auth-Token: gAAAAABisupacGY2cnU3vdrgvZIpgTjLDxJFl_H-oPPMDtDMriS9lT41YFimYnilch7BYD5NNfctw1zPMR9ERP-nC8-D8alfVe89nbqW6snnpq6a1y-agRPhqzua70EF5JbqEgOjK_WjoLHiOFqhoaugVsuXxqADJfIMX67fKobMT1tHOio9zaM Jun 22 10:09:30.589884 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: X-Domain-Id: None Jun 22 10:09:30.589884 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: X-Domain-Name: None Jun 22 10:09:30.589884 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: X-Identity-Status: Confirmed Jun 22 10:09:30.589884 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: X-Is-Admin-Project: True Jun 22 10:09:30.589884 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: X-Openstack-Nova-Api-Version: 2.90 Jun 22 10:09:30.589884 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: X-Project-Domain-Id: default Jun 22 10:09:30.589884 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: X-Project-Domain-Name: Default Jun 22 10:09:30.589884 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: X-Project-Id: 24726cc2fba44a5087e961da4a7cd653 Jun 22 10:09:30.589884 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: X-Project-Name: admin Jun 22 10:09:30.589884 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: X-Role: reader,member,admin Jun 22 10:09:30.589884 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: X-Roles: reader,member,admin Jun 22 10:09:30.591392 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/24726cc2fba44a5087e961da4a7cd653"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/24726cc2fba44a5087e961da4a7cd653"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_24726cc2fba44a5087e961da4a7cd653", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/24726cc2fba44a5087e961da4a7cd653"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}] Jun 22 10:09:30.591392 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: X-Tenant: admin Jun 22 10:09:30.591392 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: X-Tenant-Id: 24726cc2fba44a5087e961da4a7cd653 Jun 22 10:09:30.591392 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: X-Tenant-Name: admin Jun 22 10:09:30.591392 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: X-User: admin Jun 22 10:09:30.591392 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: X-User-Domain-Id: default Jun 22 10:09:30.591392 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: X-User-Domain-Name: Default Jun 22 10:09:30.591392 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: X-User-Id: 3557bebdc4d94a16b885094566c2bc9a Jun 22 10:09:30.591392 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: X-User-Name: admin Jun 22 10:09:30.591392 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: method: > Jun 22 10:09:30.591392 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: exception: Flavor 451 could not be found. Jun 22 10:09:30.591392 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: action_args: {'id': '451'} Jun 22 10:09:30.591392 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: {{(pid=103375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 10:09:30.591392 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:09:30.592352 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 22 10:09:30.592352 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 22 10:09:30.592352 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 22 10:09:30.592352 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 22 10:09:30.592352 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 22 10:09:30.592352 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 22 10:09:30.592352 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 22 10:09:30.592352 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 22 10:09:30.592352 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 22 10:09:30.592352 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 10:09:30.592352 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 22 10:09:30.592352 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 22 10:09:30.592352 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jun 22 10:09:30.592352 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: ERROR nova.api.openstack.wsgi Jun 22 10:09:30.592352 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 10:09:30.592352 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: ERROR nova.api.openstack.wsgi Jun 22 10:09:30.592352 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:09:30.592352 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 10:09:30.592352 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 10:09:30.593878 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 10:09:30.593878 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 10:09:30.593878 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 10:09:30.593878 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 10:09:30.593878 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 22 10:09:30.593878 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 22 10:09:30.593878 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jun 22 10:09:30.593878 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: ERROR nova.api.openstack.wsgi Jun 22 10:09:30.593878 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 10:09:30.593878 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: ERROR nova.api.openstack.wsgi Jun 22 10:09:30.593878 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:09:30.593878 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 10:09:30.593878 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 10:09:30.593878 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 10:09:30.593878 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 10:09:30.593878 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jun 22 10:09:30.593878 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: ERROR nova.api.openstack.wsgi Jun 22 10:09:30.593878 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi [None req-b9a534f3-2f3d-4d29-84f5-de3f7801abfe admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103375) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 10:09:30.595112 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: INFO nova.api.openstack.requestlog [None req-b9a534f3-2f3d-4d29-84f5-de3f7801abfe admin admin] 10.222.0.43 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.011914 Jun 22 10:09:30.595112 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: [pid: 103375|app: 0|req: 27/52] 10.222.0.43 () {60 vars in 1193 bytes} [Wed Jun 22 10:09:30 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Jun 22 10:09:31.419672 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi [None req-6ca3ba13-59c3-4be6-bf72-f25c6e054ab4 admin admin] Calling method '>' {{(pid=103374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:09:31.420690 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: INFO nova.api.openstack.requestlog [None req-6ca3ba13-59c3-4be6-bf72-f25c6e054ab4 admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001431 Jun 22 10:09:31.421084 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: [pid: 103374|app: 0|req: 26/53] 10.222.0.43 () {56 vars in 1074 bytes} [Wed Jun 22 10:09:31 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 10:09:31.619018 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi [None req-1d28bd86-2679-43fb-82c3-edbb90dedb9e admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:09:31.644400 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: INFO nova.api.openstack.requestlog [None req-1d28bd86-2679-43fb-82c3-edbb90dedb9e admin admin] 10.222.0.43 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.085469 Jun 22 10:09:31.645323 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: [pid: 103375|app: 0|req: 28/54] 10.222.0.43 () {64 vars in 1235 bytes} [Wed Jun 22 10:09:31 2022] POST /compute/v2.1/flavors => generated 404 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 22 10:09:32.466463 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi [None req-6ca3ba13-59c3-4be6-bf72-f25c6e054ab4 admin admin] Calling method '>' {{(pid=103374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:09:32.467465 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: INFO nova.api.openstack.requestlog [None req-6ca3ba13-59c3-4be6-bf72-f25c6e054ab4 admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001451 Jun 22 10:09:32.467866 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: [pid: 103374|app: 0|req: 27/55] 10.222.0.43 () {56 vars in 1074 bytes} [Wed Jun 22 10:09:32 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 10:09:32.655194 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi [None req-7b886b62-5272-4166-b9b4-af0b48a81c9a admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:09:32.672904 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: INFO nova.api.openstack.requestlog [None req-7b886b62-5272-4166-b9b4-af0b48a81c9a admin admin] 10.222.0.43 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.068001 Jun 22 10:09:32.673439 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: [pid: 103375|app: 0|req: 29/56] 10.222.0.43 () {64 vars in 1235 bytes} [Wed Jun 22 10:09:32 2022] POST /compute/v2.1/flavors => generated 405 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 22 10:09:33.492543 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi [None req-6ca3ba13-59c3-4be6-bf72-f25c6e054ab4 admin admin] Calling method '>' {{(pid=103374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:09:33.493590 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: INFO nova.api.openstack.requestlog [None req-6ca3ba13-59c3-4be6-bf72-f25c6e054ab4 admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001467 Jun 22 10:09:33.494028 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: [pid: 103374|app: 0|req: 28/57] 10.222.0.43 () {56 vars in 1074 bytes} [Wed Jun 22 10:09:33 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 10:09:33.683395 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi [None req-1431c468-6c78-4b57-8051-0ce4378e5b7c admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:09:33.702119 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: INFO nova.api.openstack.requestlog [None req-1431c468-6c78-4b57-8051-0ce4378e5b7c admin admin] 10.222.0.43 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.071063 Jun 22 10:09:33.702595 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: [pid: 103375|app: 0|req: 30/58] 10.222.0.43 () {64 vars in 1235 bytes} [Wed Jun 22 10:09:33 2022] POST /compute/v2.1/flavors => generated 407 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 22 10:09:34.538947 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi [None req-6ca3ba13-59c3-4be6-bf72-f25c6e054ab4 admin admin] Calling method '>' {{(pid=103374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:09:34.539952 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: INFO nova.api.openstack.requestlog [None req-6ca3ba13-59c3-4be6-bf72-f25c6e054ab4 admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001418 Jun 22 10:09:34.540344 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: [pid: 103374|app: 0|req: 29/59] 10.222.0.43 () {56 vars in 1074 bytes} [Wed Jun 22 10:09:34 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 10:09:34.736047 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi [None req-a4c2c8df-6b7e-4f32-8dd0-112a1ff282fe admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:09:34.754290 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: INFO nova.api.openstack.requestlog [None req-a4c2c8df-6b7e-4f32-8dd0-112a1ff282fe admin admin] 10.222.0.43 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.078778 Jun 22 10:09:34.754779 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: [pid: 103375|app: 0|req: 31/60] 10.222.0.43 () {64 vars in 1235 bytes} [Wed Jun 22 10:09:34 2022] POST /compute/v2.1/flavors => generated 409 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 22 10:09:35.584914 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi [None req-6ca3ba13-59c3-4be6-bf72-f25c6e054ab4 admin admin] Calling method '>' {{(pid=103374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:09:35.585946 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: INFO nova.api.openstack.requestlog [None req-6ca3ba13-59c3-4be6-bf72-f25c6e054ab4 admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001424 Jun 22 10:09:35.586336 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: [pid: 103374|app: 0|req: 30/61] 10.222.0.43 () {56 vars in 1074 bytes} [Wed Jun 22 10:09:35 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 10:09:35.773019 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi [None req-d3d9b6b9-d41b-4b3c-8268-156f9fcfc856 admin admin] Calling method '>' {{(pid=103375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:09:35.792978 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: INFO nova.api.openstack.requestlog [None req-d3d9b6b9-d41b-4b3c-8268-156f9fcfc856 admin admin] 10.222.0.43 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.071944 Jun 22 10:09:35.793511 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: [pid: 103375|app: 0|req: 32/62] 10.222.0.43 () {60 vars in 1202 bytes} [Wed Jun 22 10:09:35 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 10:10:22.532841 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi [None req-6ca3ba13-59c3-4be6-bf72-f25c6e054ab4 admin admin] Calling method '>' {{(pid=103374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:10:22.533911 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: INFO nova.api.openstack.requestlog [None req-6ca3ba13-59c3-4be6-bf72-f25c6e054ab4 admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001425 Jun 22 10:10:22.534307 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: [pid: 103374|app: 0|req: 31/63] 10.222.0.43 () {54 vars in 930 bytes} [Wed Jun 22 10:10:22 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 10:10:22.544694 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG dbcounter [-] [103375] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=103375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:10:22.596984 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi [None req-88f0849c-f6db-4391-8bde-b93d33d88eb3 admin admin] Calling method '>' {{(pid=103375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:10:22.616486 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: INFO nova.api.openstack.requestlog [None req-88f0849c-f6db-4391-8bde-b93d33d88eb3 admin admin] 10.222.0.43 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.075750 Jun 22 10:10:22.617020 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: [pid: 103375|app: 0|req: 33/64] 10.222.0.43 () {60 vars in 1291 bytes} [Wed Jun 22 10:10:22 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 10:10:22.640051 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi [None req-7e1d2f03-d737-4f34-b694-2b419946b9c9 admin admin] Calling method '>' {{(pid=103374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:10:22.643545 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG dbcounter [-] [103374] Writing DB stats nova_api:SELECT=14 {{(pid=103374) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:10:22.649374 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: INFO nova.api.openstack.requestlog [None req-7e1d2f03-d737-4f34-b694-2b419946b9c9 admin admin] 10.222.0.43 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012951 Jun 22 10:10:22.649943 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: [pid: 103374|app: 0|req: 32/65] 10.222.0.43 () {60 vars in 1282 bytes} [Wed Jun 22 10:10:22 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:10:22.661164 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi [None req-0b55a18b-9518-46df-aee4-c36d9da3fa66 admin admin] Calling method '>' {{(pid=103375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:10:22.668880 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: INFO nova.api.openstack.requestlog [None req-0b55a18b-9518-46df-aee4-c36d9da3fa66 admin admin] 10.222.0.43 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011231 Jun 22 10:10:22.669414 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: [pid: 103375|app: 0|req: 34/66] 10.222.0.43 () {60 vars in 1285 bytes} [Wed Jun 22 10:10:22 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:10:22.681570 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi [None req-0feacba8-6024-4ee2-8df4-4b2e0af7cf22 admin admin] Calling method '>' {{(pid=103374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:10:22.690730 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: INFO nova.api.openstack.requestlog [None req-0feacba8-6024-4ee2-8df4-4b2e0af7cf22 admin admin] 10.222.0.43 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013392 Jun 22 10:10:22.691250 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: [pid: 103374|app: 0|req: 33/67] 10.222.0.43 () {60 vars in 1285 bytes} [Wed Jun 22 10:10:22 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:10:22.703364 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi [None req-e8e9cd7a-b564-4b74-a4ba-eaeebd817e07 admin admin] Calling method '>' {{(pid=103375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:10:22.711141 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: INFO nova.api.openstack.requestlog [None req-e8e9cd7a-b564-4b74-a4ba-eaeebd817e07 admin admin] 10.222.0.43 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011439 Jun 22 10:10:22.711658 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: [pid: 103375|app: 0|req: 35/68] 10.222.0.43 () {60 vars in 1282 bytes} [Wed Jun 22 10:10:22 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:13:40.618087 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi [None req-0feacba8-6024-4ee2-8df4-4b2e0af7cf22 admin admin] Calling method '>' {{(pid=103374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:13:40.619106 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: INFO nova.api.openstack.requestlog [None req-0feacba8-6024-4ee2-8df4-4b2e0af7cf22 admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001506 Jun 22 10:13:40.619520 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: [pid: 103374|app: 0|req: 34/69] 10.222.0.43 () {56 vars in 1074 bytes} [Wed Jun 22 10:13:40 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 10:13:40.767005 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG dbcounter [-] [103375] Writing DB stats nova_api:SELECT=6 {{(pid=103375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:13:40.899358 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi [None req-7dcd74b0-38be-4dde-ba9d-2f2122e79775 admin admin] Calling method '>' {{(pid=103375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:13:40.900586 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 22 10:13:40.900586 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: warnings.warn(msg) Jun 22 10:13:40.901850 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG oslo_concurrency.lockutils [None req-7dcd74b0-38be-4dde-ba9d-2f2122e79775 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:13:40.902299 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG oslo_concurrency.lockutils [None req-7dcd74b0-38be-4dde-ba9d-2f2122e79775 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:13:40.903142 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG oslo_concurrency.lockutils [None req-7dcd74b0-38be-4dde-ba9d-2f2122e79775 admin admin] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:13:40.903578 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG oslo_concurrency.lockutils [None req-7dcd74b0-38be-4dde-ba9d-2f2122e79775 admin admin] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:13:40.938221 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: INFO nova.api.openstack.requestlog [None req-7dcd74b0-38be-4dde-ba9d-2f2122e79775 admin admin] 10.222.0.43 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.172615 Jun 22 10:13:40.938778 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: [pid: 103375|app: 0|req: 36/70] 10.222.0.43 () {60 vars in 1193 bytes} [Wed Jun 22 10:13:40 2022] GET /compute/v2.1/os-services => generated 791 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 22 10:13:41.782647 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi [None req-0feacba8-6024-4ee2-8df4-4b2e0af7cf22 admin admin] Calling method '>' {{(pid=103374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:13:41.783665 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: INFO nova.api.openstack.requestlog [None req-0feacba8-6024-4ee2-8df4-4b2e0af7cf22 admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001427 Jun 22 10:13:41.784058 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: [pid: 103374|app: 0|req: 35/71] 10.222.0.43 () {56 vars in 1074 bytes} [Wed Jun 22 10:13:41 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 10:13:41.978490 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi [None req-61749f25-2ce8-4783-bd12-2fbdef52e896 admin admin] Calling method '>' {{(pid=103375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:13:41.979924 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 22 10:13:41.979924 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: warnings.warn(msg) Jun 22 10:13:41.981102 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG oslo_concurrency.lockutils [None req-61749f25-2ce8-4783-bd12-2fbdef52e896 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:13:41.981572 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG oslo_concurrency.lockutils [None req-61749f25-2ce8-4783-bd12-2fbdef52e896 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:13:41.982408 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG oslo_concurrency.lockutils [None req-61749f25-2ce8-4783-bd12-2fbdef52e896 admin admin] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:13:41.982838 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG oslo_concurrency.lockutils [None req-61749f25-2ce8-4783-bd12-2fbdef52e896 admin admin] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:13:42.003885 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: INFO nova.api.openstack.requestlog [None req-61749f25-2ce8-4783-bd12-2fbdef52e896 admin admin] 10.222.0.43 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.079068 Jun 22 10:13:42.004583 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: [pid: 103375|app: 0|req: 37/72] 10.222.0.43 () {60 vars in 1193 bytes} [Wed Jun 22 10:13:41 2022] GET /compute/v2.1/os-services => generated 791 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 22 10:13:53.273340 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi [None req-0feacba8-6024-4ee2-8df4-4b2e0af7cf22 admin admin] Calling method '>' {{(pid=103374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:13:53.274407 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: INFO nova.api.openstack.requestlog [None req-0feacba8-6024-4ee2-8df4-4b2e0af7cf22 admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001498 Jun 22 10:13:53.274786 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: [pid: 103374|app: 0|req: 36/73] 10.222.0.43 () {56 vars in 1074 bytes} [Wed Jun 22 10:13:53 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 10:13:53.417996 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG dbcounter [-] [103375] Writing DB stats nova_cell0:SELECT=4 {{(pid=103375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:13:53.418717 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG dbcounter [-] [103375] Writing DB stats nova_cell1:SELECT=4 {{(pid=103375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:13:53.419315 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG dbcounter [-] [103375] Writing DB stats nova_api:SELECT=8 {{(pid=103375) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:13:53.468609 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi [None req-c90762d9-cff1-478a-b5b8-2c6c8038fb7f admin admin] Calling method '>' {{(pid=103375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:13:53.469828 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 22 10:13:53.469828 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: warnings.warn(msg) Jun 22 10:13:53.471039 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG oslo_concurrency.lockutils [None req-c90762d9-cff1-478a-b5b8-2c6c8038fb7f admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:13:53.471476 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG oslo_concurrency.lockutils [None req-c90762d9-cff1-478a-b5b8-2c6c8038fb7f admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:13:53.472252 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG oslo_concurrency.lockutils [None req-c90762d9-cff1-478a-b5b8-2c6c8038fb7f admin admin] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:13:53.472679 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG oslo_concurrency.lockutils [None req-c90762d9-cff1-478a-b5b8-2c6c8038fb7f admin admin] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:13:53.500541 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: INFO nova.api.openstack.requestlog [None req-c90762d9-cff1-478a-b5b8-2c6c8038fb7f admin admin] 10.222.0.43 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.087517 Jun 22 10:13:53.501102 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: [pid: 103375|app: 0|req: 38/74] 10.222.0.43 () {60 vars in 1193 bytes} [Wed Jun 22 10:13:53 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 10:13:54.362151 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: DEBUG nova.api.openstack.wsgi [None req-0feacba8-6024-4ee2-8df4-4b2e0af7cf22 admin admin] Calling method '>' {{(pid=103374) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:13:54.363159 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: INFO nova.api.openstack.requestlog [None req-0feacba8-6024-4ee2-8df4-4b2e0af7cf22 admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001526 Jun 22 10:13:54.363549 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: [pid: 103374|app: 0|req: 37/75] 10.222.0.43 () {56 vars in 1074 bytes} [Wed Jun 22 10:13:54 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 10:13:54.555243 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG nova.api.openstack.wsgi [None req-a9a67c3a-3d9f-4b7d-8583-99da9d32b4b5 admin admin] Calling method '>' {{(pid=103375) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:13:54.556411 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 22 10:13:54.556411 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: warnings.warn(msg) Jun 22 10:13:54.557656 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG oslo_concurrency.lockutils [None req-a9a67c3a-3d9f-4b7d-8583-99da9d32b4b5 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:13:54.558141 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG oslo_concurrency.lockutils [None req-a9a67c3a-3d9f-4b7d-8583-99da9d32b4b5 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:13:54.558945 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG oslo_concurrency.lockutils [None req-a9a67c3a-3d9f-4b7d-8583-99da9d32b4b5 admin admin] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:13:54.559385 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: DEBUG oslo_concurrency.lockutils [None req-a9a67c3a-3d9f-4b7d-8583-99da9d32b4b5 admin admin] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103375) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:13:54.581317 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: INFO nova.api.openstack.requestlog [None req-a9a67c3a-3d9f-4b7d-8583-99da9d32b4b5 admin admin] 10.222.0.43 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.078125 Jun 22 10:13:54.581883 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: [pid: 103375|app: 0|req: 39/76] 10.222.0.43 () {60 vars in 1193 bytes} [Wed Jun 22 10:13:54 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 10:14:50.216700 dv-cinder-847131-1-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Jun 22 10:14:50.217347 dv-cinder-847131-1-iscsi devstack@n-api.service[103373]: Wed Jun 22 10:14:50 2022 - graceful shutdown triggered... Jun 22 10:14:50.217808 dv-cinder-847131-1-iscsi devstack@n-api.service[103375]: Gracefully killing worker 2 (pid: 103375)... Jun 22 10:14:50.218167 dv-cinder-847131-1-iscsi devstack@n-api.service[103374]: Gracefully killing worker 1 (pid: 103374)... Jun 22 10:14:51.218174 dv-cinder-847131-1-iscsi devstack@n-api.service[103373]: worker 1 buried after 1 seconds Jun 22 10:14:51.218649 dv-cinder-847131-1-iscsi devstack@n-api.service[103373]: worker 2 buried after 1 seconds Jun 22 10:14:51.218649 dv-cinder-847131-1-iscsi devstack@n-api.service[103373]: goodbye to uWSGI. Jun 22 10:14:51.219806 dv-cinder-847131-1-iscsi systemd[1]: devstack@n-api.service: Succeeded. Jun 22 10:14:51.220350 dv-cinder-847131-1-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Jun 22 10:14:51.223233 dv-cinder-847131-1-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jun 22 10:14:51.234620 dv-cinder-847131-1-iscsi devstack@n-api.service[117853]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jun 22 10:14:51.238081 dv-cinder-847131-1-iscsi devstack@n-api.service[117853]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Jun 22 10:14:51 2022] *** Jun 22 10:14:51.238081 dv-cinder-847131-1-iscsi devstack@n-api.service[117853]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jun 22 10:14:51.238081 dv-cinder-847131-1-iscsi devstack@n-api.service[117853]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jun 22 10:14:51.238081 dv-cinder-847131-1-iscsi devstack@n-api.service[117853]: nodename: dv-cinder-847131-1-iscsi Jun 22 10:14:51.238081 dv-cinder-847131-1-iscsi devstack@n-api.service[117853]: machine: x86_64 Jun 22 10:14:51.238081 dv-cinder-847131-1-iscsi devstack@n-api.service[117853]: clock source: unix Jun 22 10:14:51.238081 dv-cinder-847131-1-iscsi devstack@n-api.service[117853]: pcre jit disabled Jun 22 10:14:51.238081 dv-cinder-847131-1-iscsi devstack@n-api.service[117853]: detected number of CPU cores: 4 Jun 22 10:14:51.238081 dv-cinder-847131-1-iscsi devstack@n-api.service[117853]: current working directory: / Jun 22 10:14:51.238081 dv-cinder-847131-1-iscsi devstack@n-api.service[117853]: detected binary path: /usr/bin/uwsgi-core Jun 22 10:14:51.238081 dv-cinder-847131-1-iscsi devstack@n-api.service[117853]: your processes number limit is 47680 Jun 22 10:14:51.238081 dv-cinder-847131-1-iscsi devstack@n-api.service[117853]: your memory page size is 4096 bytes Jun 22 10:14:51.238081 dv-cinder-847131-1-iscsi devstack@n-api.service[117853]: detected max file descriptor number: 2048 Jun 22 10:14:51.238081 dv-cinder-847131-1-iscsi devstack@n-api.service[117853]: lock engine: pthread robust mutexes Jun 22 10:14:51.238081 dv-cinder-847131-1-iscsi devstack@n-api.service[117853]: thunder lock: enabled Jun 22 10:14:51.238081 dv-cinder-847131-1-iscsi devstack@n-api.service[117853]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jun 22 10:14:51.238081 dv-cinder-847131-1-iscsi devstack@n-api.service[117853]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jun 22 10:14:51.284075 dv-cinder-847131-1-iscsi devstack@n-api.service[117853]: Python main interpreter initialized at 0x55606a8d29c0 Jun 22 10:14:51.284075 dv-cinder-847131-1-iscsi devstack@n-api.service[117853]: python threads support enabled Jun 22 10:14:51.284075 dv-cinder-847131-1-iscsi devstack@n-api.service[117853]: your server socket listen backlog is limited to 100 connections Jun 22 10:14:51.284075 dv-cinder-847131-1-iscsi devstack@n-api.service[117853]: your mercy for graceful operations on workers is 90 seconds Jun 22 10:14:51.284521 dv-cinder-847131-1-iscsi devstack@n-api.service[117853]: mapped 403077 bytes (393 KB) for 2 cores Jun 22 10:14:51.284521 dv-cinder-847131-1-iscsi devstack@n-api.service[117853]: *** Operational MODE: preforking *** Jun 22 10:14:51.284801 dv-cinder-847131-1-iscsi devstack@n-api.service[117853]: *** uWSGI is running in multiple interpreter mode *** Jun 22 10:14:51.284801 dv-cinder-847131-1-iscsi devstack@n-api.service[117853]: spawned uWSGI master process (pid: 117853) Jun 22 10:14:51.285036 dv-cinder-847131-1-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jun 22 10:14:51.285645 dv-cinder-847131-1-iscsi devstack@n-api.service[117853]: spawned uWSGI worker 1 (pid: 117873, cores: 1) Jun 22 10:14:51.293969 dv-cinder-847131-1-iscsi devstack@n-api.service[117853]: spawned uWSGI worker 2 (pid: 117874, cores: 1) Jun 22 10:14:51.293969 dv-cinder-847131-1-iscsi devstack@n-api.service[117853]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jun 22 10:14:51.955264 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 22 10:14:51.959256 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 22 10:14:53.166332 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 22 10:14:53.166332 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: from cryptography.utils import int_from_bytes Jun 22 10:14:53.167065 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 22 10:14:53.167065 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: from cryptography.utils import int_from_bytes Jun 22 10:14:53.168523 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 22 10:14:53.168523 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: from cryptography.utils import int_from_bytes Jun 22 10:14:53.168957 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 22 10:14:53.168957 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: from cryptography.utils import int_from_bytes Jun 22 10:14:55.568055 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 22 10:14:55.568655 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 22 10:14:55.568856 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 22 10:14:55.569217 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 22 10:14:55.569468 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 22 10:14:55.570085 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:14:55.570391 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:14:55.570715 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:14:55.571037 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:14:55.571369 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:14:55.571678 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:14:55.571997 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:14:55.572319 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:14:55.572647 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:14:55.572912 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:14:55.573225 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:14:55.573552 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-847131-1-iscsi {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:14:55.573921 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:14:55.574230 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:14:55.574536 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:14:55.574857 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:14:55.575159 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:14:55.575492 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:14:55.575782 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:14:55.576299 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:14:55.577055 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:14:55.577339 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:14:55.577811 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:14:55.578176 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:14:55.578408 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:14:55.578713 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:14:55.579032 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:14:55.579347 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:14:55.579670 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:14:55.580163 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:14:55.580574 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-847131-1-iscsi {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:14:55.580914 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:14:55.581285 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:14:55.581506 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:14:55.581964 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:14:55.582288 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:14:55.582600 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:14:55.583465 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:14:55.583798 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:14:55.584103 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:14:55.584429 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:14:55.584745 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:14:55.585061 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:14:55.585378 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:14:55.585724 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:14:55.586036 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:14:55.586351 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:14:55.586667 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:14:55.586967 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:14:55.587270 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:14:55.587517 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:14:55.587819 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:14:55.588136 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:14:55.588450 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:14:55.588768 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:14:55.589017 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:14:55.589263 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:14:55.589575 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:14:55.589916 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:14:55.590222 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:14:55.590525 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:14:55.590831 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:14:55.591134 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:14:55.591436 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:14:55.591740 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:14:55.592043 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:14:55.592346 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:14:55.592659 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:14:55.592971 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:14:55.593413 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:14:55.593593 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:14:55.593935 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:14:55.594330 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.43 {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:14:55.594579 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.43 {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:14:55.594884 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:14:55.595224 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:14:55.595542 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:14:55.595848 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:14:55.596168 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:14:55.596486 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:14:55.596792 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:14:55.597097 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:14:55.597400 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 22 10:14:55.597858 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:14:55.597957 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 22 10:14:55.598062 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:14:55.598062 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:14:55.598215 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 22 10:14:55.598377 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:14:55.598585 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 22 10:14:55.598742 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:14:55.598850 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 22 10:14:55.599177 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:14:55.599270 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:14:55.599487 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:14:55.599585 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:14:55.599809 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:14:55.599919 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:14:55.600119 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:14:55.600213 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:14:55.600429 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:14:55.600521 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:14:55.600737 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:14:55.600844 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:14:55.601037 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:14:55.601137 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:14:55.601344 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:14:55.601436 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:14:55.601649 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:14:55.601775 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:14:55.601982 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:14:55.602082 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:14:55.602287 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:14:55.602429 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:14:55.602593 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:14:55.602696 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-847131-1-iscsi {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:14:55.602896 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:14:55.602996 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:14:55.603203 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:14:55.603342 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:14:55.603506 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:14:55.603628 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:14:55.603808 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:14:55.603937 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:14:55.604116 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:14:55.604503 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:14:55.604687 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:14:55.604807 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:14:55.604992 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:14:55.605120 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:14:55.605297 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:14:55.605501 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:14:55.605645 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:14:55.605840 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:14:55.605976 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:14:55.606151 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:14:55.606400 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:14:55.606528 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:14:55.606713 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:14:55.606834 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:14:55.607100 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:14:55.607230 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:14:55.607350 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:14:55.607474 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:14:55.608712 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:14:55.608908 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:14:55.609010 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:14:55.609108 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:14:55.609200 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:14:55.609293 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:14:55.609385 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:14:55.609483 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:14:55.609576 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:14:55.609660 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-847131-1-iscsi {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:14:55.609790 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:14:55.610874 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:14:55.611057 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:14:55.611172 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:14:55.611260 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:14:55.611260 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:14:55.611421 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:14:55.611520 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:14:55.611613 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:14:55.611705 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:14:55.611808 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:14:55.611896 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:14:55.611986 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:14:55.612079 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:14:55.612169 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:14:55.612256 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:14:55.612366 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:14:55.612452 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:14:55.612534 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:14:55.612636 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:14:55.612636 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:14:55.612801 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:14:55.612893 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:14:55.613030 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:14:55.613128 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:14:55.613221 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:14:55.613317 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:14:55.613409 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:14:55.613529 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:14:55.613621 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:14:55.613859 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:14:55.613973 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:14:55.614192 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:14:55.614286 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:14:55.614509 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:14:55.614609 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:14:55.614844 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.614962 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:14:55.615175 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.615289 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:14:55.615518 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:14:55.615632 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.615820 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:14:55.615915 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.616146 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.616246 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:14:55.616467 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:14:55.616563 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.616780 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.616879 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:14:55.617033 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:14:55.617152 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.617295 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:14:55.617402 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.617594 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:14:55.617726 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.617942 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:14:55.618096 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.618236 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:14:55.618386 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.618552 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:14:55.618695 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.618864 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:14:55.618965 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.619174 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:14:55.619267 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.619482 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:14:55.619582 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.619791 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:14:55.619892 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.620100 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:14:55.620193 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.620408 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:14:55.620501 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.620720 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.620851 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:14:55.621035 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:14:55.621146 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.621357 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.621455 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:14:55.621666 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:14:55.621830 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.621997 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.622097 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:14:55.622333 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.622433 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.43 {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:14:55.622637 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.43 {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:14:55.622737 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.622951 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:14:55.623051 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.623275 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.623374 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:14:55.623593 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.623742 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:14:55.623904 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:14:55.624005 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.624211 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.624303 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:14:55.624518 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.624680 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:14:55.624832 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:14:55.624931 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.625265 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.625371 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:14:55.625457 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.625550 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:14:55.625799 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.625895 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:14:55.626111 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.626212 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:14:55.626422 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.626523 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:14:55.626726 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:14:55.626817 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.627033 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:14:55.627131 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.627341 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.627434 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:14:55.627664 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:14:55.627762 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.627973 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.628065 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:14:55.628286 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:14:55.628430 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.628594 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.628685 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:14:55.628896 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:14:55.628998 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.629205 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.629304 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:14:55.629513 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.630195 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:14:55.630359 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.630564 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:14:55.630798 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.630899 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:14:55.631106 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.631275 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:14:55.631412 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.631566 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:14:55.631703 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.631857 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:14:55.632009 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.632173 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:14:55.632328 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.632490 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:14:55.632652 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.632813 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:14:55.632957 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.633137 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:14:55.633286 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.633449 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:14:55.633589 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.633783 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:14:55.633925 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.634096 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:14:55.634262 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.634485 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:14:55.634589 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.634815 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.634956 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:14:55.635126 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.635614 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:14:55.635869 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.635956 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:14:55.636039 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.636130 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:14:55.636228 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.636314 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:14:55.636465 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.636601 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:14:55.636767 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.636923 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:14:55.637088 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.637238 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:14:55.637392 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.637549 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:14:55.637779 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.637892 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:14:55.638020 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.638181 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:14:55.638434 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.638523 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:14:55.638626 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.638798 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:14:55.638936 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.639109 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:14:55.639245 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.639420 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:14:55.639563 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.639730 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:14:55.639876 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.640039 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:14:55.640186 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.640348 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:14:55.640518 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.640710 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:14:55.640846 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.641046 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:14:55.641150 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.641358 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:14:55.641471 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.641662 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:14:55.641832 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.642012 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:14:55.642140 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.642345 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:14:55.642436 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.642659 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:14:55.642741 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.642970 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:14:55.643064 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.643280 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:14:55.643376 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.643598 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.643704 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:14:55.644135 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.644240 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.644315 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.644401 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.644474 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.644597 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.644774 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.644916 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.645074 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.645294 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.645935 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.646149 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.646426 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.646564 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.646740 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.646873 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.647046 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.647177 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.647351 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.647493 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.647644 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.647812 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.647981 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.648127 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.648286 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.648445 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.648626 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.648770 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.648960 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.649095 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.649279 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.649429 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.649601 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.649772 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.649945 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.650098 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.650289 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.650421 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.650560 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.650739 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.650862 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.651061 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.651157 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.651392 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.651492 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.651718 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.651878 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.652024 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.652177 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.652412 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.652503 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.652661 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.652755 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.652982 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.653085 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.653292 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.653386 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.653611 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.653734 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.653939 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.654045 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.654252 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.654346 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.654563 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.654657 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.654890 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.654999 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.655208 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.655393 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.655555 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.655657 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.655822 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.655949 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.656139 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.656243 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.656445 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.656540 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.656755 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.656839 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.657123 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.657219 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.657405 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.657495 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.657673 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.657797 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.658009 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.658150 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.658328 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.658469 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.658666 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.658773 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.659006 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.659178 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.659333 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.659425 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.659591 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.659744 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.659895 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.659999 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.660208 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.660310 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.660531 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.660624 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.660881 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.660975 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.661191 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.661432 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.661823 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.661961 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.662051 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.662137 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.662229 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.662393 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.662488 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.662705 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.662807 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.663048 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.663141 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.663351 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.663452 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.663658 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.663758 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.663970 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.664071 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.664277 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.664378 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.664583 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.664675 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.664880 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.664981 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.665191 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.665291 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.665493 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.665584 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.665816 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.665927 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.666125 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.666226 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.666435 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.666526 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.666753 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.666858 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.667059 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.667170 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.667366 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.667463 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.667683 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.667823 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.667981 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.668107 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.668280 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.668374 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.668596 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.668690 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.668901 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.669001 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.669204 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.669297 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.669504 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.669605 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.669829 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.669923 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.670174 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.670278 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.670486 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.670588 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.670787 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.670888 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.671101 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.671193 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.671420 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.671522 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.671727 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.671828 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.672031 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.672136 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.672336 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.672427 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.672641 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.672748 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.672946 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.673052 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.673251 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.673345 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.673557 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.673649 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.673890 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.673999 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.674198 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.674299 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.674506 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.674600 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.674813 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.674920 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.675126 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.675226 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.675430 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.675525 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.675737 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.675831 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.676042 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.676133 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.676342 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.676605 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.676896 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.677145 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.677247 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.677384 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.677384 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.677548 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.677642 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.677885 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.677990 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.678199 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.678335 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.678515 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.678622 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.678831 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.678925 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.679147 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.679277 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.679472 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.679565 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.679797 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.679889 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.680110 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.680231 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.680439 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.680691 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.680825 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.681309 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.681628 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.682005 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.682312 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.682643 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.682962 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.683217 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.683392 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.683560 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.683722 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.684880 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.684978 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.685074 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.685160 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.685243 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.685341 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.685435 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.685520 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.685612 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.685804 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.685905 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.686000 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.686085 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.686176 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.686275 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.686368 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.686461 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.686553 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.686696 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.686835 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.687012 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.687151 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.687336 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.687468 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.687745 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.687877 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.688074 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.688197 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.688393 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.688515 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.688703 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.688837 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.689014 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.689134 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.689324 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.689445 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.689632 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.690643 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.690819 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.690937 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.691050 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.691172 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.691281 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.691378 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.691464 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.691547 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.691654 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.691737 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.691828 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.691926 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.692011 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.692622 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.692711 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.692904 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.693007 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.693284 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.693392 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.693595 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.693709 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.693936 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.694048 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.694257 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.694351 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.694572 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.694674 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.694886 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.694980 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.695195 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.695290 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.695515 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.695611 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.695827 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.695920 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.696132 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.696233 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.696441 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.696535 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.696745 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.696837 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.697064 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.697172 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.697377 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.697479 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.697684 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.697862 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.698013 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.698154 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.698327 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.698433 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.698633 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.698726 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.698935 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.699034 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.699245 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.699347 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.699551 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.699653 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.699857 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.699949 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.700159 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.700304 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.700466 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.700562 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.700768 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.700876 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.701079 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.701182 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.701389 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.701481 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.701711 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.701808 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.702047 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.702142 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.702356 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.702450 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.702661 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.702765 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.702963 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.703096 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.703273 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.703405 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.704086 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.704215 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.704339 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.704454 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.704567 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.704687 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.704809 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.704933 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.705048 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.705168 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.705288 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.705401 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.705527 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.705648 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.705794 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.705908 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.706021 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.706132 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.706297 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.706420 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.706588 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.706718 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.706891 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.707012 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.707270 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.707394 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.707507 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.708473 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.708632 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.708768 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.708907 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.709040 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.709196 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.709342 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.709600 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.709757 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.709861 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.709956 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.710189 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.710914 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.711054 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.711171 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.711294 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.711409 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.711538 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.711653 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.711804 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.711804 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.712075 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.712337 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.712508 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.712662 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.712827 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.713058 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.713227 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.713388 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.713547 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.713547 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.713885 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.714048 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.714210 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.714362 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.714515 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.714666 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.714801 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.714905 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.715001 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.715222 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.715533 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.715840 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.716162 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.716480 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.716794 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.717118 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.717443 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.717874 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.718103 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.718260 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.718396 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.718773 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.719019 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.719155 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.719328 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.719546 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.719692 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.719939 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.720080 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.720253 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.720481 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.720627 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.720867 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.721179 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.721314 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.721489 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.721683 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.721905 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.722122 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.722266 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.722428 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.722646 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.722781 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.723045 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.723189 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.723371 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.723599 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.723751 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.723972 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.724181 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.724336 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.724575 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.724710 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.725013 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.725151 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.725326 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.725565 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.725728 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.725956 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.726102 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.726268 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.726496 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.726643 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.726886 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.727030 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.727198 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.727502 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.727644 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.727989 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.728136 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.728283 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.728459 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.728602 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.728883 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.729124 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.729505 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.729696 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.729932 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.730082 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.730327 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.730462 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.730631 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.730830 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.730975 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.731225 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.731498 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.731634 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.731837 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.731979 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.732156 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.732505 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.732674 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.732822 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.732982 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.733128 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.733281 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.733446 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.733593 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.733853 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.734015 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.734169 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.734324 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.734472 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.734624 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.734778 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.734925 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.735077 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.735231 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.735384 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.735541 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.735700 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.735855 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.736008 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.736161 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.736314 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.736468 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.736627 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.736773 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.736926 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.737073 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.737217 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.737362 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.737532 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.737679 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.737868 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.738041 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.738259 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.738424 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.738580 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.738725 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.738881 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.739713 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.739928 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.740094 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.740259 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.740413 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.740568 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.740724 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.740879 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.741039 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.741186 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.741186 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.741470 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.741615 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.741783 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.741943 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.742096 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.742253 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.742405 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.742551 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.742709 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.742857 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.743008 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.743154 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.743305 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.743450 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.743603 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.743748 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.743901 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.744055 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.744210 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.744364 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.744523 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.744743 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.745009 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.745161 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.745316 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.745463 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.745621 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.745829 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.745977 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.746178 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.746325 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.746494 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.746648 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.746801 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.746956 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.747101 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.747246 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.747402 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.747548 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.747699 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.747853 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.747999 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.748144 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.748391 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.748563 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.748720 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.748914 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.749067 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.749227 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.749381 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.749534 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.749710 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.749935 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.749935 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.750241 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.750396 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.750554 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.750699 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.750850 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.751006 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.751166 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.751319 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.751507 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.751813 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.752020 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.752174 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.752402 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.752568 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.752717 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.752878 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.753032 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.753177 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.753333 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.753478 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.753623 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.753818 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.753975 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.754130 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.754278 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.754433 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.754679 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.755370 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.755628 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.755978 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.756310 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.756628 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.756938 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.757252 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.757567 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.757923 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.758166 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.758516 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.758758 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.759034 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.759290 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.759459 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.759682 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.759953 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.760301 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.760301 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.760797 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.761014 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.761261 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.761261 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.761814 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.761996 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.762155 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.762313 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.762461 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.762461 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.762872 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.763132 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.763379 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.763644 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.763644 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.763968 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.764127 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.764281 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.764428 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.764581 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.764740 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.764886 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.765047 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.765192 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.765338 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.765483 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.765643 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.765825 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.765825 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.766115 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.766269 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.766416 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.766569 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.766738 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.766885 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.767030 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.767174 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.767319 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.767464 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.767618 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.767763 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.767911 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.768064 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.768210 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.768210 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.768532 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.768755 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.768906 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.769073 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.769220 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.769365 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.769518 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.769664 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.769869 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.770018 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.770200 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.770463 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.770463 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.770873 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.771043 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.771192 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.771507 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.771671 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.771875 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.772047 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.772202 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.772497 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.772675 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.772838 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.772991 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.773156 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.773306 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.773465 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.773630 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.773816 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.773969 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.774120 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.774272 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.774423 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.774587 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.774747 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.774900 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.775062 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.775221 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.775374 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.775534 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.775694 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.775845 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.775997 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.776146 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.776308 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.776468 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.776638 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.776791 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.776951 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.777114 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.777277 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.777437 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.777589 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.777770 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.777936 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.778168 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.778335 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.778496 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.778651 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.778899 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.779067 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.779240 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.779404 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.779558 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.779718 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.779870 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.780022 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.780183 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.780379 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.780637 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.780796 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.780796 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.781094 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.781328 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.781519 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.781674 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.781880 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.782043 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.782043 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.782354 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.782507 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.782667 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.782821 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.782821 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.783131 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.783284 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.783443 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.783613 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.783766 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.783917 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.784081 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.784242 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.784394 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.784545 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.784706 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.784865 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.785026 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.785185 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.785345 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.785516 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.785676 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.785938 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.786198 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.786401 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.786565 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.786727 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.786898 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.787061 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.787223 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.787383 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.787543 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.787702 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.787880 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.788042 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.788202 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.788361 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.788530 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.788688 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.788848 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.789176 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.789346 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.789346 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.789652 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.789842 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.789998 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.790179 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.790333 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.790492 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.790492 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.790492 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.791039 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.791192 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.791343 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.791503 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.791503 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.791802 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.791962 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.792122 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.792287 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.792438 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.792597 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.792764 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.792927 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.792927 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.793217 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.793383 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.793535 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.793737 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.793908 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.794061 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.794220 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.794383 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.794534 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.794695 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.794847 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.794998 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.795149 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.795301 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.795451 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.795611 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.795763 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.795922 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.796074 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.796236 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.796395 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.796624 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.796786 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.796946 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.797097 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.797249 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.797407 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.797568 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.797749 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.797918 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.798071 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.798229 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.798407 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.798407 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.798707 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.798707 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.798994 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.799239 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.799408 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.799408 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.799698 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.799855 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.800017 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.800177 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.800343 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.800514 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.800666 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.800824 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.801077 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.801243 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.801411 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.802202 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.802356 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.802356 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.802356 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.802793 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.802953 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.803123 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.803276 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.803434 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.803587 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.803747 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.803905 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.804057 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.804217 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.804368 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.804520 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.804680 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.804840 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.804992 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.805155 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.805155 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.805456 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.805608 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.805782 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.805948 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.806107 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.806268 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.806440 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.806600 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.806753 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.806913 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.807083 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.807235 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.807395 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.807548 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.807700 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.807860 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.808011 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.808170 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.808340 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.808500 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.808658 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.808818 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.808971 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.809141 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.809880 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.810048 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.810205 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.810368 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.810520 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.810682 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.810682 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.811064 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.811306 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.811472 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.811633 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.811633 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.811953 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.812106 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.812106 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.812402 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.812563 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.812715 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.812867 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.813065 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.813221 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.813372 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.813532 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.813684 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.813918 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.814083 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.814236 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.814387 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.814553 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.814704 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.814856 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.814856 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.815152 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.815305 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.815465 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.815617 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.815779 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.815931 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.816082 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.816244 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.816403 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.816557 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.816557 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.816861 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.817021 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.817750 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.817926 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.818080 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.818233 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.818406 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.818559 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.818559 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.818559 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.819001 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.819151 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.819451 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.819728 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.820124 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.820342 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.820648 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.820883 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.821059 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.821254 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.821560 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.821785 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.821955 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.822118 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.822280 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.822444 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.822596 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.822754 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.822914 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.823112 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.823290 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.823444 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.823595 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.823747 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.823896 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.824048 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.824240 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.824400 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.824559 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.824712 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.824871 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.825032 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.825197 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.825360 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.825512 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.825664 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.825858 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.826028 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.826188 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.826341 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.826499 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.826661 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.826813 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.826972 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.827124 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.827293 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.827445 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.827596 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.827747 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.827907 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.828059 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.828266 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.828433 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.828585 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.828737 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.828972 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.829216 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.829562 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.829805 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.829965 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.830130 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.830301 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.830455 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.830604 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.830764 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.830924 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.831085 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.831243 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.831402 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.831659 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.831828 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.831982 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.832147 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.832307 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.832526 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.832727 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.832887 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.833051 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.833239 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.833405 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.833558 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.833742 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.833901 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.834082 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.834235 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.834395 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.834548 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.834698 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.834849 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.835010 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.835163 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.835321 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.835481 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.835778 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.835948 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.836110 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.836272 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.836436 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.836588 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.836739 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.836898 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.837059 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117874) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 22 10:14:55.837213 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.837364 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.837663 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.838022 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.838330 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.838638 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.838959 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.839275 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.839582 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.839960 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.840281 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.840706 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.841016 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.841730 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.842030 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.842366 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.842679 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.842989 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.843557 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.843883 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.844195 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.844505 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.844817 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.845121 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.845440 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.846377 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.846699 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.847011 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.847329 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.847633 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.847945 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.848325 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.848669 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.848984 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.849293 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.849615 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.849957 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.850280 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.850705 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.851024 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.851376 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.852044 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.852613 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.852949 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.853271 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.853886 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.854227 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.854791 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.855100 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.855409 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.855734 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.856229 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.856554 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.856870 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.857186 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.857503 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.857840 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.858155 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.858654 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.858997 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.859390 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.861280 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.861280 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.861280 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.861280 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.861280 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.862434 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.862434 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.862757 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.863062 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.863476 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.864591 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.864909 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.865840 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.866187 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.866529 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.866851 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.867162 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.868151 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.868151 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.868479 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.868641 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.869372 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.869747 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.870064 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.870379 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.870740 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.871011 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.871343 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.871684 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.872347 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.872678 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.872985 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.873291 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.873595 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.874169 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.874496 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.874808 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.875112 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.875555 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.876226 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.876226 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.876547 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.876708 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.876895 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.877205 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.877507 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.877832 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.878137 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.878446 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.878749 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.879054 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.879363 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.880265 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.880571 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.880893 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.881180 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.881481 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.882130 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.883010 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.883340 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.883667 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.884225 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.884561 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.884875 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.885199 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.885523 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.885868 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.886183 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.886517 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.886828 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.887139 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.887454 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.887768 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.888078 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.888389 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.888726 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.889053 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.889357 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.889680 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.890020 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.890341 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.890656 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.891030 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.891298 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.891588 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.891896 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.892531 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.893306 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.893751 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.894192 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.894533 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.894867 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.895248 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.895605 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.895936 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.896266 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.896617 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.896934 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.897282 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.897611 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.897970 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.898291 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.899053 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:14:55.899299 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117873) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 22 10:14:55.901254 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO dbcounter [None req-cd94d74b-8217-4e68-a404-3809b92a17e8 None None] Registered counter for database nova_api Jun 22 10:14:55.922318 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_db.sqlalchemy.engines [None req-cd94d74b-8217-4e68-a404-3809b92a17e8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117874) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 22 10:14:55.929771 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG dbcounter [-] [117874] Writer thread running {{(pid=117874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 22 10:14:55.967924 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO dbcounter [None req-799c9ec3-9676-4261-8287-0544e66b8a37 None None] Registered counter for database nova_api Jun 22 10:14:55.987309 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.context [None req-cd94d74b-8217-4e68-a404-3809b92a17e8 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),3a2aa31d-c4ea-4d33-acd1-474d1dd4c687(cell1) {{(pid=117874) load_cells /opt/stack/nova/nova/context.py:464}} Jun 22 10:14:55.988214 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_db.sqlalchemy.engines [None req-799c9ec3-9676-4261-8287-0544e66b8a37 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117873) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 22 10:14:55.991952 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-cd94d74b-8217-4e68-a404-3809b92a17e8 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:14:55.993580 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-cd94d74b-8217-4e68-a404-3809b92a17e8 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:14:55.994403 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-cd94d74b-8217-4e68-a404-3809b92a17e8 None None] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:14:55.995365 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG dbcounter [-] [117873] Writer thread running {{(pid=117873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 22 10:14:55.996374 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-cd94d74b-8217-4e68-a404-3809b92a17e8 None None] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:14:55.998399 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO dbcounter [None req-cd94d74b-8217-4e68-a404-3809b92a17e8 None None] Registered counter for database nova_cell0 Jun 22 10:14:56.002413 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO dbcounter [None req-cd94d74b-8217-4e68-a404-3809b92a17e8 None None] Registered counter for database nova_cell1 Jun 22 10:14:56.010017 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_db.sqlalchemy.engines [None req-cd94d74b-8217-4e68-a404-3809b92a17e8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117874) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 22 10:14:56.011754 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_db.sqlalchemy.engines [None req-cd94d74b-8217-4e68-a404-3809b92a17e8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117874) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 22 10:14:56.017586 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG dbcounter [-] [117874] Writer thread running {{(pid=117874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 22 10:14:56.019659 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG dbcounter [-] [117874] Writer thread running {{(pid=117874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 22 10:14:56.051982 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.context [None req-799c9ec3-9676-4261-8287-0544e66b8a37 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),3a2aa31d-c4ea-4d33-acd1-474d1dd4c687(cell1) {{(pid=117873) load_cells /opt/stack/nova/nova/context.py:464}} Jun 22 10:14:56.056283 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-799c9ec3-9676-4261-8287-0544e66b8a37 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:14:56.058003 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-799c9ec3-9676-4261-8287-0544e66b8a37 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:14:56.058817 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-799c9ec3-9676-4261-8287-0544e66b8a37 None None] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:14:56.060801 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-799c9ec3-9676-4261-8287-0544e66b8a37 None None] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:14:56.062848 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO dbcounter [None req-799c9ec3-9676-4261-8287-0544e66b8a37 None None] Registered counter for database nova_cell0 Jun 22 10:14:56.066912 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO dbcounter [None req-799c9ec3-9676-4261-8287-0544e66b8a37 None None] Registered counter for database nova_cell1 Jun 22 10:14:56.074965 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_db.sqlalchemy.engines [None req-799c9ec3-9676-4261-8287-0544e66b8a37 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117873) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 22 10:14:56.076422 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_db.sqlalchemy.engines [None req-799c9ec3-9676-4261-8287-0544e66b8a37 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117873) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 22 10:14:56.083546 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG dbcounter [-] [117873] Writer thread running {{(pid=117873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 22 10:14:56.085778 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG dbcounter [-] [117873] Writer thread running {{(pid=117873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 22 10:14:56.168846 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO dbcounter [None req-cd94d74b-8217-4e68-a404-3809b92a17e8 None None] Registered counter for database nova_cell0 Jun 22 10:14:56.175405 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_db.sqlalchemy.engines [None req-cd94d74b-8217-4e68-a404-3809b92a17e8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117874) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 22 10:14:56.180312 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG dbcounter [-] [117874] Writer thread running {{(pid=117874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 22 10:14:56.236133 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO dbcounter [None req-799c9ec3-9676-4261-8287-0544e66b8a37 None None] Registered counter for database nova_cell0 Jun 22 10:14:56.243987 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_db.sqlalchemy.engines [None req-799c9ec3-9676-4261-8287-0544e66b8a37 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117873) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 22 10:14:56.248751 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG dbcounter [-] [117873] Writer thread running {{(pid=117873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 22 10:14:56.502396 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: WARNING keystonemiddleware.auth_token [None req-cd94d74b-8217-4e68-a404-3809b92a17e8 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 22 10:14:56.511671 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: WARNING keystonemiddleware.auth_token [None req-cd94d74b-8217-4e68-a404-3809b92a17e8 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 22 10:14:56.573185 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: WARNING keystonemiddleware.auth_token [None req-799c9ec3-9676-4261-8287-0544e66b8a37 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 22 10:14:56.580869 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: WARNING keystonemiddleware.auth_token [None req-799c9ec3-9676-4261-8287-0544e66b8a37 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 22 10:14:56.853499 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: WARNING keystonemiddleware.auth_token [None req-cd94d74b-8217-4e68-a404-3809b92a17e8 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 22 10:14:56.860042 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: WARNING keystonemiddleware.auth_token [None req-cd94d74b-8217-4e68-a404-3809b92a17e8 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 22 10:14:56.866885 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55606a8d29c0 pid: 117874 (default app) Jun 22 10:14:56.929734 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: WARNING keystonemiddleware.auth_token [None req-799c9ec3-9676-4261-8287-0544e66b8a37 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 22 10:14:56.935646 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: WARNING keystonemiddleware.auth_token [None req-799c9ec3-9676-4261-8287-0544e66b8a37 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 22 10:14:56.940998 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55606a8d29c0 pid: 117873 (default app) Jun 22 10:15:36.103682 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG dbcounter [-] [117874] Writing DB stats nova_api:SELECT=3 {{(pid=117874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:15:36.104758 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG dbcounter [-] [117874] Writing DB stats nova_cell0:SELECT=3 {{(pid=117874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:15:36.105736 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG dbcounter [-] [117874] Writing DB stats nova_cell1:SELECT=3 {{(pid=117874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:15:36.106629 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG dbcounter [-] [117874] Writing DB stats nova_cell0:SELECT=3 {{(pid=117874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:15:37.097279 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-9dc1ce3b-733a-43fc-8a27-dfe114433cf4 tempest-VolumesSnapshotsTestJSON-19151305 tempest-VolumesSnapshotsTestJSON-19151305-project] Action: 'create', calling method: .version_select at 0x7f36c0506790>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-868421128"}} {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:15:39.441293 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [None req-9dc1ce3b-733a-43fc-8a27-dfe114433cf4 tempest-VolumesSnapshotsTestJSON-19151305 tempest-VolumesSnapshotsTestJSON-19151305-project] 10.222.0.43 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 3.349935 Jun 22 10:15:39.445840 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 1/1] 10.222.0.43 () {60 vars in 1154 bytes} [Wed Jun 22 10:15:36 2022] POST /compute/v2.1/os-volumes => generated 344 bytes in 3356 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jun 22 10:15:39.456919 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG dbcounter [-] [117873] Writing DB stats nova_api:SELECT=3 {{(pid=117873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:15:39.458040 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG dbcounter [-] [117873] Writing DB stats nova_cell1:SELECT=3 {{(pid=117873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:15:39.459889 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG dbcounter [-] [117873] Writing DB stats nova_cell0:SELECT=3 {{(pid=117873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:15:39.468258 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG dbcounter [-] [117873] Writing DB stats nova_cell0:SELECT=3 {{(pid=117873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:15:39.902892 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-549b2d5c-c27b-4ec5-9813-9f2e99acf941 tempest-VolumesSnapshotsTestJSON-19151305 tempest-VolumesSnapshotsTestJSON-19151305-project] Calling method '.version_select at 0x7f36c0557430>' {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:15:40.688468 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [None req-549b2d5c-c27b-4ec5-9813-9f2e99acf941 tempest-VolumesSnapshotsTestJSON-19151305 tempest-VolumesSnapshotsTestJSON-19151305-project] 10.222.0.43 "GET /compute/v2.1/os-volumes/df4e9d4e-47e5-41c7-8f4d-ee71c1439fbc" status: 200 len: 345 microversion: 2.1 time: 1.237401 Jun 22 10:15:40.702938 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 1/2] 10.222.0.43 () {58 vars in 1244 bytes} [Wed Jun 22 10:15:39 2022] GET /compute/v2.1/os-volumes/df4e9d4e-47e5-41c7-8f4d-ee71c1439fbc => generated 345 bytes in 1254 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 10:15:40.709195 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-951e7e23-8652-4fcf-b388-86629e0fc510 tempest-VolumesSnapshotsTestJSON-19151305 tempest-VolumesSnapshotsTestJSON-19151305-project] Action: 'create', calling method: .version_select at 0x7f36c03cf550>, body: {"snapshot": {"volume_id": "df4e9d4e-47e5-41c7-8f4d-ee71c1439fbc", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-372246833"}} {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:15:41.087395 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [None req-951e7e23-8652-4fcf-b388-86629e0fc510 tempest-VolumesSnapshotsTestJSON-19151305 tempest-VolumesSnapshotsTestJSON-19151305-project] 10.222.0.43 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.383321 Jun 22 10:15:41.093980 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 2/3] 10.222.0.43 () {60 vars in 1161 bytes} [Wed Jun 22 10:15:40 2022] POST /compute/v2.1/os-snapshots => generated 286 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 10:15:41.100321 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-f0a40224-12a4-4fd9-a678-639f3021f1c8 tempest-VolumesSnapshotsTestJSON-19151305 tempest-VolumesSnapshotsTestJSON-19151305-project] Calling method '.version_select at 0x7f36c0416550>' {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:15:41.233712 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [None req-f0a40224-12a4-4fd9-a678-639f3021f1c8 tempest-VolumesSnapshotsTestJSON-19151305 tempest-VolumesSnapshotsTestJSON-19151305-project] 10.222.0.43 "GET /compute/v2.1/os-snapshots/d05668fa-856c-4ee6-998c-102525b50501" status: 200 len: 286 microversion: 2.1 time: 0.138988 Jun 22 10:15:41.234261 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 2/4] 10.222.0.43 () {58 vars in 1250 bytes} [Wed Jun 22 10:15:41 2022] GET /compute/v2.1/os-snapshots/d05668fa-856c-4ee6-998c-102525b50501 => generated 286 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 22 10:15:41.244718 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-0546c836-9981-4402-ae3f-5295f9bfb951 tempest-VolumesSnapshotsTestJSON-19151305 tempest-VolumesSnapshotsTestJSON-19151305-project] Calling method '.version_select at 0x7f36c03cf5e0>' {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:15:41.352424 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [None req-0546c836-9981-4402-ae3f-5295f9bfb951 tempest-VolumesSnapshotsTestJSON-19151305 tempest-VolumesSnapshotsTestJSON-19151305-project] 10.222.0.43 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.111488 Jun 22 10:15:41.353369 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 3/5] 10.222.0.43 () {58 vars in 1139 bytes} [Wed Jun 22 10:15:41 2022] GET /compute/v2.1/os-snapshots => generated 289 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 10:15:41.364793 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-a45d4e05-08c5-4e3a-8eda-8c50c68a6fc2 tempest-VolumesSnapshotsTestJSON-19151305 tempest-VolumesSnapshotsTestJSON-19151305-project] Calling method '.version_select at 0x7f36c0416ca0>' {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:15:41.422136 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [None req-a45d4e05-08c5-4e3a-8eda-8c50c68a6fc2 tempest-VolumesSnapshotsTestJSON-19151305 tempest-VolumesSnapshotsTestJSON-19151305-project] 10.222.0.43 "GET /compute/v2.1/os-snapshots/d05668fa-856c-4ee6-998c-102525b50501" status: 200 len: 286 microversion: 2.1 time: 0.062137 Jun 22 10:15:41.422704 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 3/6] 10.222.0.43 () {58 vars in 1250 bytes} [Wed Jun 22 10:15:41 2022] GET /compute/v2.1/os-snapshots/d05668fa-856c-4ee6-998c-102525b50501 => generated 286 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 10:15:42.436441 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-a64a1cc7-1474-4241-b64b-b7250e12989f tempest-VolumesSnapshotsTestJSON-19151305 tempest-VolumesSnapshotsTestJSON-19151305-project] Calling method '.version_select at 0x7f36c03e3310>' {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:15:42.497541 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [None req-a64a1cc7-1474-4241-b64b-b7250e12989f tempest-VolumesSnapshotsTestJSON-19151305 tempest-VolumesSnapshotsTestJSON-19151305-project] 10.222.0.43 "GET /compute/v2.1/os-snapshots/d05668fa-856c-4ee6-998c-102525b50501" status: 200 len: 286 microversion: 2.1 time: 0.066766 Jun 22 10:15:42.498552 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 4/7] 10.222.0.43 () {58 vars in 1250 bytes} [Wed Jun 22 10:15:42 2022] GET /compute/v2.1/os-snapshots/d05668fa-856c-4ee6-998c-102525b50501 => generated 286 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 22 10:15:43.509635 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-c5b837b7-bcc3-4af9-acb1-779ac12b82ec tempest-VolumesSnapshotsTestJSON-19151305 tempest-VolumesSnapshotsTestJSON-19151305-project] Calling method '.version_select at 0x7f36c03d53a0>' {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:15:43.575786 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [None req-c5b837b7-bcc3-4af9-acb1-779ac12b82ec tempest-VolumesSnapshotsTestJSON-19151305 tempest-VolumesSnapshotsTestJSON-19151305-project] 10.222.0.43 "GET /compute/v2.1/os-snapshots/d05668fa-856c-4ee6-998c-102525b50501" status: 200 len: 286 microversion: 2.1 time: 0.069810 Jun 22 10:15:43.577016 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 4/8] 10.222.0.43 () {58 vars in 1250 bytes} [Wed Jun 22 10:15:43 2022] GET /compute/v2.1/os-snapshots/d05668fa-856c-4ee6-998c-102525b50501 => generated 286 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 10:15:44.589258 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-2f5a9291-ab14-4a8a-a91c-dd3f06de84fa tempest-VolumesSnapshotsTestJSON-19151305 tempest-VolumesSnapshotsTestJSON-19151305-project] Calling method '.version_select at 0x7f36c03e3a60>' {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:15:44.833489 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [None req-2f5a9291-ab14-4a8a-a91c-dd3f06de84fa tempest-VolumesSnapshotsTestJSON-19151305 tempest-VolumesSnapshotsTestJSON-19151305-project] 10.222.0.43 "GET /compute/v2.1/os-snapshots/d05668fa-856c-4ee6-998c-102525b50501" status: 200 len: 287 microversion: 2.1 time: 0.247909 Jun 22 10:15:44.834606 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 5/9] 10.222.0.43 () {58 vars in 1250 bytes} [Wed Jun 22 10:15:44 2022] GET /compute/v2.1/os-snapshots/d05668fa-856c-4ee6-998c-102525b50501 => generated 287 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 10:15:44.844491 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-ad328b14-6f0b-46bb-8b39-5c0343d6e706 tempest-VolumesSnapshotsTestJSON-19151305 tempest-VolumesSnapshotsTestJSON-19151305-project] Calling method '.version_select at 0x7f36c0416ca0>' {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:15:45.031292 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [None req-ad328b14-6f0b-46bb-8b39-5c0343d6e706 tempest-VolumesSnapshotsTestJSON-19151305 tempest-VolumesSnapshotsTestJSON-19151305-project] 10.222.0.43 "DELETE /compute/v2.1/os-snapshots/d05668fa-856c-4ee6-998c-102525b50501" status: 202 len: 0 microversion: 2.1 time: 0.189160 Jun 22 10:15:45.042850 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 5/10] 10.222.0.43 () {58 vars in 1253 bytes} [Wed Jun 22 10:15:44 2022] DELETE /compute/v2.1/os-snapshots/d05668fa-856c-4ee6-998c-102525b50501 => generated 0 bytes in 202 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 22 10:15:45.044166 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-d493ae11-c33f-4e34-af71-6abbd764d851 tempest-VolumesSnapshotsTestJSON-19151305 tempest-VolumesSnapshotsTestJSON-19151305-project] Calling method '.version_select at 0x7f36c03cf4c0>' {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:15:45.111132 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [None req-d493ae11-c33f-4e34-af71-6abbd764d851 tempest-VolumesSnapshotsTestJSON-19151305 tempest-VolumesSnapshotsTestJSON-19151305-project] 10.222.0.43 "GET /compute/v2.1/os-snapshots/d05668fa-856c-4ee6-998c-102525b50501" status: 200 len: 286 microversion: 2.1 time: 0.071626 Jun 22 10:15:45.111132 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 6/11] 10.222.0.43 () {58 vars in 1250 bytes} [Wed Jun 22 10:15:45 2022] GET /compute/v2.1/os-snapshots/d05668fa-856c-4ee6-998c-102525b50501 => generated 286 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 10:15:46.130905 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-4af6908b-d74c-45ff-9e89-992752bc247c tempest-VolumesSnapshotsTestJSON-19151305 tempest-VolumesSnapshotsTestJSON-19151305-project] Calling method '.version_select at 0x7f36c0416550>' {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:15:46.187458 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.wsgi [None req-4af6908b-d74c-45ff-9e89-992752bc247c tempest-VolumesSnapshotsTestJSON-19151305 tempest-VolumesSnapshotsTestJSON-19151305-project] HTTP exception thrown: Snapshot d05668fa-856c-4ee6-998c-102525b50501 could not be found. Jun 22 10:15:46.194904 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-4af6908b-d74c-45ff-9e89-992752bc247c tempest-VolumesSnapshotsTestJSON-19151305 tempest-VolumesSnapshotsTestJSON-19151305-project] Request method failure captured: Jun 22 10:15:46.194904 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: request: GET /compute/v2.1/os-snapshots/d05668fa-856c-4ee6-998c-102525b50501 HTTP/1.1 Jun 22 10:15:46.194904 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: Accept: application/json Jun 22 10:15:46.194904 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: Accept-Encoding: identity Jun 22 10:15:46.194904 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: Connection: close Jun 22 10:15:46.194904 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: Content-Length: 0 Jun 22 10:15:46.194904 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: Content-Type: application/json Jun 22 10:15:46.194904 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: Host: 10.222.0.43 Jun 22 10:15:46.194904 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: Openstack-System-Scope: None Jun 22 10:15:46.194904 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: User-Agent: python-urllib3/1.26.9 Jun 22 10:15:46.194904 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-Auth-Token: gAAAAABisuvI8CM6Hcr6b2XAmztS0zcAjEeNvo54eJ4dQR6wRI65SPgWs_Vxyw-9l6g5V2ydW8fwM7wf2Tk0afv4TWIKkSbUqn3xt3tK-L6wwJxTC-UcldtzjHcgpC36xSonjhwFzMSvtzJNBPZJWRK1nKHEHSZoPgXT9oLpyFkttAMDOaB8fQY Jun 22 10:15:46.194904 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-Domain-Id: None Jun 22 10:15:46.194904 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-Domain-Name: None Jun 22 10:15:46.194904 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-Identity-Status: Confirmed Jun 22 10:15:46.194904 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-Is-Admin-Project: True Jun 22 10:15:46.194904 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-Project-Domain-Id: default Jun 22 10:15:46.194904 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-Project-Domain-Name: Default Jun 22 10:15:46.194904 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-Project-Id: 18756f7eccc64437bf9b22f0fe967a1c Jun 22 10:15:46.194904 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-19151305 Jun 22 10:15:46.194904 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-Role: reader,member Jun 22 10:15:46.194904 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-Roles: reader,member Jun 22 10:15:46.196295 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/18756f7eccc64437bf9b22f0fe967a1c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/18756f7eccc64437bf9b22f0fe967a1c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_18756f7eccc64437bf9b22f0fe967a1c", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/18756f7eccc64437bf9b22f0fe967a1c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}] Jun 22 10:15:46.196295 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-Tenant: tempest-VolumesSnapshotsTestJSON-19151305 Jun 22 10:15:46.196295 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-Tenant-Id: 18756f7eccc64437bf9b22f0fe967a1c Jun 22 10:15:46.196295 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-19151305 Jun 22 10:15:46.196295 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-User: tempest-VolumesSnapshotsTestJSON-19151305-project Jun 22 10:15:46.196295 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-User-Domain-Id: default Jun 22 10:15:46.196295 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-User-Domain-Name: Default Jun 22 10:15:46.196295 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-User-Id: 175789ab31f14363b7b04629954447c8 Jun 22 10:15:46.196295 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-User-Name: tempest-VolumesSnapshotsTestJSON-19151305-project Jun 22 10:15:46.196295 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: method: Jun 22 10:15:46.196295 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: exception: Snapshot d05668fa-856c-4ee6-998c-102525b50501 could not be found. Jun 22 10:15:46.196295 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: action_args: {'id': 'd05668fa-856c-4ee6-998c-102525b50501'} Jun 22 10:15:46.196295 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 10:15:46.196962 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:15:46.196962 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jun 22 10:15:46.196962 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jun 22 10:15:46.196962 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jun 22 10:15:46.196962 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jun 22 10:15:46.196962 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jun 22 10:15:46.196962 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jun 22 10:15:46.196962 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 22 10:15:46.196962 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 22 10:15:46.196962 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 22 10:15:46.196962 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 22 10:15:46.196962 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 22 10:15:46.196962 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 22 10:15:46.196962 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 22 10:15:46.196962 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 22 10:15:46.196962 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot d05668fa-856c-4ee6-998c-102525b50501 could not be found. (HTTP 404) (Request-ID: req-7d372511-8b8f-4c6d-a0ad-86d0eccca95b) Jun 22 10:15:46.196962 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi Jun 22 10:15:46.196962 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 10:15:46.198263 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi Jun 22 10:15:46.198263 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:15:46.198263 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Jun 22 10:15:46.198263 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Jun 22 10:15:46.198263 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 22 10:15:46.198263 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 22 10:15:46.198263 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Jun 22 10:15:46.198263 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Jun 22 10:15:46.198263 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 22 10:15:46.198263 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 22 10:15:46.198263 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jun 22 10:15:46.198263 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jun 22 10:15:46.198263 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jun 22 10:15:46.198263 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jun 22 10:15:46.198263 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jun 22 10:15:46.198263 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jun 22 10:15:46.198263 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 22 10:15:46.198263 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 22 10:15:46.198263 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 22 10:15:46.200335 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 22 10:15:46.200335 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 22 10:15:46.200335 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 22 10:15:46.200335 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 22 10:15:46.200335 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 22 10:15:46.200335 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot d05668fa-856c-4ee6-998c-102525b50501 could not be found. Jun 22 10:15:46.200335 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi Jun 22 10:15:46.200335 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 10:15:46.200335 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi Jun 22 10:15:46.200335 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:15:46.200335 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 10:15:46.200335 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 10:15:46.200335 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 10:15:46.200335 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 10:15:46.200335 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 22 10:15:46.200335 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 22 10:15:46.200335 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 10:15:46.200335 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 10:15:46.200335 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Jun 22 10:15:46.200335 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 22 10:15:46.201334 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot d05668fa-856c-4ee6-998c-102525b50501 could not be found. Jun 22 10:15:46.201334 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi Jun 22 10:15:46.201334 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 10:15:46.201334 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi Jun 22 10:15:46.201334 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:15:46.201334 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 10:15:46.201334 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 10:15:46.201334 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 10:15:46.201334 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 10:15:46.201334 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot d05668fa-856c-4ee6-998c-102525b50501 could not be found. Jun 22 10:15:46.201334 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi Jun 22 10:15:46.202857 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-4af6908b-d74c-45ff-9e89-992752bc247c tempest-VolumesSnapshotsTestJSON-19151305 tempest-VolumesSnapshotsTestJSON-19151305-project] Returning 404 to user: Snapshot d05668fa-856c-4ee6-998c-102525b50501 could not be found. {{(pid=117873) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 10:15:46.203886 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [None req-4af6908b-d74c-45ff-9e89-992752bc247c tempest-VolumesSnapshotsTestJSON-19151305 tempest-VolumesSnapshotsTestJSON-19151305-project] 10.222.0.43 "GET /compute/v2.1/os-snapshots/d05668fa-856c-4ee6-998c-102525b50501" status: 404 len: 111 microversion: 2.1 time: 0.084975 Jun 22 10:15:46.205031 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 6/12] 10.222.0.43 () {58 vars in 1250 bytes} [Wed Jun 22 10:15:46 2022] GET /compute/v2.1/os-snapshots/d05668fa-856c-4ee6-998c-102525b50501 => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 22 10:15:46.215064 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-0599c08a-6f5e-40fa-b8b5-4e2a3ce03e83 tempest-VolumesSnapshotsTestJSON-19151305 tempest-VolumesSnapshotsTestJSON-19151305-project] Calling method '.version_select at 0x7f36c03cfca0>' {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:15:46.400145 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [None req-0599c08a-6f5e-40fa-b8b5-4e2a3ce03e83 tempest-VolumesSnapshotsTestJSON-19151305 tempest-VolumesSnapshotsTestJSON-19151305-project] 10.222.0.43 "DELETE /compute/v2.1/os-volumes/df4e9d4e-47e5-41c7-8f4d-ee71c1439fbc" status: 202 len: 0 microversion: 2.1 time: 0.190507 Jun 22 10:15:46.400975 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 7/13] 10.222.0.43 () {58 vars in 1247 bytes} [Wed Jun 22 10:15:46 2022] DELETE /compute/v2.1/os-volumes/df4e9d4e-47e5-41c7-8f4d-ee71c1439fbc => generated 0 bytes in 192 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 22 10:15:46.412142 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-d54fbf9f-5c8c-4aed-acd0-3db838a8c982 tempest-VolumesSnapshotsTestJSON-19151305 tempest-VolumesSnapshotsTestJSON-19151305-project] Calling method '.version_select at 0x7f36c03d5e50>' {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:15:46.501420 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [None req-d54fbf9f-5c8c-4aed-acd0-3db838a8c982 tempest-VolumesSnapshotsTestJSON-19151305 tempest-VolumesSnapshotsTestJSON-19151305-project] 10.222.0.43 "GET /compute/v2.1/os-volumes/df4e9d4e-47e5-41c7-8f4d-ee71c1439fbc" status: 200 len: 344 microversion: 2.1 time: 0.094599 Jun 22 10:15:46.502953 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 7/14] 10.222.0.43 () {58 vars in 1244 bytes} [Wed Jun 22 10:15:46 2022] GET /compute/v2.1/os-volumes/df4e9d4e-47e5-41c7-8f4d-ee71c1439fbc => generated 344 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 10:15:47.515098 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-04b14490-e168-497c-9506-8b5078eb3cf5 tempest-VolumesSnapshotsTestJSON-19151305 tempest-VolumesSnapshotsTestJSON-19151305-project] Calling method '.version_select at 0x7f36c03e39d0>' {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:15:47.638568 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [None req-04b14490-e168-497c-9506-8b5078eb3cf5 tempest-VolumesSnapshotsTestJSON-19151305 tempest-VolumesSnapshotsTestJSON-19151305-project] 10.222.0.43 "GET /compute/v2.1/os-volumes/df4e9d4e-47e5-41c7-8f4d-ee71c1439fbc" status: 200 len: 344 microversion: 2.1 time: 0.127170 Jun 22 10:15:47.639132 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 8/15] 10.222.0.43 () {58 vars in 1244 bytes} [Wed Jun 22 10:15:47 2022] GET /compute/v2.1/os-volumes/df4e9d4e-47e5-41c7-8f4d-ee71c1439fbc => generated 344 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 10:15:48.651847 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-65e45dc3-804e-4718-95f6-996efd47dddd tempest-VolumesSnapshotsTestJSON-19151305 tempest-VolumesSnapshotsTestJSON-19151305-project] Calling method '.version_select at 0x7f36c033b550>' {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:15:48.770119 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [None req-65e45dc3-804e-4718-95f6-996efd47dddd tempest-VolumesSnapshotsTestJSON-19151305 tempest-VolumesSnapshotsTestJSON-19151305-project] 10.222.0.43 "GET /compute/v2.1/os-volumes/df4e9d4e-47e5-41c7-8f4d-ee71c1439fbc" status: 200 len: 344 microversion: 2.1 time: 0.121554 Jun 22 10:15:48.776041 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 8/16] 10.222.0.43 () {58 vars in 1244 bytes} [Wed Jun 22 10:15:48 2022] GET /compute/v2.1/os-volumes/df4e9d4e-47e5-41c7-8f4d-ee71c1439fbc => generated 344 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 10:15:49.306202 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-130c3446-c6b2-40e6-b49a-3102639bca18 tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Action: 'create', calling method: .version_select at 0x7f36c03cfdc0>, body: {"keypair": {"name": "tempest-keypair-817100034", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPvkaj3WQxamLygALfZwSs0gbPYrMRN6lUM7uLaffLGzp/h9dsipYsgIF9SHaGp8VFTo4GV7+0F7xQTLGyjLpeTljvIgpYmzWirelHFyaaKZ9C6thHKbqAGfBe6BKJUdKw=="}} {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:15:49.436977 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.quota [None req-130c3446-c6b2-40e6-b49a-3102639bca18 tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Getting quotas for project 78629282e2b74418a2c1cdac32576ef1. Resources: {'key_pairs'} {{(pid=117874) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 22 10:15:49.450428 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.quota [None req-130c3446-c6b2-40e6-b49a-3102639bca18 tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Getting quotas for user 7be3d844dcee4d19966fc7944463a0bc and project 78629282e2b74418a2c1cdac32576ef1. Resources: {'key_pairs'} {{(pid=117874) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 22 10:15:49.600959 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [None req-130c3446-c6b2-40e6-b49a-3102639bca18 tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.701633 Jun 22 10:15:49.607090 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 9/17] 10.222.0.43 () {60 vars in 1158 bytes} [Wed Jun 22 10:15:48 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 10:15:49.791138 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-6d2091c5-ba9e-4e0a-8077-ac469db79dcc tempest-VolumesSnapshotsTestJSON-19151305 tempest-VolumesSnapshotsTestJSON-19151305-project] Calling method '.version_select at 0x7f36c033bc10>' {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:15:49.889099 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.wsgi [None req-6d2091c5-ba9e-4e0a-8077-ac469db79dcc tempest-VolumesSnapshotsTestJSON-19151305 tempest-VolumesSnapshotsTestJSON-19151305-project] HTTP exception thrown: Volume df4e9d4e-47e5-41c7-8f4d-ee71c1439fbc could not be found. Jun 22 10:15:49.891852 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-6d2091c5-ba9e-4e0a-8077-ac469db79dcc tempest-VolumesSnapshotsTestJSON-19151305 tempest-VolumesSnapshotsTestJSON-19151305-project] Request method failure captured: Jun 22 10:15:49.891852 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: request: GET /compute/v2.1/os-volumes/df4e9d4e-47e5-41c7-8f4d-ee71c1439fbc HTTP/1.1 Jun 22 10:15:49.891852 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: Accept: application/json Jun 22 10:15:49.891852 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: Accept-Encoding: identity Jun 22 10:15:49.891852 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: Connection: close Jun 22 10:15:49.891852 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: Content-Length: 0 Jun 22 10:15:49.891852 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: Content-Type: application/json Jun 22 10:15:49.891852 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: Host: 10.222.0.43 Jun 22 10:15:49.891852 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: Openstack-System-Scope: None Jun 22 10:15:49.891852 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: User-Agent: python-urllib3/1.26.9 Jun 22 10:15:49.891852 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-Auth-Token: gAAAAABisuvI8CM6Hcr6b2XAmztS0zcAjEeNvo54eJ4dQR6wRI65SPgWs_Vxyw-9l6g5V2ydW8fwM7wf2Tk0afv4TWIKkSbUqn3xt3tK-L6wwJxTC-UcldtzjHcgpC36xSonjhwFzMSvtzJNBPZJWRK1nKHEHSZoPgXT9oLpyFkttAMDOaB8fQY Jun 22 10:15:49.891852 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-Domain-Id: None Jun 22 10:15:49.891852 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-Domain-Name: None Jun 22 10:15:49.891852 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-Identity-Status: Confirmed Jun 22 10:15:49.891852 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-Is-Admin-Project: True Jun 22 10:15:49.891852 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-Project-Domain-Id: default Jun 22 10:15:49.891852 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-Project-Domain-Name: Default Jun 22 10:15:49.891852 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-Project-Id: 18756f7eccc64437bf9b22f0fe967a1c Jun 22 10:15:49.891852 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-19151305 Jun 22 10:15:49.891852 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-Role: reader,member Jun 22 10:15:49.891852 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-Roles: reader,member Jun 22 10:15:49.893821 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/18756f7eccc64437bf9b22f0fe967a1c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/18756f7eccc64437bf9b22f0fe967a1c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_18756f7eccc64437bf9b22f0fe967a1c", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/18756f7eccc64437bf9b22f0fe967a1c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}] Jun 22 10:15:49.893821 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-Tenant: tempest-VolumesSnapshotsTestJSON-19151305 Jun 22 10:15:49.893821 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-Tenant-Id: 18756f7eccc64437bf9b22f0fe967a1c Jun 22 10:15:49.893821 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-19151305 Jun 22 10:15:49.893821 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-User: tempest-VolumesSnapshotsTestJSON-19151305-project Jun 22 10:15:49.893821 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-User-Domain-Id: default Jun 22 10:15:49.893821 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-User-Domain-Name: Default Jun 22 10:15:49.893821 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-User-Id: 175789ab31f14363b7b04629954447c8 Jun 22 10:15:49.893821 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-User-Name: tempest-VolumesSnapshotsTestJSON-19151305-project Jun 22 10:15:49.893821 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: method: Jun 22 10:15:49.893821 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: exception: Volume df4e9d4e-47e5-41c7-8f4d-ee71c1439fbc could not be found. Jun 22 10:15:49.893821 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: action_args: {'id': 'df4e9d4e-47e5-41c7-8f4d-ee71c1439fbc'} Jun 22 10:15:49.893821 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 10:15:49.894877 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:15:49.894877 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 22 10:15:49.894877 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 22 10:15:49.894877 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 22 10:15:49.894877 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 22 10:15:49.894877 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 22 10:15:49.894877 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 22 10:15:49.894877 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 22 10:15:49.894877 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 22 10:15:49.894877 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 22 10:15:49.894877 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 22 10:15:49.894877 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 22 10:15:49.894877 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 22 10:15:49.894877 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 22 10:15:49.894877 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 22 10:15:49.894877 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume df4e9d4e-47e5-41c7-8f4d-ee71c1439fbc could not be found. (HTTP 404) (Request-ID: req-8039a4ad-9986-44cc-bda4-92dac662dfe9) Jun 22 10:15:49.894877 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi Jun 22 10:15:49.894877 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 10:15:49.894877 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi Jun 22 10:15:49.896110 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:15:49.896110 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 22 10:15:49.896110 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 22 10:15:49.896110 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 22 10:15:49.896110 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 22 10:15:49.896110 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 22 10:15:49.896110 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 22 10:15:49.896110 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 22 10:15:49.896110 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 22 10:15:49.896110 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 22 10:15:49.896110 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 22 10:15:49.896110 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 22 10:15:49.896110 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 22 10:15:49.896110 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 22 10:15:49.896110 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 22 10:15:49.896110 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 22 10:15:49.896110 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 22 10:15:49.896110 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 22 10:15:49.896110 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 22 10:15:49.897360 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 22 10:15:49.897360 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 22 10:15:49.897360 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 22 10:15:49.897360 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 22 10:15:49.897360 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume df4e9d4e-47e5-41c7-8f4d-ee71c1439fbc could not be found. Jun 22 10:15:49.897360 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi Jun 22 10:15:49.897360 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 10:15:49.897360 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi Jun 22 10:15:49.897360 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:15:49.897360 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 10:15:49.897360 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 10:15:49.897360 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 10:15:49.897360 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 10:15:49.897360 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 22 10:15:49.897360 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 22 10:15:49.897360 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 10:15:49.897360 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 10:15:49.897360 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 22 10:15:49.897360 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 22 10:15:49.898618 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume df4e9d4e-47e5-41c7-8f4d-ee71c1439fbc could not be found. Jun 22 10:15:49.898618 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi Jun 22 10:15:49.898618 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 10:15:49.898618 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi Jun 22 10:15:49.898618 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:15:49.898618 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 10:15:49.898618 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 10:15:49.898618 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 10:15:49.898618 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 10:15:49.898618 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume df4e9d4e-47e5-41c7-8f4d-ee71c1439fbc could not be found. Jun 22 10:15:49.898618 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi Jun 22 10:15:49.900402 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-6d2091c5-ba9e-4e0a-8077-ac469db79dcc tempest-VolumesSnapshotsTestJSON-19151305 tempest-VolumesSnapshotsTestJSON-19151305-project] Returning 404 to user: Volume df4e9d4e-47e5-41c7-8f4d-ee71c1439fbc could not be found. {{(pid=117873) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 10:15:49.901440 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [None req-6d2091c5-ba9e-4e0a-8077-ac469db79dcc tempest-VolumesSnapshotsTestJSON-19151305 tempest-VolumesSnapshotsTestJSON-19151305-project] 10.222.0.43 "GET /compute/v2.1/os-volumes/df4e9d4e-47e5-41c7-8f4d-ee71c1439fbc" status: 404 len: 109 microversion: 2.1 time: 0.116718 Jun 22 10:15:49.902172 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 9/18] 10.222.0.43 () {58 vars in 1244 bytes} [Wed Jun 22 10:15:49 2022] GET /compute/v2.1/os-volumes/df4e9d4e-47e5-41c7-8f4d-ee71c1439fbc => generated 109 bytes in 119 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 22 10:15:49.917532 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-e9f6acec-6671-45e7-896d-6c1bf5d9ae41 tempest-VolumesSnapshotsTestJSON-19151305 tempest-VolumesSnapshotsTestJSON-19151305-project] Calling method '.version_select at 0x7f36c0344ca0>' {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:15:49.970738 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.wsgi [None req-e9f6acec-6671-45e7-896d-6c1bf5d9ae41 tempest-VolumesSnapshotsTestJSON-19151305 tempest-VolumesSnapshotsTestJSON-19151305-project] HTTP exception thrown: Volume df4e9d4e-47e5-41c7-8f4d-ee71c1439fbc could not be found. Jun 22 10:15:49.976269 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-e9f6acec-6671-45e7-896d-6c1bf5d9ae41 tempest-VolumesSnapshotsTestJSON-19151305 tempest-VolumesSnapshotsTestJSON-19151305-project] Request method failure captured: Jun 22 10:15:49.976269 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: request: DELETE /compute/v2.1/os-volumes/df4e9d4e-47e5-41c7-8f4d-ee71c1439fbc HTTP/1.1 Jun 22 10:15:49.976269 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: Accept: application/json Jun 22 10:15:49.976269 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: Accept-Encoding: identity Jun 22 10:15:49.976269 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: Connection: close Jun 22 10:15:49.976269 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: Content-Length: 0 Jun 22 10:15:49.976269 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: Content-Type: application/json Jun 22 10:15:49.976269 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: Host: 10.222.0.43 Jun 22 10:15:49.976269 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: Openstack-System-Scope: None Jun 22 10:15:49.976269 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: User-Agent: python-urllib3/1.26.9 Jun 22 10:15:49.976269 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-Auth-Token: gAAAAABisuvI8CM6Hcr6b2XAmztS0zcAjEeNvo54eJ4dQR6wRI65SPgWs_Vxyw-9l6g5V2ydW8fwM7wf2Tk0afv4TWIKkSbUqn3xt3tK-L6wwJxTC-UcldtzjHcgpC36xSonjhwFzMSvtzJNBPZJWRK1nKHEHSZoPgXT9oLpyFkttAMDOaB8fQY Jun 22 10:15:49.976269 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-Domain-Id: None Jun 22 10:15:49.976269 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-Domain-Name: None Jun 22 10:15:49.976269 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-Identity-Status: Confirmed Jun 22 10:15:49.976269 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-Is-Admin-Project: True Jun 22 10:15:49.976269 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-Project-Domain-Id: default Jun 22 10:15:49.976269 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-Project-Domain-Name: Default Jun 22 10:15:49.976269 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-Project-Id: 18756f7eccc64437bf9b22f0fe967a1c Jun 22 10:15:49.976269 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-19151305 Jun 22 10:15:49.976269 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-Role: reader,member Jun 22 10:15:49.976269 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-Roles: reader,member Jun 22 10:15:49.977248 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/18756f7eccc64437bf9b22f0fe967a1c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/18756f7eccc64437bf9b22f0fe967a1c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_18756f7eccc64437bf9b22f0fe967a1c", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/18756f7eccc64437bf9b22f0fe967a1c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}] Jun 22 10:15:49.977248 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-Tenant: tempest-VolumesSnapshotsTestJSON-19151305 Jun 22 10:15:49.977248 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-Tenant-Id: 18756f7eccc64437bf9b22f0fe967a1c Jun 22 10:15:49.977248 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-19151305 Jun 22 10:15:49.977248 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-User: tempest-VolumesSnapshotsTestJSON-19151305-project Jun 22 10:15:49.977248 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-User-Domain-Id: default Jun 22 10:15:49.977248 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-User-Domain-Name: Default Jun 22 10:15:49.977248 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-User-Id: 175789ab31f14363b7b04629954447c8 Jun 22 10:15:49.977248 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-User-Name: tempest-VolumesSnapshotsTestJSON-19151305-project Jun 22 10:15:49.977248 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: method: Jun 22 10:15:49.977248 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: exception: Volume df4e9d4e-47e5-41c7-8f4d-ee71c1439fbc could not be found. Jun 22 10:15:49.977248 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: action_args: {'id': 'df4e9d4e-47e5-41c7-8f4d-ee71c1439fbc'} Jun 22 10:15:49.977248 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 10:15:49.978402 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:15:49.978402 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 22 10:15:49.978402 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 22 10:15:49.978402 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 22 10:15:49.978402 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 22 10:15:49.978402 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 22 10:15:49.978402 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 22 10:15:49.978402 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 22 10:15:49.978402 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 22 10:15:49.978402 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 22 10:15:49.978402 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 22 10:15:49.978402 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 22 10:15:49.978402 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 22 10:15:49.978402 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 22 10:15:49.978402 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 22 10:15:49.978402 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume df4e9d4e-47e5-41c7-8f4d-ee71c1439fbc could not be found. (HTTP 404) (Request-ID: req-528be60e-261b-459b-98e8-c05331ae960d) Jun 22 10:15:49.978402 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi Jun 22 10:15:49.978402 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 10:15:49.978402 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi Jun 22 10:15:49.979551 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:15:49.979551 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jun 22 10:15:49.979551 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jun 22 10:15:49.979551 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 22 10:15:49.979551 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 22 10:15:49.979551 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 22 10:15:49.979551 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 22 10:15:49.979551 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 22 10:15:49.979551 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 22 10:15:49.979551 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 22 10:15:49.979551 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 22 10:15:49.979551 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 22 10:15:49.979551 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 22 10:15:49.979551 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 22 10:15:49.979551 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 22 10:15:49.979551 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 22 10:15:49.979551 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 22 10:15:49.979551 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 22 10:15:49.979551 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 22 10:15:49.980413 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 22 10:15:49.980413 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 22 10:15:49.980413 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 22 10:15:49.980413 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 22 10:15:49.980413 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume df4e9d4e-47e5-41c7-8f4d-ee71c1439fbc could not be found. Jun 22 10:15:49.980413 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi Jun 22 10:15:49.980413 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 10:15:49.980413 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi Jun 22 10:15:49.980413 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:15:49.980413 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 10:15:49.980413 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 10:15:49.980413 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 10:15:49.980413 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 10:15:49.980413 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 22 10:15:49.980413 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 22 10:15:49.980413 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 10:15:49.980413 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 10:15:49.980413 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jun 22 10:15:49.980413 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 22 10:15:49.981289 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume df4e9d4e-47e5-41c7-8f4d-ee71c1439fbc could not be found. Jun 22 10:15:49.981289 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi Jun 22 10:15:49.981289 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 10:15:49.981289 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi Jun 22 10:15:49.981289 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:15:49.981289 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 10:15:49.981289 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 10:15:49.981289 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 10:15:49.981289 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 10:15:49.981289 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume df4e9d4e-47e5-41c7-8f4d-ee71c1439fbc could not be found. Jun 22 10:15:49.981289 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi Jun 22 10:15:49.985530 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-e9f6acec-6671-45e7-896d-6c1bf5d9ae41 tempest-VolumesSnapshotsTestJSON-19151305 tempest-VolumesSnapshotsTestJSON-19151305-project] Returning 404 to user: Volume df4e9d4e-47e5-41c7-8f4d-ee71c1439fbc could not be found. {{(pid=117874) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 10:15:49.986634 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [None req-e9f6acec-6671-45e7-896d-6c1bf5d9ae41 tempest-VolumesSnapshotsTestJSON-19151305 tempest-VolumesSnapshotsTestJSON-19151305-project] 10.222.0.43 "DELETE /compute/v2.1/os-volumes/df4e9d4e-47e5-41c7-8f4d-ee71c1439fbc" status: 404 len: 109 microversion: 2.1 time: 0.077645 Jun 22 10:15:49.989824 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 10/19] 10.222.0.43 () {58 vars in 1247 bytes} [Wed Jun 22 10:15:49 2022] DELETE /compute/v2.1/os-volumes/df4e9d4e-47e5-41c7-8f4d-ee71c1439fbc => generated 109 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 22 10:15:49.997196 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-d28d7544-1312-460e-b03a-f9772ab0e80d tempest-VolumesSnapshotsTestJSON-19151305 tempest-VolumesSnapshotsTestJSON-19151305-project] Calling method '.version_select at 0x7f36c033b4c0>' {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:15:50.077466 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.wsgi [None req-d28d7544-1312-460e-b03a-f9772ab0e80d tempest-VolumesSnapshotsTestJSON-19151305 tempest-VolumesSnapshotsTestJSON-19151305-project] HTTP exception thrown: Volume df4e9d4e-47e5-41c7-8f4d-ee71c1439fbc could not be found. Jun 22 10:15:50.082338 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-d28d7544-1312-460e-b03a-f9772ab0e80d tempest-VolumesSnapshotsTestJSON-19151305 tempest-VolumesSnapshotsTestJSON-19151305-project] Request method failure captured: Jun 22 10:15:50.082338 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: request: GET /compute/v2.1/os-volumes/df4e9d4e-47e5-41c7-8f4d-ee71c1439fbc HTTP/1.1 Jun 22 10:15:50.082338 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: Accept: application/json Jun 22 10:15:50.082338 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: Accept-Encoding: identity Jun 22 10:15:50.082338 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: Connection: close Jun 22 10:15:50.082338 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: Content-Length: 0 Jun 22 10:15:50.082338 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: Content-Type: application/json Jun 22 10:15:50.082338 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: Host: 10.222.0.43 Jun 22 10:15:50.082338 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: Openstack-System-Scope: None Jun 22 10:15:50.082338 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: User-Agent: python-urllib3/1.26.9 Jun 22 10:15:50.082338 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-Auth-Token: gAAAAABisuvI8CM6Hcr6b2XAmztS0zcAjEeNvo54eJ4dQR6wRI65SPgWs_Vxyw-9l6g5V2ydW8fwM7wf2Tk0afv4TWIKkSbUqn3xt3tK-L6wwJxTC-UcldtzjHcgpC36xSonjhwFzMSvtzJNBPZJWRK1nKHEHSZoPgXT9oLpyFkttAMDOaB8fQY Jun 22 10:15:50.082338 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-Domain-Id: None Jun 22 10:15:50.082338 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-Domain-Name: None Jun 22 10:15:50.082338 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-Identity-Status: Confirmed Jun 22 10:15:50.082338 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-Is-Admin-Project: True Jun 22 10:15:50.082338 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-Project-Domain-Id: default Jun 22 10:15:50.082338 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-Project-Domain-Name: Default Jun 22 10:15:50.082338 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-Project-Id: 18756f7eccc64437bf9b22f0fe967a1c Jun 22 10:15:50.082338 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-19151305 Jun 22 10:15:50.082338 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-Role: reader,member Jun 22 10:15:50.082338 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-Roles: reader,member Jun 22 10:15:50.083410 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/18756f7eccc64437bf9b22f0fe967a1c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/18756f7eccc64437bf9b22f0fe967a1c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_18756f7eccc64437bf9b22f0fe967a1c", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/18756f7eccc64437bf9b22f0fe967a1c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}] Jun 22 10:15:50.083410 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-Tenant: tempest-VolumesSnapshotsTestJSON-19151305 Jun 22 10:15:50.083410 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-Tenant-Id: 18756f7eccc64437bf9b22f0fe967a1c Jun 22 10:15:50.083410 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-19151305 Jun 22 10:15:50.083410 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-User: tempest-VolumesSnapshotsTestJSON-19151305-project Jun 22 10:15:50.083410 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-User-Domain-Id: default Jun 22 10:15:50.083410 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-User-Domain-Name: Default Jun 22 10:15:50.083410 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-User-Id: 175789ab31f14363b7b04629954447c8 Jun 22 10:15:50.083410 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-User-Name: tempest-VolumesSnapshotsTestJSON-19151305-project Jun 22 10:15:50.083410 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: method: Jun 22 10:15:50.083410 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: exception: Volume df4e9d4e-47e5-41c7-8f4d-ee71c1439fbc could not be found. Jun 22 10:15:50.083410 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: action_args: {'id': 'df4e9d4e-47e5-41c7-8f4d-ee71c1439fbc'} Jun 22 10:15:50.083410 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 10:15:50.084024 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:15:50.084024 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 22 10:15:50.084024 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 22 10:15:50.084024 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 22 10:15:50.084024 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 22 10:15:50.084024 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 22 10:15:50.084024 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 22 10:15:50.084024 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 22 10:15:50.084024 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 22 10:15:50.084024 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 22 10:15:50.084024 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 22 10:15:50.084024 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 22 10:15:50.084024 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 22 10:15:50.084024 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 22 10:15:50.084024 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 22 10:15:50.084024 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume df4e9d4e-47e5-41c7-8f4d-ee71c1439fbc could not be found. (HTTP 404) (Request-ID: req-7370ccd3-33b4-4e05-ae2e-f4e14d5b67c0) Jun 22 10:15:50.084024 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi Jun 22 10:15:50.084024 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 10:15:50.084024 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi Jun 22 10:15:50.084885 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:15:50.084885 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 22 10:15:50.084885 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 22 10:15:50.084885 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 22 10:15:50.084885 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 22 10:15:50.084885 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 22 10:15:50.084885 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 22 10:15:50.084885 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 22 10:15:50.084885 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 22 10:15:50.084885 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 22 10:15:50.084885 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 22 10:15:50.084885 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 22 10:15:50.084885 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 22 10:15:50.084885 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 22 10:15:50.084885 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 22 10:15:50.084885 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 22 10:15:50.084885 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 22 10:15:50.084885 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 22 10:15:50.084885 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 22 10:15:50.085851 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 22 10:15:50.085851 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 22 10:15:50.085851 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 22 10:15:50.085851 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 22 10:15:50.085851 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume df4e9d4e-47e5-41c7-8f4d-ee71c1439fbc could not be found. Jun 22 10:15:50.085851 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi Jun 22 10:15:50.085851 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 10:15:50.085851 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi Jun 22 10:15:50.085851 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:15:50.085851 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 10:15:50.085851 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 10:15:50.085851 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 10:15:50.085851 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 10:15:50.085851 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 22 10:15:50.085851 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 22 10:15:50.085851 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 10:15:50.085851 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 10:15:50.085851 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 22 10:15:50.085851 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 22 10:15:50.086794 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume df4e9d4e-47e5-41c7-8f4d-ee71c1439fbc could not be found. Jun 22 10:15:50.086794 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi Jun 22 10:15:50.086794 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 10:15:50.086794 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi Jun 22 10:15:50.086794 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:15:50.086794 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 10:15:50.086794 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 10:15:50.086794 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 10:15:50.086794 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 10:15:50.086794 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume df4e9d4e-47e5-41c7-8f4d-ee71c1439fbc could not be found. Jun 22 10:15:50.086794 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi Jun 22 10:15:50.093190 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-d28d7544-1312-460e-b03a-f9772ab0e80d tempest-VolumesSnapshotsTestJSON-19151305 tempest-VolumesSnapshotsTestJSON-19151305-project] Returning 404 to user: Volume df4e9d4e-47e5-41c7-8f4d-ee71c1439fbc could not be found. {{(pid=117873) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 10:15:50.094098 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [None req-d28d7544-1312-460e-b03a-f9772ab0e80d tempest-VolumesSnapshotsTestJSON-19151305 tempest-VolumesSnapshotsTestJSON-19151305-project] 10.222.0.43 "GET /compute/v2.1/os-volumes/df4e9d4e-47e5-41c7-8f4d-ee71c1439fbc" status: 404 len: 109 microversion: 2.1 time: 0.101707 Jun 22 10:15:50.094946 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 10/20] 10.222.0.43 () {58 vars in 1244 bytes} [Wed Jun 22 10:15:49 2022] GET /compute/v2.1/os-volumes/df4e9d4e-47e5-41c7-8f4d-ee71c1439fbc => generated 109 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 22 10:15:53.124370 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-3c3d6b8a-ee61-4d7c-8126-c5381afb4d81 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Action: 'create', calling method: .version_select at 0x7f36bfad90d0>, body: {"keypair": {"name": "tempest-keypair-1340879061", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC1OORUA5bg6/Jih9+TDWEapB+l0flsoIZln0WnJezDLv8196wsQlw/a1zCrMGEUYtq9JjjqPtYng88wtUcCmBvbYb+l1BMCD8L9i3xFRf6powtr26lhDAWG4LuB6mKI3g=="}} {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:15:53.162998 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.quota [None req-3c3d6b8a-ee61-4d7c-8126-c5381afb4d81 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Getting quotas for project 5ee9d603d9cc4a8797f55d544f189720. Resources: {'key_pairs'} {{(pid=117874) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 22 10:15:53.174232 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.quota [None req-3c3d6b8a-ee61-4d7c-8126-c5381afb4d81 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Getting quotas for user 75753b29a78640df9622d4e2655baf9b and project 5ee9d603d9cc4a8797f55d544f189720. Resources: {'key_pairs'} {{(pid=117874) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 22 10:15:53.229633 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [None req-3c3d6b8a-ee61-4d7c-8126-c5381afb4d81 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.440166 Jun 22 10:15:53.236480 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 11/21] 10.222.0.43 () {62 vars in 1199 bytes} [Wed Jun 22 10:15:52 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 448 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jun 22 10:15:54.246394 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-5cdbeba2-12b7-4e75-9f82-d4e6bae23807 tempest-DeleteServersTestJSON-502292925 tempest-DeleteServersTestJSON-502292925-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-853434949", "imageRef": "22d2c064-5bf7-438e-bbb7-47259e4bdab5", "flavorRef": "452", "networks": [{"uuid": "a0897f8b-0e7c-4829-8ca1-9ba6a95f427f"}]}} {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:15:54.438833 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.network.neutron [None req-5cdbeba2-12b7-4e75-9f82-d4e6bae23807 tempest-DeleteServersTestJSON-502292925 tempest-DeleteServersTestJSON-502292925-project] validate_networks() for [('a0897f8b-0e7c-4829-8ca1-9ba6a95f427f', None, None, None, None, None)] {{(pid=117873) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 22 10:15:55.884250 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.virt.hardware [None req-5cdbeba2-12b7-4e75-9f82-d4e6bae23807 tempest-DeleteServersTestJSON-502292925 tempest-DeleteServersTestJSON-502292925-project] Flavor limits 0:0:0 {{(pid=117873) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 22 10:15:55.885926 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.virt.hardware [None req-5cdbeba2-12b7-4e75-9f82-d4e6bae23807 tempest-DeleteServersTestJSON-502292925 tempest-DeleteServersTestJSON-502292925-project] Image limits 0:0:0 {{(pid=117873) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 22 10:15:55.886586 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.virt.hardware [None req-5cdbeba2-12b7-4e75-9f82-d4e6bae23807 tempest-DeleteServersTestJSON-502292925 tempest-DeleteServersTestJSON-502292925-project] Flavor pref 0:0:0 {{(pid=117873) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 22 10:15:55.887144 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.virt.hardware [None req-5cdbeba2-12b7-4e75-9f82-d4e6bae23807 tempest-DeleteServersTestJSON-502292925 tempest-DeleteServersTestJSON-502292925-project] Image pref 0:0:0 {{(pid=117873) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 22 10:15:55.887691 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.virt.hardware [None req-5cdbeba2-12b7-4e75-9f82-d4e6bae23807 tempest-DeleteServersTestJSON-502292925 tempest-DeleteServersTestJSON-502292925-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117873) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 22 10:15:55.924424 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-5cdbeba2-12b7-4e75-9f82-d4e6bae23807 tempest-DeleteServersTestJSON-502292925 tempest-DeleteServersTestJSON-502292925-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:15:55.925662 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-5cdbeba2-12b7-4e75-9f82-d4e6bae23807 tempest-DeleteServersTestJSON-502292925 tempest-DeleteServersTestJSON-502292925-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:15:55.926722 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-5cdbeba2-12b7-4e75-9f82-d4e6bae23807 tempest-DeleteServersTestJSON-502292925 tempest-DeleteServersTestJSON-502292925-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:15:55.927459 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-5cdbeba2-12b7-4e75-9f82-d4e6bae23807 tempest-DeleteServersTestJSON-502292925 tempest-DeleteServersTestJSON-502292925-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:15:56.005228 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.quota [None req-5cdbeba2-12b7-4e75-9f82-d4e6bae23807 tempest-DeleteServersTestJSON-502292925 tempest-DeleteServersTestJSON-502292925-project] Getting quotas for project d4765b82e21647a9b391a98f446a0e17. Resources: {'instances', 'cores', 'ram'} {{(pid=117873) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 22 10:15:56.018970 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.quota [None req-5cdbeba2-12b7-4e75-9f82-d4e6bae23807 tempest-DeleteServersTestJSON-502292925 tempest-DeleteServersTestJSON-502292925-project] Getting quotas for user 2b3af9bfaaaa4dcca0747f776115c826 and project d4765b82e21647a9b391a98f446a0e17. Resources: {'instances', 'cores', 'ram'} {{(pid=117873) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 22 10:15:56.037882 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.compute.api [None req-5cdbeba2-12b7-4e75-9f82-d4e6bae23807 tempest-DeleteServersTestJSON-502292925 tempest-DeleteServersTestJSON-502292925-project] Going to run 1 instances... {{(pid=117873) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 22 10:15:56.041963 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.compute.api [None req-5cdbeba2-12b7-4e75-9f82-d4e6bae23807 tempest-DeleteServersTestJSON-502292925 tempest-DeleteServersTestJSON-502292925-project] [instance: 8b3f01d1-ac00-4bfb-8ae3-be75720b8ad1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='22d2c064-5bf7-438e-bbb7-47259e4bdab5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117873) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 22 10:15:56.188360 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [None req-5cdbeba2-12b7-4e75-9f82-d4e6bae23807 tempest-DeleteServersTestJSON-502292925 tempest-DeleteServersTestJSON-502292925-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.162811 Jun 22 10:15:56.189780 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 11/22] 10.222.0.43 () {60 vars in 1146 bytes} [Wed Jun 22 10:15:54 2022] POST /compute/v2.1/servers => generated 380 bytes in 2166 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 22 10:15:56.201382 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-c2263af5-316c-459a-9571-de12436b77f9 tempest-DeleteServersTestJSON-502292925 tempest-DeleteServersTestJSON-502292925-project] Calling method '>' {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:15:56.202625 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.compute.api [None req-c2263af5-316c-459a-9571-de12436b77f9 tempest-DeleteServersTestJSON-502292925 tempest-DeleteServersTestJSON-502292925-project] [instance: 8b3f01d1-ac00-4bfb-8ae3-be75720b8ad1] Fetching instance by UUID {{(pid=117874) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:15:56.386101 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.policy [None req-c2263af5-316c-459a-9571-de12436b77f9 tempest-DeleteServersTestJSON-502292925 tempest-DeleteServersTestJSON-502292925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3af9bfaaaa4dcca0747f776115c826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4765b82e21647a9b391a98f446a0e17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117874) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:15:56.409253 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [None req-c2263af5-316c-459a-9571-de12436b77f9 tempest-DeleteServersTestJSON-502292925 tempest-DeleteServersTestJSON-502292925-project] 10.222.0.43 "GET /compute/v2.1/servers/8b3f01d1-ac00-4bfb-8ae3-be75720b8ad1" status: 200 len: 1214 microversion: 2.1 time: 0.212553 Jun 22 10:15:56.423661 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 12/23] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:15:56 2022] GET /compute/v2.1/servers/8b3f01d1-ac00-4bfb-8ae3-be75720b8ad1 => generated 1214 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:15:57.445925 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-4ea3d17f-3cc2-49c6-8eda-b6905eb84590 tempest-DeleteServersTestJSON-502292925 tempest-DeleteServersTestJSON-502292925-project] Calling method '>' {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:15:57.447133 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.compute.api [None req-4ea3d17f-3cc2-49c6-8eda-b6905eb84590 tempest-DeleteServersTestJSON-502292925 tempest-DeleteServersTestJSON-502292925-project] [instance: 8b3f01d1-ac00-4bfb-8ae3-be75720b8ad1] Fetching instance by UUID {{(pid=117873) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:15:57.575403 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.policy [None req-4ea3d17f-3cc2-49c6-8eda-b6905eb84590 tempest-DeleteServersTestJSON-502292925 tempest-DeleteServersTestJSON-502292925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3af9bfaaaa4dcca0747f776115c826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4765b82e21647a9b391a98f446a0e17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117873) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:15:57.611678 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [None req-4ea3d17f-3cc2-49c6-8eda-b6905eb84590 tempest-DeleteServersTestJSON-502292925 tempest-DeleteServersTestJSON-502292925-project] 10.222.0.43 "GET /compute/v2.1/servers/8b3f01d1-ac00-4bfb-8ae3-be75720b8ad1" status: 200 len: 1214 microversion: 2.1 time: 0.169810 Jun 22 10:15:57.622160 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 12/24] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:15:57 2022] GET /compute/v2.1/servers/8b3f01d1-ac00-4bfb-8ae3-be75720b8ad1 => generated 1214 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:15:58.639620 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-13e8da7d-840f-4224-b8c5-4e5ef8a395a8 tempest-DeleteServersTestJSON-502292925 tempest-DeleteServersTestJSON-502292925-project] Calling method '>' {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:15:58.640859 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.compute.api [None req-13e8da7d-840f-4224-b8c5-4e5ef8a395a8 tempest-DeleteServersTestJSON-502292925 tempest-DeleteServersTestJSON-502292925-project] [instance: 8b3f01d1-ac00-4bfb-8ae3-be75720b8ad1] Fetching instance by UUID {{(pid=117874) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:15:58.874735 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.policy [None req-13e8da7d-840f-4224-b8c5-4e5ef8a395a8 tempest-DeleteServersTestJSON-502292925 tempest-DeleteServersTestJSON-502292925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3af9bfaaaa4dcca0747f776115c826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4765b82e21647a9b391a98f446a0e17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117874) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:15:58.894152 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [None req-13e8da7d-840f-4224-b8c5-4e5ef8a395a8 tempest-DeleteServersTestJSON-502292925 tempest-DeleteServersTestJSON-502292925-project] 10.222.0.43 "GET /compute/v2.1/servers/8b3f01d1-ac00-4bfb-8ae3-be75720b8ad1" status: 200 len: 1214 microversion: 2.1 time: 0.256648 Jun 22 10:15:58.906600 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 13/25] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:15:58 2022] GET /compute/v2.1/servers/8b3f01d1-ac00-4bfb-8ae3-be75720b8ad1 => generated 1214 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:15:59.504837 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-ff1690f0-6c21-4d9a-89b7-086a0c79fb32 tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-297258122", "imageRef": "22d2c064-5bf7-438e-bbb7-47259e4bdab5", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "8bc94bec-5b18-4b15-a531-8b4a0778b280"}], "security_groups": [{"name": "tempest-securitygroup--209977663"}], "key_name": "tempest-keypair-817100034", "user_data": "}} {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:15:59.822123 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.network.neutron [None req-ff1690f0-6c21-4d9a-89b7-086a0c79fb32 tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] validate_networks() for [('8bc94bec-5b18-4b15-a531-8b4a0778b280', None, None, None, None, None)] {{(pid=117873) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 22 10:15:59.914451 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-7e2ff12a-a556-483d-b4b6-ee04b87aa16e tempest-DeleteServersTestJSON-502292925 tempest-DeleteServersTestJSON-502292925-project] Calling method '>' {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:15:59.915221 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.compute.api [None req-7e2ff12a-a556-483d-b4b6-ee04b87aa16e tempest-DeleteServersTestJSON-502292925 tempest-DeleteServersTestJSON-502292925-project] [instance: 8b3f01d1-ac00-4bfb-8ae3-be75720b8ad1] Fetching instance by UUID {{(pid=117874) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:15:59.944312 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-7e2ff12a-a556-483d-b4b6-ee04b87aa16e tempest-DeleteServersTestJSON-502292925 tempest-DeleteServersTestJSON-502292925-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:15:59.946106 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-7e2ff12a-a556-483d-b4b6-ee04b87aa16e tempest-DeleteServersTestJSON-502292925 tempest-DeleteServersTestJSON-502292925-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:15:59.948575 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-7e2ff12a-a556-483d-b4b6-ee04b87aa16e tempest-DeleteServersTestJSON-502292925 tempest-DeleteServersTestJSON-502292925-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:15:59.951436 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-7e2ff12a-a556-483d-b4b6-ee04b87aa16e tempest-DeleteServersTestJSON-502292925 tempest-DeleteServersTestJSON-502292925-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:16:00.403310 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.policy [None req-7e2ff12a-a556-483d-b4b6-ee04b87aa16e tempest-DeleteServersTestJSON-502292925 tempest-DeleteServersTestJSON-502292925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3af9bfaaaa4dcca0747f776115c826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4765b82e21647a9b391a98f446a0e17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117874) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:16:00.460292 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [None req-7e2ff12a-a556-483d-b4b6-ee04b87aa16e tempest-DeleteServersTestJSON-502292925 tempest-DeleteServersTestJSON-502292925-project] 10.222.0.43 "GET /compute/v2.1/servers/8b3f01d1-ac00-4bfb-8ae3-be75720b8ad1" status: 200 len: 1266 microversion: 2.1 time: 0.548680 Jun 22 10:16:00.463201 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 14/26] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:15:59 2022] GET /compute/v2.1/servers/8b3f01d1-ac00-4bfb-8ae3-be75720b8ad1 => generated 1266 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:16:00.491362 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-54af17fa-a6f3-4829-9241-2df7f204f586 tempest-VolumesTestJSON-838426207 tempest-VolumesTestJSON-838426207-project] Calling method '.version_select at 0x7f36bfa24b80>' {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:16:00.655121 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [None req-54af17fa-a6f3-4829-9241-2df7f204f586 tempest-VolumesTestJSON-838426207 tempest-VolumesTestJSON-838426207-project] 10.222.0.43 "GET /compute/v2.1/os-volumes/3d3f4cbf-9935-4156-87a5-f947c3381d57" status: 200 len: 350 microversion: 2.1 time: 0.190791 Jun 22 10:16:00.655839 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 15/27] 10.222.0.43 () {58 vars in 1244 bytes} [Wed Jun 22 10:16:00 2022] GET /compute/v2.1/os-volumes/3d3f4cbf-9935-4156-87a5-f947c3381d57 => generated 350 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 10:16:01.485554 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-d4e4fa69-73cd-4243-a537-7a2104383cca tempest-DeleteServersTestJSON-502292925 tempest-DeleteServersTestJSON-502292925-project] Calling method '>' {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:16:01.487197 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.compute.api [None req-d4e4fa69-73cd-4243-a537-7a2104383cca tempest-DeleteServersTestJSON-502292925 tempest-DeleteServersTestJSON-502292925-project] [instance: 8b3f01d1-ac00-4bfb-8ae3-be75720b8ad1] Fetching instance by UUID {{(pid=117874) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:16:01.495921 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-d4e4fa69-73cd-4243-a537-7a2104383cca tempest-DeleteServersTestJSON-502292925 tempest-DeleteServersTestJSON-502292925-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:16:01.496650 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-d4e4fa69-73cd-4243-a537-7a2104383cca tempest-DeleteServersTestJSON-502292925 tempest-DeleteServersTestJSON-502292925-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:16:01.499506 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-d4e4fa69-73cd-4243-a537-7a2104383cca tempest-DeleteServersTestJSON-502292925 tempest-DeleteServersTestJSON-502292925-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:16:01.503965 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-d4e4fa69-73cd-4243-a537-7a2104383cca tempest-DeleteServersTestJSON-502292925 tempest-DeleteServersTestJSON-502292925-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:16:01.577467 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.virt.hardware [None req-ff1690f0-6c21-4d9a-89b7-086a0c79fb32 tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Flavor limits 0:0:0 {{(pid=117873) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 22 10:16:01.578491 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.virt.hardware [None req-ff1690f0-6c21-4d9a-89b7-086a0c79fb32 tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Image limits 0:0:0 {{(pid=117873) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 22 10:16:01.579622 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.virt.hardware [None req-ff1690f0-6c21-4d9a-89b7-086a0c79fb32 tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Flavor pref 0:0:0 {{(pid=117873) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 22 10:16:01.581237 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.virt.hardware [None req-ff1690f0-6c21-4d9a-89b7-086a0c79fb32 tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Image pref 0:0:0 {{(pid=117873) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 22 10:16:01.581793 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.virt.hardware [None req-ff1690f0-6c21-4d9a-89b7-086a0c79fb32 tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117873) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 22 10:16:01.622223 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-ff1690f0-6c21-4d9a-89b7-086a0c79fb32 tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:16:01.623176 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-ff1690f0-6c21-4d9a-89b7-086a0c79fb32 tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:16:01.627195 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-ff1690f0-6c21-4d9a-89b7-086a0c79fb32 tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:16:01.632618 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-ff1690f0-6c21-4d9a-89b7-086a0c79fb32 tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:16:01.680078 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.quota [None req-ff1690f0-6c21-4d9a-89b7-086a0c79fb32 tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Getting quotas for project 78629282e2b74418a2c1cdac32576ef1. Resources: {'instances', 'cores', 'ram'} {{(pid=117873) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 22 10:16:01.686014 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.quota [None req-ff1690f0-6c21-4d9a-89b7-086a0c79fb32 tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Getting quotas for user 7be3d844dcee4d19966fc7944463a0bc and project 78629282e2b74418a2c1cdac32576ef1. Resources: {'instances', 'cores', 'ram'} {{(pid=117873) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 22 10:16:01.705498 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.compute.api [None req-ff1690f0-6c21-4d9a-89b7-086a0c79fb32 tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Going to run 1 instances... {{(pid=117873) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 22 10:16:01.708687 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.compute.api [None req-ff1690f0-6c21-4d9a-89b7-086a0c79fb32 tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] [instance: 5828c9dc-3439-4da7-a94c-f81cbbfdcb99] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='22d2c064-5bf7-438e-bbb7-47259e4bdab5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117873) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 22 10:16:01.820799 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.policy [None req-d4e4fa69-73cd-4243-a537-7a2104383cca tempest-DeleteServersTestJSON-502292925 tempest-DeleteServersTestJSON-502292925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3af9bfaaaa4dcca0747f776115c826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4765b82e21647a9b391a98f446a0e17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117874) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:16:01.852779 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [None req-ff1690f0-6c21-4d9a-89b7-086a0c79fb32 tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 2.332860 Jun 22 10:16:01.853826 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 13/28] 10.222.0.43 () {60 vars in 1146 bytes} [Wed Jun 22 10:15:59 2022] POST /compute/v2.1/servers => generated 401 bytes in 2355 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 22 10:16:01.865002 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-28ec2978-eb3e-4fdc-9657-972340434bb8 tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Calling method '>' {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:16:01.866058 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.compute.api [None req-28ec2978-eb3e-4fdc-9657-972340434bb8 tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] [instance: 5828c9dc-3439-4da7-a94c-f81cbbfdcb99] Fetching instance by UUID {{(pid=117873) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:16:01.868731 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [None req-d4e4fa69-73cd-4243-a537-7a2104383cca tempest-DeleteServersTestJSON-502292925 tempest-DeleteServersTestJSON-502292925-project] 10.222.0.43 "GET /compute/v2.1/servers/8b3f01d1-ac00-4bfb-8ae3-be75720b8ad1" status: 200 len: 1272 microversion: 2.1 time: 0.388696 Jun 22 10:16:01.885088 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 16/29] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:16:01 2022] GET /compute/v2.1/servers/8b3f01d1-ac00-4bfb-8ae3-be75720b8ad1 => generated 1272 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:16:02.559243 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-a8bf3ecf-cb63-495e-a7c6-0eb50259ab2a tempest-VolumesTestJSON-838426207 tempest-VolumesTestJSON-838426207-project] Calling method '.version_select at 0x7f36bf9d0ee0>' {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:16:02.813237 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [None req-a8bf3ecf-cb63-495e-a7c6-0eb50259ab2a tempest-VolumesTestJSON-838426207 tempest-VolumesTestJSON-838426207-project] 10.222.0.43 "GET /compute/v2.1/os-volumes/bb3f78c9-0996-4af1-a7db-24510f12266c" status: 200 len: 351 microversion: 2.1 time: 0.257934 Jun 22 10:16:02.819513 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 17/30] 10.222.0.43 () {58 vars in 1244 bytes} [Wed Jun 22 10:16:02 2022] GET /compute/v2.1/os-volumes/bb3f78c9-0996-4af1-a7db-24510f12266c => generated 351 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 22 10:16:02.836121 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.policy [None req-28ec2978-eb3e-4fdc-9657-972340434bb8 tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7be3d844dcee4d19966fc7944463a0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78629282e2b74418a2c1cdac32576ef1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117873) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:16:02.844954 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [None req-28ec2978-eb3e-4fdc-9657-972340434bb8 tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] 10.222.0.43 "GET /compute/v2.1/servers/5828c9dc-3439-4da7-a94c-f81cbbfdcb99" status: 200 len: 1240 microversion: 2.1 time: 0.984553 Jun 22 10:16:02.850056 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 14/31] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:16:01 2022] GET /compute/v2.1/servers/5828c9dc-3439-4da7-a94c-f81cbbfdcb99 => generated 1240 bytes in 990 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:16:02.891795 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-ef57ccc4-0019-432f-be37-a77049b5b38e tempest-DeleteServersTestJSON-502292925 tempest-DeleteServersTestJSON-502292925-project] Calling method '>' {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:16:02.892667 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.compute.api [None req-ef57ccc4-0019-432f-be37-a77049b5b38e tempest-DeleteServersTestJSON-502292925 tempest-DeleteServersTestJSON-502292925-project] [instance: 8b3f01d1-ac00-4bfb-8ae3-be75720b8ad1] Fetching instance by UUID {{(pid=117874) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:16:02.915198 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-ef57ccc4-0019-432f-be37-a77049b5b38e tempest-DeleteServersTestJSON-502292925 tempest-DeleteServersTestJSON-502292925-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:16:02.915661 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-ef57ccc4-0019-432f-be37-a77049b5b38e tempest-DeleteServersTestJSON-502292925 tempest-DeleteServersTestJSON-502292925-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:16:02.918791 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-ef57ccc4-0019-432f-be37-a77049b5b38e tempest-DeleteServersTestJSON-502292925 tempest-DeleteServersTestJSON-502292925-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:16:02.919241 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-ef57ccc4-0019-432f-be37-a77049b5b38e tempest-DeleteServersTestJSON-502292925 tempest-DeleteServersTestJSON-502292925-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:16:03.479736 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.policy [None req-ef57ccc4-0019-432f-be37-a77049b5b38e tempest-DeleteServersTestJSON-502292925 tempest-DeleteServersTestJSON-502292925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3af9bfaaaa4dcca0747f776115c826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4765b82e21647a9b391a98f446a0e17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117874) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:16:03.503398 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [None req-ef57ccc4-0019-432f-be37-a77049b5b38e tempest-DeleteServersTestJSON-502292925 tempest-DeleteServersTestJSON-502292925-project] 10.222.0.43 "GET /compute/v2.1/servers/8b3f01d1-ac00-4bfb-8ae3-be75720b8ad1" status: 200 len: 1272 microversion: 2.1 time: 0.609689 Jun 22 10:16:03.514133 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 18/32] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:16:02 2022] GET /compute/v2.1/servers/8b3f01d1-ac00-4bfb-8ae3-be75720b8ad1 => generated 1272 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:16:03.865339 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-c1998535-93e2-42b3-b0fa-6cffa4556c93 tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Calling method '>' {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:16:03.866110 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.compute.api [None req-c1998535-93e2-42b3-b0fa-6cffa4556c93 tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] [instance: 5828c9dc-3439-4da7-a94c-f81cbbfdcb99] Fetching instance by UUID {{(pid=117874) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:16:03.878909 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-c1998535-93e2-42b3-b0fa-6cffa4556c93 tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:16:03.890278 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-c1998535-93e2-42b3-b0fa-6cffa4556c93 tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:16:03.891736 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-c1998535-93e2-42b3-b0fa-6cffa4556c93 tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:16:03.892242 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-c1998535-93e2-42b3-b0fa-6cffa4556c93 tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:16:04.082172 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-d1fb813d-a52d-4e62-9cb9-52c7124161f8 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1340412513", "imageRef": "22d2c064-5bf7-438e-bbb7-47259e4bdab5", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:16:04.216605 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.network.neutron [None req-d1fb813d-a52d-4e62-9cb9-52c7124161f8 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] validate_networks() for [('4f5c1d12-de71-40fa-95b0-3e1b37dac412', None, None, None, None, None)] {{(pid=117873) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 22 10:16:04.527100 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.policy [None req-c1998535-93e2-42b3-b0fa-6cffa4556c93 tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7be3d844dcee4d19966fc7944463a0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78629282e2b74418a2c1cdac32576ef1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117874) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:16:04.559776 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [None req-c1998535-93e2-42b3-b0fa-6cffa4556c93 tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] 10.222.0.43 "GET /compute/v2.1/servers/5828c9dc-3439-4da7-a94c-f81cbbfdcb99" status: 200 len: 1244 microversion: 2.1 time: 0.699293 Jun 22 10:16:04.570638 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 19/33] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:16:03 2022] GET /compute/v2.1/servers/5828c9dc-3439-4da7-a94c-f81cbbfdcb99 => generated 1244 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:16:04.588058 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-10e42867-5335-42cc-9e42-c059b539a8e9 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-475008616", "imageRef": "22d2c064-5bf7-438e-bbb7-47259e4bdab5", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "323c8696-2ed1-4abe-97f8-e9536ce29485"}], "security_groups": [{"name": "tempest-securitygroup--1056371999"}], "key_name": "tempest-keypair-1340879061", "user_data": "}} {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:16:05.382838 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.network.neutron [None req-10e42867-5335-42cc-9e42-c059b539a8e9 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] validate_networks() for [('323c8696-2ed1-4abe-97f8-e9536ce29485', None, None, None, None, None)] {{(pid=117874) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 22 10:16:06.436434 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.virt.hardware [None req-d1fb813d-a52d-4e62-9cb9-52c7124161f8 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Flavor limits 0:0:0 {{(pid=117873) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 22 10:16:06.446427 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.virt.hardware [None req-d1fb813d-a52d-4e62-9cb9-52c7124161f8 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Image limits 0:0:0 {{(pid=117873) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 22 10:16:06.446427 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.virt.hardware [None req-d1fb813d-a52d-4e62-9cb9-52c7124161f8 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Flavor pref 0:0:0 {{(pid=117873) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 22 10:16:06.446427 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.virt.hardware [None req-d1fb813d-a52d-4e62-9cb9-52c7124161f8 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Image pref 0:0:0 {{(pid=117873) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 22 10:16:06.446427 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.virt.hardware [None req-d1fb813d-a52d-4e62-9cb9-52c7124161f8 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117873) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 22 10:16:06.472097 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-d1fb813d-a52d-4e62-9cb9-52c7124161f8 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:16:06.478832 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-d1fb813d-a52d-4e62-9cb9-52c7124161f8 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:16:06.480056 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-d1fb813d-a52d-4e62-9cb9-52c7124161f8 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:16:06.480531 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-d1fb813d-a52d-4e62-9cb9-52c7124161f8 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:16:06.597182 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.quota [None req-d1fb813d-a52d-4e62-9cb9-52c7124161f8 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Getting quotas for project c3277b9cbc4b4a8bbacee8440cea1ed2. Resources: {'instances', 'cores', 'ram'} {{(pid=117873) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 22 10:16:06.623073 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.quota [None req-d1fb813d-a52d-4e62-9cb9-52c7124161f8 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Getting quotas for user 0d7292401816437fba46d073c4746e45 and project c3277b9cbc4b4a8bbacee8440cea1ed2. Resources: {'instances', 'cores', 'ram'} {{(pid=117873) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 22 10:16:06.654303 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.compute.api [None req-d1fb813d-a52d-4e62-9cb9-52c7124161f8 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Going to run 1 instances... {{(pid=117873) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 22 10:16:06.661812 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.compute.api [None req-d1fb813d-a52d-4e62-9cb9-52c7124161f8 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] [instance: a8d495ae-295a-4ffa-a2d9-5774249e687d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='22d2c064-5bf7-438e-bbb7-47259e4bdab5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117873) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 22 10:16:06.784432 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [None req-d1fb813d-a52d-4e62-9cb9-52c7124161f8 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.072443 Jun 22 10:16:06.785870 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 15/34] 10.222.0.43 () {60 vars in 1146 bytes} [Wed Jun 22 10:16:03 2022] POST /compute/v2.1/servers => generated 383 bytes in 3075 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 22 10:16:06.797739 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-8f994516-30bd-4655-8fdf-c77c5ebe4471 tempest-DeleteServersTestJSON-502292925 tempest-DeleteServersTestJSON-502292925-project] Calling method '>' {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:16:06.801281 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.compute.api [None req-8f994516-30bd-4655-8fdf-c77c5ebe4471 tempest-DeleteServersTestJSON-502292925 tempest-DeleteServersTestJSON-502292925-project] [instance: 8b3f01d1-ac00-4bfb-8ae3-be75720b8ad1] Fetching instance by UUID {{(pid=117873) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:16:06.814995 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-8f994516-30bd-4655-8fdf-c77c5ebe4471 tempest-DeleteServersTestJSON-502292925 tempest-DeleteServersTestJSON-502292925-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:16:06.818151 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-8f994516-30bd-4655-8fdf-c77c5ebe4471 tempest-DeleteServersTestJSON-502292925 tempest-DeleteServersTestJSON-502292925-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:16:06.822356 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-8f994516-30bd-4655-8fdf-c77c5ebe4471 tempest-DeleteServersTestJSON-502292925 tempest-DeleteServersTestJSON-502292925-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:16:06.824591 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-8f994516-30bd-4655-8fdf-c77c5ebe4471 tempest-DeleteServersTestJSON-502292925 tempest-DeleteServersTestJSON-502292925-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:16:08.256826 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.virt.hardware [None req-10e42867-5335-42cc-9e42-c059b539a8e9 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Flavor limits 0:0:0 {{(pid=117874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 22 10:16:08.258022 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.virt.hardware [None req-10e42867-5335-42cc-9e42-c059b539a8e9 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Image limits 0:0:0 {{(pid=117874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 22 10:16:08.259036 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.virt.hardware [None req-10e42867-5335-42cc-9e42-c059b539a8e9 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Flavor pref 0:0:0 {{(pid=117874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 22 10:16:08.259700 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.virt.hardware [None req-10e42867-5335-42cc-9e42-c059b539a8e9 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Image pref 0:0:0 {{(pid=117874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 22 10:16:08.260327 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.virt.hardware [None req-10e42867-5335-42cc-9e42-c059b539a8e9 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 22 10:16:08.281427 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-10e42867-5335-42cc-9e42-c059b539a8e9 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:16:08.286205 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-10e42867-5335-42cc-9e42-c059b539a8e9 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:16:08.287301 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-10e42867-5335-42cc-9e42-c059b539a8e9 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:16:08.287967 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-10e42867-5335-42cc-9e42-c059b539a8e9 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:16:08.357846 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.policy [None req-8f994516-30bd-4655-8fdf-c77c5ebe4471 tempest-DeleteServersTestJSON-502292925 tempest-DeleteServersTestJSON-502292925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3af9bfaaaa4dcca0747f776115c826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4765b82e21647a9b391a98f446a0e17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117873) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:16:08.358464 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.quota [None req-10e42867-5335-42cc-9e42-c059b539a8e9 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Getting quotas for project 5ee9d603d9cc4a8797f55d544f189720. Resources: {'instances', 'cores', 'ram'} {{(pid=117874) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 22 10:16:08.373323 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.quota [None req-10e42867-5335-42cc-9e42-c059b539a8e9 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Getting quotas for user 75753b29a78640df9622d4e2655baf9b and project 5ee9d603d9cc4a8797f55d544f189720. Resources: {'instances', 'cores', 'ram'} {{(pid=117874) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 22 10:16:08.392192 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [None req-8f994516-30bd-4655-8fdf-c77c5ebe4471 tempest-DeleteServersTestJSON-502292925 tempest-DeleteServersTestJSON-502292925-project] 10.222.0.43 "GET /compute/v2.1/servers/8b3f01d1-ac00-4bfb-8ae3-be75720b8ad1" status: 200 len: 1314 microversion: 2.1 time: 1.605013 Jun 22 10:16:08.402038 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 16/35] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:16:06 2022] GET /compute/v2.1/servers/8b3f01d1-ac00-4bfb-8ae3-be75720b8ad1 => generated 1314 bytes in 1615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:16:08.420452 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.compute.api [None req-10e42867-5335-42cc-9e42-c059b539a8e9 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Going to run 1 instances... {{(pid=117874) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 22 10:16:08.425926 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-c2167c1d-fef7-4f73-a3c0-e2bf8fb2aa63 tempest-VolumesTestJSON-838426207 tempest-VolumesTestJSON-838426207-project] Calling method '.version_select at 0x7f36bf1fb310>' {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:16:08.429197 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.compute.api [None req-10e42867-5335-42cc-9e42-c059b539a8e9 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] [instance: 73dbd5ab-5688-4de4-9da2-0b89d7cefb11] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='22d2c064-5bf7-438e-bbb7-47259e4bdab5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117874) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 22 10:16:08.572746 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [None req-c2167c1d-fef7-4f73-a3c0-e2bf8fb2aa63 tempest-VolumesTestJSON-838426207 tempest-VolumesTestJSON-838426207-project] 10.222.0.43 "GET /compute/v2.1/os-volumes/f731e416-44d0-4029-94ed-111cb723d40b" status: 200 len: 351 microversion: 2.1 time: 0.169587 Jun 22 10:16:08.573755 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 17/36] 10.222.0.43 () {58 vars in 1244 bytes} [Wed Jun 22 10:16:08 2022] GET /compute/v2.1/os-volumes/f731e416-44d0-4029-94ed-111cb723d40b => generated 351 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 10:16:08.582620 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-6df1f3fb-3f28-4f92-bab9-6cac928a227c tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Calling method '>' {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:16:08.585470 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.compute.api [None req-6df1f3fb-3f28-4f92-bab9-6cac928a227c tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] [instance: 5828c9dc-3439-4da7-a94c-f81cbbfdcb99] Fetching instance by UUID {{(pid=117873) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:16:08.604433 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-6df1f3fb-3f28-4f92-bab9-6cac928a227c tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:16:08.605089 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-6df1f3fb-3f28-4f92-bab9-6cac928a227c tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:16:08.609377 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-6df1f3fb-3f28-4f92-bab9-6cac928a227c tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:16:08.610058 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-6df1f3fb-3f28-4f92-bab9-6cac928a227c tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:16:08.707709 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [None req-10e42867-5335-42cc-9e42-c059b539a8e9 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 4.135714 Jun 22 10:16:08.711465 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 20/37] 10.222.0.43 () {62 vars in 1187 bytes} [Wed Jun 22 10:16:04 2022] POST /compute/v2.1/servers => generated 402 bytes in 4144 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jun 22 10:16:09.385710 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-840d3e9d-85a4-4032-9182-3efa3a0d5a8f tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Action: 'create', calling method: .version_select at 0x7f36bf9093a0>, body: {"keypair": {"name": "tempest-keypair-1521054167", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEKAVU1r4SVvPmujlHiMRmQGe9IPEef/dbhs2NSJKsCfD+F+hRI/6fJYppXxnN1tcYw791U2cxGurxEbAboBSVMSKJyIBQMwsX6+hSoJZ5ExRjSbFvZSCJCu2yg36Zkg3w=="}} {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:16:09.418203 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.quota [None req-840d3e9d-85a4-4032-9182-3efa3a0d5a8f tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Getting quotas for project ad52333bcbec425089c44c3e55df97ff. Resources: {'key_pairs'} {{(pid=117874) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 22 10:16:09.423685 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.quota [None req-840d3e9d-85a4-4032-9182-3efa3a0d5a8f tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Getting quotas for user 78fe3fc4334c43d7a5ef6d70f9f57523 and project ad52333bcbec425089c44c3e55df97ff. Resources: {'key_pairs'} {{(pid=117874) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 22 10:16:09.463795 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [None req-840d3e9d-85a4-4032-9182-3efa3a0d5a8f tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.749902 Jun 22 10:16:09.465247 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 21/38] 10.222.0.43 () {60 vars in 1158 bytes} [Wed Jun 22 10:16:08 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 753 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 10:16:09.470175 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-6520ed96-99e1-4a5e-af0a-66394d68babf tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Calling method '>' {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:16:09.471780 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.compute.api [None req-6520ed96-99e1-4a5e-af0a-66394d68babf tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] [instance: a8d495ae-295a-4ffa-a2d9-5774249e687d] Fetching instance by UUID {{(pid=117874) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:16:09.478679 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-6520ed96-99e1-4a5e-af0a-66394d68babf tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:16:09.479646 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-6520ed96-99e1-4a5e-af0a-66394d68babf tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:16:09.481104 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-6520ed96-99e1-4a5e-af0a-66394d68babf tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:16:09.481534 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-6520ed96-99e1-4a5e-af0a-66394d68babf tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:16:09.958853 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.policy [None req-6520ed96-99e1-4a5e-af0a-66394d68babf tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d7292401816437fba46d073c4746e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3277b9cbc4b4a8bbacee8440cea1ed2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117874) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:16:09.966883 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [None req-6520ed96-99e1-4a5e-af0a-66394d68babf tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] 10.222.0.43 "GET /compute/v2.1/servers/a8d495ae-295a-4ffa-a2d9-5774249e687d" status: 200 len: 1282 microversion: 2.1 time: 0.500355 Jun 22 10:16:09.986671 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 22/39] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:16:09 2022] GET /compute/v2.1/servers/a8d495ae-295a-4ffa-a2d9-5774249e687d => generated 1282 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:16:10.005923 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-26e65130-2fc7-482d-869d-ad24cf6f101c tempest-VolumesTestJSON-838426207 tempest-VolumesTestJSON-838426207-project] Calling method '.version_select at 0x7f36bf90f040>' {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:16:10.257466 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [None req-26e65130-2fc7-482d-869d-ad24cf6f101c tempest-VolumesTestJSON-838426207 tempest-VolumesTestJSON-838426207-project] 10.222.0.43 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.269405 Jun 22 10:16:10.258544 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 23/40] 10.222.0.43 () {58 vars in 1133 bytes} [Wed Jun 22 10:16:09 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:16:10.264397 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-b15dda80-d460-45c2-9e9b-1d7ac12fb9c4 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Calling method '>' {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:16:10.265203 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.compute.api [None req-b15dda80-d460-45c2-9e9b-1d7ac12fb9c4 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] [instance: 73dbd5ab-5688-4de4-9da2-0b89d7cefb11] Fetching instance by UUID {{(pid=117874) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:16:10.279025 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-b15dda80-d460-45c2-9e9b-1d7ac12fb9c4 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:16:10.280638 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-b15dda80-d460-45c2-9e9b-1d7ac12fb9c4 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:16:10.281596 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-b15dda80-d460-45c2-9e9b-1d7ac12fb9c4 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:16:10.284743 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-b15dda80-d460-45c2-9e9b-1d7ac12fb9c4 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:16:10.605291 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.policy [None req-b15dda80-d460-45c2-9e9b-1d7ac12fb9c4 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75753b29a78640df9622d4e2655baf9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee9d603d9cc4a8797f55d544f189720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117874) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:16:10.618088 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.policy [None req-b15dda80-d460-45c2-9e9b-1d7ac12fb9c4 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75753b29a78640df9622d4e2655baf9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee9d603d9cc4a8797f55d544f189720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117874) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:16:10.621293 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.policy [None req-b15dda80-d460-45c2-9e9b-1d7ac12fb9c4 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75753b29a78640df9622d4e2655baf9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee9d603d9cc4a8797f55d544f189720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117874) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:16:10.636681 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [None req-b15dda80-d460-45c2-9e9b-1d7ac12fb9c4 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] 10.222.0.43 "GET /compute/v2.1/servers/73dbd5ab-5688-4de4-9da2-0b89d7cefb11" status: 200 len: 1277 microversion: 2.20 time: 0.376872 Jun 22 10:16:10.637777 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 24/41] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jun 22 10:16:10 2022] GET /compute/v2.1/servers/73dbd5ab-5688-4de4-9da2-0b89d7cefb11 => generated 1277 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 10:16:10.643263 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.policy [None req-6df1f3fb-3f28-4f92-bab9-6cac928a227c tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7be3d844dcee4d19966fc7944463a0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78629282e2b74418a2c1cdac32576ef1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117873) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:16:10.657408 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [None req-6df1f3fb-3f28-4f92-bab9-6cac928a227c tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] 10.222.0.43 "GET /compute/v2.1/servers/5828c9dc-3439-4da7-a94c-f81cbbfdcb99" status: 200 len: 1365 microversion: 2.1 time: 2.076662 Jun 22 10:16:10.661310 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 18/42] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:16:08 2022] GET /compute/v2.1/servers/5828c9dc-3439-4da7-a94c-f81cbbfdcb99 => generated 1365 bytes in 2087 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:16:10.680162 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-0df117b4-3b22-43b3-90b5-5ca369ccb32c tempest-VolumesTestJSON-838426207 tempest-VolumesTestJSON-838426207-project] Calling method '.version_select at 0x7f36bf1fb4c0>' {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:16:10.682483 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-7f8eb1dc-f4f7-4e9b-94cf-30356dbcaed1 tempest-DeleteServersTestJSON-502292925 tempest-DeleteServersTestJSON-502292925-project] Calling method '>' {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:16:10.692040 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.compute.api [None req-7f8eb1dc-f4f7-4e9b-94cf-30356dbcaed1 tempest-DeleteServersTestJSON-502292925 tempest-DeleteServersTestJSON-502292925-project] [instance: 8b3f01d1-ac00-4bfb-8ae3-be75720b8ad1] Fetching instance by UUID {{(pid=117874) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:16:10.724152 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-7f8eb1dc-f4f7-4e9b-94cf-30356dbcaed1 tempest-DeleteServersTestJSON-502292925 tempest-DeleteServersTestJSON-502292925-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:16:10.724922 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-7f8eb1dc-f4f7-4e9b-94cf-30356dbcaed1 tempest-DeleteServersTestJSON-502292925 tempest-DeleteServersTestJSON-502292925-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:16:10.726984 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-7f8eb1dc-f4f7-4e9b-94cf-30356dbcaed1 tempest-DeleteServersTestJSON-502292925 tempest-DeleteServersTestJSON-502292925-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:16:10.731447 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-7f8eb1dc-f4f7-4e9b-94cf-30356dbcaed1 tempest-DeleteServersTestJSON-502292925 tempest-DeleteServersTestJSON-502292925-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:16:10.928381 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [None req-0df117b4-3b22-43b3-90b5-5ca369ccb32c tempest-VolumesTestJSON-838426207 tempest-VolumesTestJSON-838426207-project] 10.222.0.43 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.252030 Jun 22 10:16:10.929561 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 19/43] 10.222.0.43 () {58 vars in 1148 bytes} [Wed Jun 22 10:16:10 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 695 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 10:16:10.936365 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-d5ffa06c-a98b-4c50-87cb-487caa30cb3a tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-456214950", "imageRef": "22d2c064-5bf7-438e-bbb7-47259e4bdab5", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:16:11.183991 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.network.neutron [None req-d5ffa06c-a98b-4c50-87cb-487caa30cb3a tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] validate_networks() for [('4f5c1d12-de71-40fa-95b0-3e1b37dac412', None, None, None, None, None)] {{(pid=117873) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 22 10:16:12.395180 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.policy [None req-7f8eb1dc-f4f7-4e9b-94cf-30356dbcaed1 tempest-DeleteServersTestJSON-502292925 tempest-DeleteServersTestJSON-502292925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3af9bfaaaa4dcca0747f776115c826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4765b82e21647a9b391a98f446a0e17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117874) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:16:12.424083 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [None req-7f8eb1dc-f4f7-4e9b-94cf-30356dbcaed1 tempest-DeleteServersTestJSON-502292925 tempest-DeleteServersTestJSON-502292925-project] 10.222.0.43 "GET /compute/v2.1/servers/8b3f01d1-ac00-4bfb-8ae3-be75720b8ad1" status: 200 len: 1314 microversion: 2.1 time: 1.784381 Jun 22 10:16:12.429557 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 25/44] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:16:10 2022] GET /compute/v2.1/servers/8b3f01d1-ac00-4bfb-8ae3-be75720b8ad1 => generated 1314 bytes in 1791 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:16:12.443151 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-ae01b447-dc55-46f6-bd4b-2c18d3a0a9f3 tempest-VolumesTestJSON-838426207 tempest-VolumesTestJSON-838426207-project] Calling method '.version_select at 0x7f36bf924280>' {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:16:12.603441 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [None req-ae01b447-dc55-46f6-bd4b-2c18d3a0a9f3 tempest-VolumesTestJSON-838426207 tempest-VolumesTestJSON-838426207-project] 10.222.0.43 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.171685 Jun 22 10:16:12.604765 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 26/45] 10.222.0.43 () {58 vars in 1133 bytes} [Wed Jun 22 10:16:12 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:16:12.609739 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-f008b7ba-a5b1-464b-9275-b4bcbbc4c8ef tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Calling method '>' {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:16:12.610644 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.compute.api [None req-f008b7ba-a5b1-464b-9275-b4bcbbc4c8ef tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] [instance: 73dbd5ab-5688-4de4-9da2-0b89d7cefb11] Fetching instance by UUID {{(pid=117874) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:16:12.621577 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-f008b7ba-a5b1-464b-9275-b4bcbbc4c8ef tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:16:12.624955 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-f008b7ba-a5b1-464b-9275-b4bcbbc4c8ef tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:16:12.627479 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-f008b7ba-a5b1-464b-9275-b4bcbbc4c8ef tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:16:12.629000 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-f008b7ba-a5b1-464b-9275-b4bcbbc4c8ef tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:16:13.014339 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.policy [None req-f008b7ba-a5b1-464b-9275-b4bcbbc4c8ef tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75753b29a78640df9622d4e2655baf9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee9d603d9cc4a8797f55d544f189720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117874) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:16:13.039744 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.policy [None req-f008b7ba-a5b1-464b-9275-b4bcbbc4c8ef tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75753b29a78640df9622d4e2655baf9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee9d603d9cc4a8797f55d544f189720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117874) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:16:13.043759 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.policy [None req-f008b7ba-a5b1-464b-9275-b4bcbbc4c8ef tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75753b29a78640df9622d4e2655baf9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee9d603d9cc4a8797f55d544f189720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117874) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:16:13.053172 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [None req-f008b7ba-a5b1-464b-9275-b4bcbbc4c8ef tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] 10.222.0.43 "GET /compute/v2.1/servers/73dbd5ab-5688-4de4-9da2-0b89d7cefb11" status: 200 len: 1339 microversion: 2.20 time: 0.446885 Jun 22 10:16:13.056903 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 27/46] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jun 22 10:16:12 2022] GET /compute/v2.1/servers/73dbd5ab-5688-4de4-9da2-0b89d7cefb11 => generated 1339 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 10:16:13.072836 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-f47b0df3-fd84-4d94-af81-af4cde23d39c tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Calling method '>' {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:16:13.086297 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.compute.api [None req-f47b0df3-fd84-4d94-af81-af4cde23d39c tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] [instance: 5828c9dc-3439-4da7-a94c-f81cbbfdcb99] Fetching instance by UUID {{(pid=117874) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:16:13.108943 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-f47b0df3-fd84-4d94-af81-af4cde23d39c tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:16:13.112927 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-f47b0df3-fd84-4d94-af81-af4cde23d39c tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:16:13.116823 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-f47b0df3-fd84-4d94-af81-af4cde23d39c tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:16:13.117660 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-f47b0df3-fd84-4d94-af81-af4cde23d39c tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:16:13.806006 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.policy [None req-f47b0df3-fd84-4d94-af81-af4cde23d39c tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7be3d844dcee4d19966fc7944463a0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78629282e2b74418a2c1cdac32576ef1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117874) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:16:13.822250 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.virt.hardware [None req-d5ffa06c-a98b-4c50-87cb-487caa30cb3a tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Flavor limits 0:0:0 {{(pid=117873) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 22 10:16:13.823300 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.virt.hardware [None req-d5ffa06c-a98b-4c50-87cb-487caa30cb3a tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Image limits 0:0:0 {{(pid=117873) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 22 10:16:13.823933 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.virt.hardware [None req-d5ffa06c-a98b-4c50-87cb-487caa30cb3a tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Flavor pref 0:0:0 {{(pid=117873) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 22 10:16:13.824503 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.virt.hardware [None req-d5ffa06c-a98b-4c50-87cb-487caa30cb3a tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Image pref 0:0:0 {{(pid=117873) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 22 10:16:13.825248 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.virt.hardware [None req-d5ffa06c-a98b-4c50-87cb-487caa30cb3a tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117873) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 22 10:16:13.835986 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [None req-f47b0df3-fd84-4d94-af81-af4cde23d39c tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] 10.222.0.43 "GET /compute/v2.1/servers/5828c9dc-3439-4da7-a94c-f81cbbfdcb99" status: 200 len: 1365 microversion: 2.1 time: 0.766862 Jun 22 10:16:13.844515 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 28/47] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:16:13 2022] GET /compute/v2.1/servers/5828c9dc-3439-4da7-a94c-f81cbbfdcb99 => generated 1365 bytes in 787 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:16:13.854800 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-d5ffa06c-a98b-4c50-87cb-487caa30cb3a tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:16:13.855389 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-d5ffa06c-a98b-4c50-87cb-487caa30cb3a tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:16:13.856555 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-d5ffa06c-a98b-4c50-87cb-487caa30cb3a tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:16:13.857228 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-d5ffa06c-a98b-4c50-87cb-487caa30cb3a tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:16:13.860061 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-527c44b7-2ead-43fb-8a50-91370e0d6bdc tempest-VolumesTestJSON-838426207 tempest-VolumesTestJSON-838426207-project] Calling method '.version_select at 0x7f36bf909430>' {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:16:13.967502 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.quota [None req-d5ffa06c-a98b-4c50-87cb-487caa30cb3a tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Getting quotas for project c3277b9cbc4b4a8bbacee8440cea1ed2. Resources: {'instances', 'cores', 'ram'} {{(pid=117873) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 22 10:16:13.994664 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.quota [None req-d5ffa06c-a98b-4c50-87cb-487caa30cb3a tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Getting quotas for user 0d7292401816437fba46d073c4746e45 and project c3277b9cbc4b4a8bbacee8440cea1ed2. Resources: {'instances', 'cores', 'ram'} {{(pid=117873) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 22 10:16:14.052507 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.compute.api [None req-d5ffa06c-a98b-4c50-87cb-487caa30cb3a tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Going to run 1 instances... {{(pid=117873) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 22 10:16:14.069166 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.compute.api [None req-d5ffa06c-a98b-4c50-87cb-487caa30cb3a tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] [instance: 9f07e4bb-f4e9-428e-8feb-db50b3ff2109] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='22d2c064-5bf7-438e-bbb7-47259e4bdab5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117873) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 22 10:16:14.134394 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [None req-527c44b7-2ead-43fb-8a50-91370e0d6bdc tempest-VolumesTestJSON-838426207 tempest-VolumesTestJSON-838426207-project] 10.222.0.43 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.288141 Jun 22 10:16:14.136404 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 29/48] 10.222.0.43 () {58 vars in 1166 bytes} [Wed Jun 22 10:16:13 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 10:16:14.232464 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [None req-d5ffa06c-a98b-4c50-87cb-487caa30cb3a tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.301591 Jun 22 10:16:14.237015 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 20/49] 10.222.0.43 () {60 vars in 1146 bytes} [Wed Jun 22 10:16:10 2022] POST /compute/v2.1/servers => generated 383 bytes in 3306 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 22 10:16:14.259186 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-fbb70323-2001-42d1-8f9b-231d76793b2b tempest-DeleteServersTestJSON-502292925 tempest-DeleteServersTestJSON-502292925-project] Calling method '>' {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:16:14.259806 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.compute.api [None req-fbb70323-2001-42d1-8f9b-231d76793b2b tempest-DeleteServersTestJSON-502292925 tempest-DeleteServersTestJSON-502292925-project] [instance: 8b3f01d1-ac00-4bfb-8ae3-be75720b8ad1] Fetching instance by UUID {{(pid=117873) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:16:14.262352 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [req-369ef960-e57c-4117-8294-784389cd4ff5 req-039cf9e1-b5f7-46c5-bd48-b264f6e9a841 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8b3f01d1-ac00-4bfb-8ae3-be75720b8ad1", "tag": "bd80709c-555a-4184-b601-e49f7cd8bdc4"}]} {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:16:14.293826 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-fbb70323-2001-42d1-8f9b-231d76793b2b tempest-DeleteServersTestJSON-502292925 tempest-DeleteServersTestJSON-502292925-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:16:14.296950 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-fbb70323-2001-42d1-8f9b-231d76793b2b tempest-DeleteServersTestJSON-502292925 tempest-DeleteServersTestJSON-502292925-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:16:14.300579 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [req-369ef960-e57c-4117-8294-784389cd4ff5 req-039cf9e1-b5f7-46c5-bd48-b264f6e9a841 service nova] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:16:14.301515 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [req-369ef960-e57c-4117-8294-784389cd4ff5 req-039cf9e1-b5f7-46c5-bd48-b264f6e9a841 service nova] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:16:14.303637 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-fbb70323-2001-42d1-8f9b-231d76793b2b tempest-DeleteServersTestJSON-502292925 tempest-DeleteServersTestJSON-502292925-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:16:14.304217 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-fbb70323-2001-42d1-8f9b-231d76793b2b tempest-DeleteServersTestJSON-502292925 tempest-DeleteServersTestJSON-502292925-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:16:14.354004 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.compute.server_external_events [req-369ef960-e57c-4117-8294-784389cd4ff5 req-039cf9e1-b5f7-46c5-bd48-b264f6e9a841 service nova] Creating event network-changed:bd80709c-555a-4184-b601-e49f7cd8bdc4 for instance 8b3f01d1-ac00-4bfb-8ae3-be75720b8ad1 on hv-cinder-84713 Jun 22 10:16:14.363113 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [req-369ef960-e57c-4117-8294-784389cd4ff5 req-039cf9e1-b5f7-46c5-bd48-b264f6e9a841 service nova] Acquired lock "compute-rpcapi-router" {{(pid=117874) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jun 22 10:16:14.367413 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-4c1b6b2e-e7b9-4baf-953a-264dd80fa8a0 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:16:14.368526 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-4c1b6b2e-e7b9-4baf-953a-264dd80fa8a0 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:16:14.369774 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-4c1b6b2e-e7b9-4baf-953a-264dd80fa8a0 None None] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:16:14.377100 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-4c1b6b2e-e7b9-4baf-953a-264dd80fa8a0 None None] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:16:14.408766 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.compute.rpcapi [None req-4c1b6b2e-e7b9-4baf-953a-264dd80fa8a0 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jun 22 10:16:14.409682 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-4c1b6b2e-e7b9-4baf-953a-264dd80fa8a0 None None] Releasing lock "compute-rpcapi-router" {{(pid=117874) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jun 22 10:16:14.468345 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [None req-4c1b6b2e-e7b9-4baf-953a-264dd80fa8a0 None None] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.330166 Jun 22 10:16:14.478027 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 30/50] 10.222.0.43 () {64 vars in 1317 bytes} [Wed Jun 22 10:16:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 10:16:14.502709 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-986f14c9-0da1-4f8f-a5bf-46b31a3b1ec5 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Calling method '>' {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:16:14.513982 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.compute.api [None req-986f14c9-0da1-4f8f-a5bf-46b31a3b1ec5 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] [instance: 73dbd5ab-5688-4de4-9da2-0b89d7cefb11] Fetching instance by UUID {{(pid=117874) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:16:14.538524 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-986f14c9-0da1-4f8f-a5bf-46b31a3b1ec5 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:16:14.540885 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-986f14c9-0da1-4f8f-a5bf-46b31a3b1ec5 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:16:14.543395 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-986f14c9-0da1-4f8f-a5bf-46b31a3b1ec5 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:16:14.544031 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-986f14c9-0da1-4f8f-a5bf-46b31a3b1ec5 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:16:14.780780 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.policy [None req-986f14c9-0da1-4f8f-a5bf-46b31a3b1ec5 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75753b29a78640df9622d4e2655baf9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee9d603d9cc4a8797f55d544f189720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117874) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:16:14.795952 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.policy [None req-986f14c9-0da1-4f8f-a5bf-46b31a3b1ec5 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75753b29a78640df9622d4e2655baf9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee9d603d9cc4a8797f55d544f189720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117874) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:16:14.808781 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.policy [None req-986f14c9-0da1-4f8f-a5bf-46b31a3b1ec5 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75753b29a78640df9622d4e2655baf9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee9d603d9cc4a8797f55d544f189720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117874) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:16:14.825036 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [None req-986f14c9-0da1-4f8f-a5bf-46b31a3b1ec5 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] 10.222.0.43 "GET /compute/v2.1/servers/73dbd5ab-5688-4de4-9da2-0b89d7cefb11" status: 200 len: 1339 microversion: 2.20 time: 0.341831 Jun 22 10:16:14.830842 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 31/51] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jun 22 10:16:14 2022] GET /compute/v2.1/servers/73dbd5ab-5688-4de4-9da2-0b89d7cefb11 => generated 1339 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 10:16:14.843701 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-3cf76c15-1039-43f3-be16-0131e5439d52 tempest-VolumesTestJSON-838426207 tempest-VolumesTestJSON-838426207-project] Calling method '.version_select at 0x7f36bf90f670>' {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:16:14.976189 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.policy [None req-fbb70323-2001-42d1-8f9b-231d76793b2b tempest-DeleteServersTestJSON-502292925 tempest-DeleteServersTestJSON-502292925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3af9bfaaaa4dcca0747f776115c826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4765b82e21647a9b391a98f446a0e17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117873) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:16:14.994405 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [None req-fbb70323-2001-42d1-8f9b-231d76793b2b tempest-DeleteServersTestJSON-502292925 tempest-DeleteServersTestJSON-502292925-project] 10.222.0.43 "GET /compute/v2.1/servers/8b3f01d1-ac00-4bfb-8ae3-be75720b8ad1" status: 200 len: 1314 microversion: 2.1 time: 0.755244 Jun 22 10:16:15.001438 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 21/52] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:16:14 2022] GET /compute/v2.1/servers/8b3f01d1-ac00-4bfb-8ae3-be75720b8ad1 => generated 1314 bytes in 764 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:16:15.028145 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-8eb1889a-7b62-4fc9-b800-2440dca77eea tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Calling method '>' {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:16:15.057468 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.compute.api [None req-8eb1889a-7b62-4fc9-b800-2440dca77eea tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] [instance: 9f07e4bb-f4e9-428e-8feb-db50b3ff2109] Fetching instance by UUID {{(pid=117873) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:16:15.057565 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [None req-3cf76c15-1039-43f3-be16-0131e5439d52 tempest-VolumesTestJSON-838426207 tempest-VolumesTestJSON-838426207-project] 10.222.0.43 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.213177 Jun 22 10:16:15.057565 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 32/53] 10.222.0.43 () {58 vars in 1169 bytes} [Wed Jun 22 10:16:14 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 695 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 10:16:15.057565 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-003cea8e-6453-4960-9f7b-00da127e520a tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Calling method '>' {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:16:15.057565 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.compute.api [None req-003cea8e-6453-4960-9f7b-00da127e520a tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] [instance: 5828c9dc-3439-4da7-a94c-f81cbbfdcb99] Fetching instance by UUID {{(pid=117874) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:16:15.065076 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-003cea8e-6453-4960-9f7b-00da127e520a tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:16:15.065523 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-003cea8e-6453-4960-9f7b-00da127e520a tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:16:15.066433 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-003cea8e-6453-4960-9f7b-00da127e520a tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:16:15.095998 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-003cea8e-6453-4960-9f7b-00da127e520a tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.029s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:16:15.292152 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.policy [None req-8eb1889a-7b62-4fc9-b800-2440dca77eea tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d7292401816437fba46d073c4746e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3277b9cbc4b4a8bbacee8440cea1ed2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117873) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:16:15.304535 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [None req-8eb1889a-7b62-4fc9-b800-2440dca77eea tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] 10.222.0.43 "GET /compute/v2.1/servers/9f07e4bb-f4e9-428e-8feb-db50b3ff2109" status: 200 len: 1221 microversion: 2.1 time: 0.300385 Jun 22 10:16:15.317533 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 22/54] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:16:15 2022] GET /compute/v2.1/servers/9f07e4bb-f4e9-428e-8feb-db50b3ff2109 => generated 1221 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:16:15.322601 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-b814cdf7-77c2-43cf-833e-558b7b7ca021 tempest-VolumesTestJSON-838426207 tempest-VolumesTestJSON-838426207-project] Calling method '.version_select at 0x7f36bf195160>' {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:16:15.716536 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [None req-b814cdf7-77c2-43cf-833e-558b7b7ca021 tempest-VolumesTestJSON-838426207 tempest-VolumesTestJSON-838426207-project] 10.222.0.43 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.397671 Jun 22 10:16:15.717196 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 23/55] 10.222.0.43 () {58 vars in 1154 bytes} [Wed Jun 22 10:16:15 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:16:15.743291 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-17334bfd-3263-4fce-9e77-e4f473caa518 tempest-VolumesTestJSON-838426207 tempest-VolumesTestJSON-838426207-project] Calling method '.version_select at 0x7f36bf14af70>' {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:16:16.090428 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [None req-17334bfd-3263-4fce-9e77-e4f473caa518 tempest-VolumesTestJSON-838426207 tempest-VolumesTestJSON-838426207-project] 10.222.0.43 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.362708 Jun 22 10:16:16.091123 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 24/56] 10.222.0.43 () {58 vars in 1187 bytes} [Wed Jun 22 10:16:15 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 10:16:16.098303 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-0847d4e1-d39d-42fe-b553-4875e85a00a0 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Calling method '>' {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:16:16.098303 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.compute.api [None req-0847d4e1-d39d-42fe-b553-4875e85a00a0 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] [instance: 73dbd5ab-5688-4de4-9da2-0b89d7cefb11] Fetching instance by UUID {{(pid=117873) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:16:16.111979 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.policy [None req-003cea8e-6453-4960-9f7b-00da127e520a tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7be3d844dcee4d19966fc7944463a0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78629282e2b74418a2c1cdac32576ef1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117874) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:16:16.129618 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [None req-003cea8e-6453-4960-9f7b-00da127e520a tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] 10.222.0.43 "GET /compute/v2.1/servers/5828c9dc-3439-4da7-a94c-f81cbbfdcb99" status: 200 len: 1365 microversion: 2.1 time: 1.082268 Jun 22 10:16:16.133842 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-0847d4e1-d39d-42fe-b553-4875e85a00a0 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:16:16.134450 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 33/57] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:16:15 2022] GET /compute/v2.1/servers/5828c9dc-3439-4da7-a94c-f81cbbfdcb99 => generated 1365 bytes in 1088 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:16:16.136786 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-0847d4e1-d39d-42fe-b553-4875e85a00a0 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:16:16.137948 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-0847d4e1-d39d-42fe-b553-4875e85a00a0 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:16:16.138547 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-0847d4e1-d39d-42fe-b553-4875e85a00a0 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:16:16.149545 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-50df716f-deb4-4613-9961-674852231659 tempest-DeleteServersTestJSON-502292925 tempest-DeleteServersTestJSON-502292925-project] Calling method '>' {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:16:16.154274 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.compute.api [None req-50df716f-deb4-4613-9961-674852231659 tempest-DeleteServersTestJSON-502292925 tempest-DeleteServersTestJSON-502292925-project] [instance: 8b3f01d1-ac00-4bfb-8ae3-be75720b8ad1] Fetching instance by UUID {{(pid=117874) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:16:16.172315 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-50df716f-deb4-4613-9961-674852231659 tempest-DeleteServersTestJSON-502292925 tempest-DeleteServersTestJSON-502292925-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:16:16.174363 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-50df716f-deb4-4613-9961-674852231659 tempest-DeleteServersTestJSON-502292925 tempest-DeleteServersTestJSON-502292925-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:16:16.177824 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-50df716f-deb4-4613-9961-674852231659 tempest-DeleteServersTestJSON-502292925 tempest-DeleteServersTestJSON-502292925-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:16:16.178701 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-50df716f-deb4-4613-9961-674852231659 tempest-DeleteServersTestJSON-502292925 tempest-DeleteServersTestJSON-502292925-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:16:16.282739 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.policy [None req-0847d4e1-d39d-42fe-b553-4875e85a00a0 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75753b29a78640df9622d4e2655baf9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee9d603d9cc4a8797f55d544f189720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117873) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:16:16.304951 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.policy [None req-0847d4e1-d39d-42fe-b553-4875e85a00a0 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75753b29a78640df9622d4e2655baf9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee9d603d9cc4a8797f55d544f189720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117873) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:16:16.306713 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.policy [None req-0847d4e1-d39d-42fe-b553-4875e85a00a0 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75753b29a78640df9622d4e2655baf9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee9d603d9cc4a8797f55d544f189720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117873) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:16:16.308062 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [None req-0847d4e1-d39d-42fe-b553-4875e85a00a0 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] 10.222.0.43 "GET /compute/v2.1/servers/73dbd5ab-5688-4de4-9da2-0b89d7cefb11" status: 200 len: 1339 microversion: 2.20 time: 0.215600 Jun 22 10:16:16.308969 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 25/58] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jun 22 10:16:16 2022] GET /compute/v2.1/servers/73dbd5ab-5688-4de4-9da2-0b89d7cefb11 => generated 1339 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 10:16:16.351395 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-6f51e694-e743-431a-a749-4b41daf7fa61 tempest-VolumesTestJSON-838426207 tempest-VolumesTestJSON-838426207-project] Calling method '.version_select at 0x7f36bf12cb80>' {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:16:16.768920 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [None req-6f51e694-e743-431a-a749-4b41daf7fa61 tempest-VolumesTestJSON-838426207 tempest-VolumesTestJSON-838426207-project] 10.222.0.43 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.458789 Jun 22 10:16:16.770548 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 26/59] 10.222.0.43 () {58 vars in 1154 bytes} [Wed Jun 22 10:16:16 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:16:16.796703 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-a7de1b64-dc12-4f72-b858-2af8c0afe87a tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Calling method '>' {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:16:16.800544 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.compute.api [None req-a7de1b64-dc12-4f72-b858-2af8c0afe87a tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] [instance: 9f07e4bb-f4e9-428e-8feb-db50b3ff2109] Fetching instance by UUID {{(pid=117873) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:16:16.855271 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-a7de1b64-dc12-4f72-b858-2af8c0afe87a tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:16:16.856268 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-a7de1b64-dc12-4f72-b858-2af8c0afe87a tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:16:16.864391 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-a7de1b64-dc12-4f72-b858-2af8c0afe87a tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:16:16.867252 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-a7de1b64-dc12-4f72-b858-2af8c0afe87a tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:16:17.033795 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.policy [None req-50df716f-deb4-4613-9961-674852231659 tempest-DeleteServersTestJSON-502292925 tempest-DeleteServersTestJSON-502292925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3af9bfaaaa4dcca0747f776115c826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4765b82e21647a9b391a98f446a0e17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117874) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:16:17.040422 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [None req-50df716f-deb4-4613-9961-674852231659 tempest-DeleteServersTestJSON-502292925 tempest-DeleteServersTestJSON-502292925-project] 10.222.0.43 "GET /compute/v2.1/servers/8b3f01d1-ac00-4bfb-8ae3-be75720b8ad1" status: 200 len: 1314 microversion: 2.1 time: 0.904550 Jun 22 10:16:17.048494 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 34/60] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:16:16 2022] GET /compute/v2.1/servers/8b3f01d1-ac00-4bfb-8ae3-be75720b8ad1 => generated 1314 bytes in 913 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:16:17.241641 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.policy [None req-a7de1b64-dc12-4f72-b858-2af8c0afe87a tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d7292401816437fba46d073c4746e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3277b9cbc4b4a8bbacee8440cea1ed2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117873) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:16:17.253537 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [None req-a7de1b64-dc12-4f72-b858-2af8c0afe87a tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] 10.222.0.43 "GET /compute/v2.1/servers/9f07e4bb-f4e9-428e-8feb-db50b3ff2109" status: 200 len: 1281 microversion: 2.1 time: 0.479425 Jun 22 10:16:17.254808 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 27/61] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:16:16 2022] GET /compute/v2.1/servers/9f07e4bb-f4e9-428e-8feb-db50b3ff2109 => generated 1281 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:16:17.275810 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-c0fdf487-419a-44f8-8fdb-16aaf1415e2e tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Calling method '>' {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:16:17.277963 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.compute.api [None req-c0fdf487-419a-44f8-8fdb-16aaf1415e2e tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] [instance: 5828c9dc-3439-4da7-a94c-f81cbbfdcb99] Fetching instance by UUID {{(pid=117873) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:16:17.291452 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-c0fdf487-419a-44f8-8fdb-16aaf1415e2e tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:16:17.294142 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-c0fdf487-419a-44f8-8fdb-16aaf1415e2e tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:16:17.295189 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-c0fdf487-419a-44f8-8fdb-16aaf1415e2e tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:16:17.295784 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-c0fdf487-419a-44f8-8fdb-16aaf1415e2e tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:16:17.646827 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [req-6bd1fbda-e635-4f33-957b-6741cec75d12 req-429971b8-4ce8-4286-93db-1f8b2afe687d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5828c9dc-3439-4da7-a94c-f81cbbfdcb99", "tag": "f9ce6858-55e5-4d8b-b5fe-2cff5d9c4f08"}]} {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:16:17.665938 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG dbcounter [-] [117874] Writing DB stats nova_api:SELECT=83,nova_api:INSERT=6 {{(pid=117874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:16:17.676017 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [req-6bd1fbda-e635-4f33-957b-6741cec75d12 req-429971b8-4ce8-4286-93db-1f8b2afe687d service nova] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:16:17.685849 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [req-6bd1fbda-e635-4f33-957b-6741cec75d12 req-429971b8-4ce8-4286-93db-1f8b2afe687d service nova] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:16:17.745855 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.compute.server_external_events [req-6bd1fbda-e635-4f33-957b-6741cec75d12 req-429971b8-4ce8-4286-93db-1f8b2afe687d service nova] Creating event network-changed:f9ce6858-55e5-4d8b-b5fe-2cff5d9c4f08 for instance 5828c9dc-3439-4da7-a94c-f81cbbfdcb99 on hv-cinder-84713 Jun 22 10:16:17.769307 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [req-6bd1fbda-e635-4f33-957b-6741cec75d12 req-429971b8-4ce8-4286-93db-1f8b2afe687d service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.714259 Jun 22 10:16:17.771202 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 35/62] 10.222.0.43 () {64 vars in 1317 bytes} [Wed Jun 22 10:16:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 10:16:17.784227 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-6c2f44ca-ae7b-409d-a370-3d58d3b4d7f7 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Calling method '>' {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:16:17.793507 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.compute.api [None req-6c2f44ca-ae7b-409d-a370-3d58d3b4d7f7 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] [instance: 73dbd5ab-5688-4de4-9da2-0b89d7cefb11] Fetching instance by UUID {{(pid=117874) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:16:17.818640 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-6c2f44ca-ae7b-409d-a370-3d58d3b4d7f7 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:16:17.819150 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-6c2f44ca-ae7b-409d-a370-3d58d3b4d7f7 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:16:17.822256 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-6c2f44ca-ae7b-409d-a370-3d58d3b4d7f7 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:16:17.823393 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-6c2f44ca-ae7b-409d-a370-3d58d3b4d7f7 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:16:17.917626 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.policy [None req-c0fdf487-419a-44f8-8fdb-16aaf1415e2e tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7be3d844dcee4d19966fc7944463a0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78629282e2b74418a2c1cdac32576ef1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117873) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:16:17.926476 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [None req-c0fdf487-419a-44f8-8fdb-16aaf1415e2e tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] 10.222.0.43 "GET /compute/v2.1/servers/5828c9dc-3439-4da7-a94c-f81cbbfdcb99" status: 200 len: 1365 microversion: 2.1 time: 0.668698 Jun 22 10:16:17.932923 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 28/63] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:16:17 2022] GET /compute/v2.1/servers/5828c9dc-3439-4da7-a94c-f81cbbfdcb99 => generated 1365 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:16:18.066296 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-d7e8a5b5-8858-45fd-9e4f-7fad02e780c2 tempest-DeleteServersTestJSON-502292925 tempest-DeleteServersTestJSON-502292925-project] Calling method '>' {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:16:18.066916 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.compute.api [None req-d7e8a5b5-8858-45fd-9e4f-7fad02e780c2 tempest-DeleteServersTestJSON-502292925 tempest-DeleteServersTestJSON-502292925-project] [instance: 8b3f01d1-ac00-4bfb-8ae3-be75720b8ad1] Fetching instance by UUID {{(pid=117873) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:16:18.087083 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-d7e8a5b5-8858-45fd-9e4f-7fad02e780c2 tempest-DeleteServersTestJSON-502292925 tempest-DeleteServersTestJSON-502292925-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:16:18.087753 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-d7e8a5b5-8858-45fd-9e4f-7fad02e780c2 tempest-DeleteServersTestJSON-502292925 tempest-DeleteServersTestJSON-502292925-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:16:18.088689 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-d7e8a5b5-8858-45fd-9e4f-7fad02e780c2 tempest-DeleteServersTestJSON-502292925 tempest-DeleteServersTestJSON-502292925-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:16:18.089260 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-d7e8a5b5-8858-45fd-9e4f-7fad02e780c2 tempest-DeleteServersTestJSON-502292925 tempest-DeleteServersTestJSON-502292925-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:16:18.380100 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.policy [None req-6c2f44ca-ae7b-409d-a370-3d58d3b4d7f7 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75753b29a78640df9622d4e2655baf9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee9d603d9cc4a8797f55d544f189720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117874) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:16:18.393416 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.policy [None req-6c2f44ca-ae7b-409d-a370-3d58d3b4d7f7 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75753b29a78640df9622d4e2655baf9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee9d603d9cc4a8797f55d544f189720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117874) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:16:18.396661 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.policy [None req-6c2f44ca-ae7b-409d-a370-3d58d3b4d7f7 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75753b29a78640df9622d4e2655baf9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee9d603d9cc4a8797f55d544f189720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117874) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:16:18.397857 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [None req-6c2f44ca-ae7b-409d-a370-3d58d3b4d7f7 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] 10.222.0.43 "GET /compute/v2.1/servers/73dbd5ab-5688-4de4-9da2-0b89d7cefb11" status: 200 len: 1407 microversion: 2.20 time: 0.623959 Jun 22 10:16:18.402305 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 36/64] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jun 22 10:16:17 2022] GET /compute/v2.1/servers/73dbd5ab-5688-4de4-9da2-0b89d7cefb11 => generated 1407 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 10:16:18.416504 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-321e6c9d-b546-4c08-918d-71a95fbb866e tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Calling method '>' {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:16:18.417607 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.compute.api [None req-321e6c9d-b546-4c08-918d-71a95fbb866e tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] [instance: 9f07e4bb-f4e9-428e-8feb-db50b3ff2109] Fetching instance by UUID {{(pid=117874) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:16:18.436050 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-321e6c9d-b546-4c08-918d-71a95fbb866e tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:16:18.438068 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-321e6c9d-b546-4c08-918d-71a95fbb866e tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:16:18.440091 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-321e6c9d-b546-4c08-918d-71a95fbb866e tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:16:18.441274 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-321e6c9d-b546-4c08-918d-71a95fbb866e tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:16:18.660903 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.policy [None req-321e6c9d-b546-4c08-918d-71a95fbb866e tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d7292401816437fba46d073c4746e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3277b9cbc4b4a8bbacee8440cea1ed2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117874) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:16:18.671396 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [None req-321e6c9d-b546-4c08-918d-71a95fbb866e tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] 10.222.0.43 "GET /compute/v2.1/servers/9f07e4bb-f4e9-428e-8feb-db50b3ff2109" status: 200 len: 1279 microversion: 2.1 time: 0.266085 Jun 22 10:16:18.671989 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 37/65] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:16:18 2022] GET /compute/v2.1/servers/9f07e4bb-f4e9-428e-8feb-db50b3ff2109 => generated 1279 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:16:18.756122 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.policy [None req-d7e8a5b5-8858-45fd-9e4f-7fad02e780c2 tempest-DeleteServersTestJSON-502292925 tempest-DeleteServersTestJSON-502292925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3af9bfaaaa4dcca0747f776115c826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4765b82e21647a9b391a98f446a0e17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117873) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:16:18.791546 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [None req-d7e8a5b5-8858-45fd-9e4f-7fad02e780c2 tempest-DeleteServersTestJSON-502292925 tempest-DeleteServersTestJSON-502292925-project] 10.222.0.43 "GET /compute/v2.1/servers/8b3f01d1-ac00-4bfb-8ae3-be75720b8ad1" status: 200 len: 1314 microversion: 2.1 time: 0.729522 Jun 22 10:16:18.792930 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 29/66] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:16:18 2022] GET /compute/v2.1/servers/8b3f01d1-ac00-4bfb-8ae3-be75720b8ad1 => generated 1314 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:16:18.959324 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-a43a123a-73c3-42b2-8ffd-6f8a6a01889d tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Calling method '>' {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:16:18.959954 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.compute.api [None req-a43a123a-73c3-42b2-8ffd-6f8a6a01889d tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] [instance: 5828c9dc-3439-4da7-a94c-f81cbbfdcb99] Fetching instance by UUID {{(pid=117874) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:16:18.975884 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-a43a123a-73c3-42b2-8ffd-6f8a6a01889d tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:16:18.976339 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-a43a123a-73c3-42b2-8ffd-6f8a6a01889d tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:16:18.977153 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-a43a123a-73c3-42b2-8ffd-6f8a6a01889d tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:16:18.978265 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-a43a123a-73c3-42b2-8ffd-6f8a6a01889d tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:16:19.420308 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-4e3b606d-97f4-4734-910c-035ab5eec6f6 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Calling method '>' {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:16:19.421325 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.compute.api [None req-4e3b606d-97f4-4734-910c-035ab5eec6f6 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] [instance: 73dbd5ab-5688-4de4-9da2-0b89d7cefb11] Fetching instance by UUID {{(pid=117873) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:16:19.434104 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.policy [None req-a43a123a-73c3-42b2-8ffd-6f8a6a01889d tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7be3d844dcee4d19966fc7944463a0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78629282e2b74418a2c1cdac32576ef1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117874) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:16:19.436612 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG dbcounter [-] [117874] Writing DB stats nova_cell0:SELECT=22 {{(pid=117874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:16:19.443862 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [None req-a43a123a-73c3-42b2-8ffd-6f8a6a01889d tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] 10.222.0.43 "GET /compute/v2.1/servers/5828c9dc-3439-4da7-a94c-f81cbbfdcb99" status: 200 len: 1365 microversion: 2.1 time: 0.495694 Jun 22 10:16:19.449581 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 38/67] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:16:18 2022] GET /compute/v2.1/servers/5828c9dc-3439-4da7-a94c-f81cbbfdcb99 => generated 1365 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:16:19.457602 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-4e3b606d-97f4-4734-910c-035ab5eec6f6 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:16:19.458086 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-4e3b606d-97f4-4734-910c-035ab5eec6f6 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:16:19.459103 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-4e3b606d-97f4-4734-910c-035ab5eec6f6 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:16:19.459534 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-4e3b606d-97f4-4734-910c-035ab5eec6f6 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:16:19.688532 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-48b60b13-a87b-459d-a4c9-f5abc6b63976 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Calling method '>' {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:16:19.690008 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.compute.api [None req-48b60b13-a87b-459d-a4c9-f5abc6b63976 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] [instance: 9f07e4bb-f4e9-428e-8feb-db50b3ff2109] Fetching instance by UUID {{(pid=117874) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:16:19.701137 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-48b60b13-a87b-459d-a4c9-f5abc6b63976 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:16:19.702107 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-48b60b13-a87b-459d-a4c9-f5abc6b63976 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:16:19.706699 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-48b60b13-a87b-459d-a4c9-f5abc6b63976 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:16:19.708271 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-48b60b13-a87b-459d-a4c9-f5abc6b63976 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:16:19.713713 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG dbcounter [-] [117874] Writing DB stats nova_cell1:SELECT=100 {{(pid=117874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:16:19.760639 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.policy [None req-4e3b606d-97f4-4734-910c-035ab5eec6f6 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75753b29a78640df9622d4e2655baf9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee9d603d9cc4a8797f55d544f189720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117873) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:16:19.769862 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.policy [None req-4e3b606d-97f4-4734-910c-035ab5eec6f6 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75753b29a78640df9622d4e2655baf9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee9d603d9cc4a8797f55d544f189720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117873) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:16:19.772313 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.policy [None req-4e3b606d-97f4-4734-910c-035ab5eec6f6 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75753b29a78640df9622d4e2655baf9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee9d603d9cc4a8797f55d544f189720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117873) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:16:19.773909 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [None req-4e3b606d-97f4-4734-910c-035ab5eec6f6 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] 10.222.0.43 "GET /compute/v2.1/servers/73dbd5ab-5688-4de4-9da2-0b89d7cefb11" status: 200 len: 1407 microversion: 2.20 time: 0.357857 Jun 22 10:16:19.785643 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 30/68] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jun 22 10:16:19 2022] GET /compute/v2.1/servers/73dbd5ab-5688-4de4-9da2-0b89d7cefb11 => generated 1407 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 10:16:19.812541 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-f816a7f8-6b0c-4373-bf86-3e2d20fea082 tempest-DeleteServersTestJSON-502292925 tempest-DeleteServersTestJSON-502292925-project] Calling method '>' {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:16:19.813483 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.compute.api [None req-f816a7f8-6b0c-4373-bf86-3e2d20fea082 tempest-DeleteServersTestJSON-502292925 tempest-DeleteServersTestJSON-502292925-project] [instance: 8b3f01d1-ac00-4bfb-8ae3-be75720b8ad1] Fetching instance by UUID {{(pid=117873) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:16:19.828250 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-f816a7f8-6b0c-4373-bf86-3e2d20fea082 tempest-DeleteServersTestJSON-502292925 tempest-DeleteServersTestJSON-502292925-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:16:19.828715 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-f816a7f8-6b0c-4373-bf86-3e2d20fea082 tempest-DeleteServersTestJSON-502292925 tempest-DeleteServersTestJSON-502292925-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:16:19.832278 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-f816a7f8-6b0c-4373-bf86-3e2d20fea082 tempest-DeleteServersTestJSON-502292925 tempest-DeleteServersTestJSON-502292925-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:16:19.832732 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-f816a7f8-6b0c-4373-bf86-3e2d20fea082 tempest-DeleteServersTestJSON-502292925 tempest-DeleteServersTestJSON-502292925-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:16:19.865939 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.policy [None req-48b60b13-a87b-459d-a4c9-f5abc6b63976 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d7292401816437fba46d073c4746e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3277b9cbc4b4a8bbacee8440cea1ed2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117874) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:16:19.876799 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [None req-48b60b13-a87b-459d-a4c9-f5abc6b63976 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] 10.222.0.43 "GET /compute/v2.1/servers/9f07e4bb-f4e9-428e-8feb-db50b3ff2109" status: 200 len: 1279 microversion: 2.1 time: 0.191855 Jun 22 10:16:19.878085 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 39/69] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:16:19 2022] GET /compute/v2.1/servers/9f07e4bb-f4e9-428e-8feb-db50b3ff2109 => generated 1279 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 10:16:20.110391 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-4504c83b-3272-481e-b95f-a041de825191 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1776247393", "imageRef": "22d2c064-5bf7-438e-bbb7-47259e4bdab5", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "f4e78d1e-cabc-488a-aae3-f9e986faebb4"}], "security_groups": [{"name": "tempest-securitygroup--890828823"}], "key_name": "tempest-keypair-1521054167", "user_data": "}} {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:16:20.117495 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.policy [None req-f816a7f8-6b0c-4373-bf86-3e2d20fea082 tempest-DeleteServersTestJSON-502292925 tempest-DeleteServersTestJSON-502292925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3af9bfaaaa4dcca0747f776115c826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4765b82e21647a9b391a98f446a0e17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117873) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:16:20.120595 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG dbcounter [-] [117873] Writing DB stats nova_cell1:SELECT=61 {{(pid=117873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:16:20.134500 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [None req-f816a7f8-6b0c-4373-bf86-3e2d20fea082 tempest-DeleteServersTestJSON-502292925 tempest-DeleteServersTestJSON-502292925-project] 10.222.0.43 "GET /compute/v2.1/servers/8b3f01d1-ac00-4bfb-8ae3-be75720b8ad1" status: 200 len: 1314 microversion: 2.1 time: 0.329690 Jun 22 10:16:20.135394 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 31/70] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:16:19 2022] GET /compute/v2.1/servers/8b3f01d1-ac00-4bfb-8ae3-be75720b8ad1 => generated 1314 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:16:20.268202 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.network.neutron [None req-4504c83b-3272-481e-b95f-a041de825191 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] validate_networks() for [('f4e78d1e-cabc-488a-aae3-f9e986faebb4', None, None, None, None, None)] {{(pid=117874) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 22 10:16:20.460613 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-0381c5fa-863e-4f0b-ae6e-f840b5b619d5 tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Calling method '>' {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:16:20.461222 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.compute.api [None req-0381c5fa-863e-4f0b-ae6e-f840b5b619d5 tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] [instance: 5828c9dc-3439-4da7-a94c-f81cbbfdcb99] Fetching instance by UUID {{(pid=117873) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:16:20.464460 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG dbcounter [-] [117873] Writing DB stats nova_api:SELECT=85,nova_api:INSERT=12 {{(pid=117873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:16:20.473104 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-0381c5fa-863e-4f0b-ae6e-f840b5b619d5 tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:16:20.473541 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-0381c5fa-863e-4f0b-ae6e-f840b5b619d5 tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:16:20.479040 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-0381c5fa-863e-4f0b-ae6e-f840b5b619d5 tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:16:20.481049 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-0381c5fa-863e-4f0b-ae6e-f840b5b619d5 tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:16:20.858838 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.policy [None req-0381c5fa-863e-4f0b-ae6e-f840b5b619d5 tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7be3d844dcee4d19966fc7944463a0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78629282e2b74418a2c1cdac32576ef1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117873) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:16:20.869518 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [None req-0381c5fa-863e-4f0b-ae6e-f840b5b619d5 tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] 10.222.0.43 "GET /compute/v2.1/servers/5828c9dc-3439-4da7-a94c-f81cbbfdcb99" status: 200 len: 1365 microversion: 2.1 time: 0.412068 Jun 22 10:16:20.880499 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 32/71] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:16:20 2022] GET /compute/v2.1/servers/5828c9dc-3439-4da7-a94c-f81cbbfdcb99 => generated 1365 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 10:16:20.891790 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-c565a221-f2c1-4260-833e-8c33aea22615 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Calling method '>' {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:16:20.894360 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.compute.api [None req-c565a221-f2c1-4260-833e-8c33aea22615 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] [instance: 73dbd5ab-5688-4de4-9da2-0b89d7cefb11] Fetching instance by UUID {{(pid=117873) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:16:20.912069 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-c565a221-f2c1-4260-833e-8c33aea22615 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:16:20.912730 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-c565a221-f2c1-4260-833e-8c33aea22615 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:16:20.920581 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-c565a221-f2c1-4260-833e-8c33aea22615 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:16:20.921336 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-c565a221-f2c1-4260-833e-8c33aea22615 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:16:21.069408 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.virt.hardware [None req-4504c83b-3272-481e-b95f-a041de825191 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Flavor limits 0:0:0 {{(pid=117874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 22 10:16:21.069948 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.virt.hardware [None req-4504c83b-3272-481e-b95f-a041de825191 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Image limits 0:0:0 {{(pid=117874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 22 10:16:21.070356 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.virt.hardware [None req-4504c83b-3272-481e-b95f-a041de825191 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Flavor pref 0:0:0 {{(pid=117874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 22 10:16:21.070769 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.virt.hardware [None req-4504c83b-3272-481e-b95f-a041de825191 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Image pref 0:0:0 {{(pid=117874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 22 10:16:21.071177 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.virt.hardware [None req-4504c83b-3272-481e-b95f-a041de825191 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 22 10:16:21.115424 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-4504c83b-3272-481e-b95f-a041de825191 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:16:21.115874 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-4504c83b-3272-481e-b95f-a041de825191 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:16:21.116680 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-4504c83b-3272-481e-b95f-a041de825191 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:16:21.117119 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-4504c83b-3272-481e-b95f-a041de825191 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:16:21.203527 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.quota [None req-4504c83b-3272-481e-b95f-a041de825191 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Getting quotas for project ad52333bcbec425089c44c3e55df97ff. Resources: {'instances', 'cores', 'ram'} {{(pid=117874) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 22 10:16:21.214952 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.quota [None req-4504c83b-3272-481e-b95f-a041de825191 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Getting quotas for user 78fe3fc4334c43d7a5ef6d70f9f57523 and project ad52333bcbec425089c44c3e55df97ff. Resources: {'instances', 'cores', 'ram'} {{(pid=117874) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 22 10:16:21.247446 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.compute.api [None req-4504c83b-3272-481e-b95f-a041de825191 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Going to run 1 instances... {{(pid=117874) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 22 10:16:21.255077 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.compute.api [None req-4504c83b-3272-481e-b95f-a041de825191 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] [instance: eb851ab6-0e89-41d2-be52-d76cdc8644d6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='22d2c064-5bf7-438e-bbb7-47259e4bdab5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117874) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 22 10:16:21.423107 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [None req-4504c83b-3272-481e-b95f-a041de825191 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.311075 Jun 22 10:16:21.429235 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 40/72] 10.222.0.43 () {60 vars in 1146 bytes} [Wed Jun 22 10:16:20 2022] POST /compute/v2.1/servers => generated 401 bytes in 1327 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 22 10:16:21.434440 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-f79451cd-7f27-4497-b173-16eafa877bcc tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Calling method '>' {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:16:21.464050 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.compute.api [None req-f79451cd-7f27-4497-b173-16eafa877bcc tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] [instance: 9f07e4bb-f4e9-428e-8feb-db50b3ff2109] Fetching instance by UUID {{(pid=117874) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:16:21.488927 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-f79451cd-7f27-4497-b173-16eafa877bcc tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:16:21.490820 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-f79451cd-7f27-4497-b173-16eafa877bcc tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:16:21.492998 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-f79451cd-7f27-4497-b173-16eafa877bcc tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:16:21.494235 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-f79451cd-7f27-4497-b173-16eafa877bcc tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:16:21.514408 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.policy [None req-c565a221-f2c1-4260-833e-8c33aea22615 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75753b29a78640df9622d4e2655baf9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee9d603d9cc4a8797f55d544f189720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117873) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:16:21.544746 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.policy [None req-c565a221-f2c1-4260-833e-8c33aea22615 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75753b29a78640df9622d4e2655baf9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee9d603d9cc4a8797f55d544f189720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117873) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:16:21.550633 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.policy [None req-c565a221-f2c1-4260-833e-8c33aea22615 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75753b29a78640df9622d4e2655baf9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee9d603d9cc4a8797f55d544f189720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117873) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:16:21.554933 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [None req-c565a221-f2c1-4260-833e-8c33aea22615 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] 10.222.0.43 "GET /compute/v2.1/servers/73dbd5ab-5688-4de4-9da2-0b89d7cefb11" status: 200 len: 1407 microversion: 2.20 time: 0.673146 Jun 22 10:16:21.568767 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 33/73] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jun 22 10:16:20 2022] GET /compute/v2.1/servers/73dbd5ab-5688-4de4-9da2-0b89d7cefb11 => generated 1407 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 10:16:21.570662 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-3b3b2ad6-9ebb-4718-bd1f-2f3fd8007ac1 tempest-DeleteServersTestJSON-502292925 tempest-DeleteServersTestJSON-502292925-project] Calling method '>' {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:16:21.572095 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.compute.api [None req-3b3b2ad6-9ebb-4718-bd1f-2f3fd8007ac1 tempest-DeleteServersTestJSON-502292925 tempest-DeleteServersTestJSON-502292925-project] [instance: 8b3f01d1-ac00-4bfb-8ae3-be75720b8ad1] Fetching instance by UUID {{(pid=117873) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:16:21.588365 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-3b3b2ad6-9ebb-4718-bd1f-2f3fd8007ac1 tempest-DeleteServersTestJSON-502292925 tempest-DeleteServersTestJSON-502292925-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:16:21.589342 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-3b3b2ad6-9ebb-4718-bd1f-2f3fd8007ac1 tempest-DeleteServersTestJSON-502292925 tempest-DeleteServersTestJSON-502292925-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:16:21.590605 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-3b3b2ad6-9ebb-4718-bd1f-2f3fd8007ac1 tempest-DeleteServersTestJSON-502292925 tempest-DeleteServersTestJSON-502292925-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:16:21.591377 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-3b3b2ad6-9ebb-4718-bd1f-2f3fd8007ac1 tempest-DeleteServersTestJSON-502292925 tempest-DeleteServersTestJSON-502292925-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:16:21.867475 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.policy [None req-f79451cd-7f27-4497-b173-16eafa877bcc tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d7292401816437fba46d073c4746e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3277b9cbc4b4a8bbacee8440cea1ed2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117874) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:16:21.880099 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [None req-f79451cd-7f27-4497-b173-16eafa877bcc tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] 10.222.0.43 "GET /compute/v2.1/servers/9f07e4bb-f4e9-428e-8feb-db50b3ff2109" status: 200 len: 1279 microversion: 2.1 time: 0.449501 Jun 22 10:16:21.889408 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 41/74] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:16:21 2022] GET /compute/v2.1/servers/9f07e4bb-f4e9-428e-8feb-db50b3ff2109 => generated 1279 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:16:21.899449 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-7facaeab-23f9-443b-9735-c9e605d21105 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Calling method '>' {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:16:21.900097 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.compute.api [None req-7facaeab-23f9-443b-9735-c9e605d21105 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] [instance: eb851ab6-0e89-41d2-be52-d76cdc8644d6] Fetching instance by UUID {{(pid=117874) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:16:22.224848 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.policy [None req-7facaeab-23f9-443b-9735-c9e605d21105 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78fe3fc4334c43d7a5ef6d70f9f57523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad52333bcbec425089c44c3e55df97ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117874) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:16:22.269258 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [None req-7facaeab-23f9-443b-9735-c9e605d21105 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] 10.222.0.43 "GET /compute/v2.1/servers/eb851ab6-0e89-41d2-be52-d76cdc8644d6" status: 200 len: 1238 microversion: 2.1 time: 0.375795 Jun 22 10:16:22.285153 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 42/75] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:16:21 2022] GET /compute/v2.1/servers/eb851ab6-0e89-41d2-be52-d76cdc8644d6 => generated 1238 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:16:22.292726 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [req-50888aec-c1d9-49cf-a541-a7555f51fee3 req-27b4f49b-91e5-40f7-b85b-bb5c41ba1445 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a8d495ae-295a-4ffa-a2d9-5774249e687d", "tag": "fae1b3df-59c5-40aa-9acc-2d668ec3c54d"}]} {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:16:22.309676 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [req-50888aec-c1d9-49cf-a541-a7555f51fee3 req-27b4f49b-91e5-40f7-b85b-bb5c41ba1445 service nova] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:16:22.310581 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [req-50888aec-c1d9-49cf-a541-a7555f51fee3 req-27b4f49b-91e5-40f7-b85b-bb5c41ba1445 service nova] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:16:22.339908 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.compute.server_external_events [req-50888aec-c1d9-49cf-a541-a7555f51fee3 req-27b4f49b-91e5-40f7-b85b-bb5c41ba1445 service nova] Creating event network-changed:fae1b3df-59c5-40aa-9acc-2d668ec3c54d for instance a8d495ae-295a-4ffa-a2d9-5774249e687d on hv-cinder-84713 Jun 22 10:16:22.352928 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [req-50888aec-c1d9-49cf-a541-a7555f51fee3 req-27b4f49b-91e5-40f7-b85b-bb5c41ba1445 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065891 Jun 22 10:16:22.353860 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 43/76] 10.222.0.43 () {64 vars in 1317 bytes} [Wed Jun 22 10:16:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 10:16:22.362707 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-69c03e04-3d18-40cb-b070-7b571af722c3 tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Calling method '>' {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:16:22.365791 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.compute.api [None req-69c03e04-3d18-40cb-b070-7b571af722c3 tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] [instance: 5828c9dc-3439-4da7-a94c-f81cbbfdcb99] Fetching instance by UUID {{(pid=117874) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:16:22.375424 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-69c03e04-3d18-40cb-b070-7b571af722c3 tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:16:22.376975 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-69c03e04-3d18-40cb-b070-7b571af722c3 tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:16:22.378085 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-69c03e04-3d18-40cb-b070-7b571af722c3 tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:16:22.378938 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-69c03e04-3d18-40cb-b070-7b571af722c3 tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:16:22.574341 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.policy [None req-3b3b2ad6-9ebb-4718-bd1f-2f3fd8007ac1 tempest-DeleteServersTestJSON-502292925 tempest-DeleteServersTestJSON-502292925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3af9bfaaaa4dcca0747f776115c826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4765b82e21647a9b391a98f446a0e17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117873) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:16:22.587228 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [None req-3b3b2ad6-9ebb-4718-bd1f-2f3fd8007ac1 tempest-DeleteServersTestJSON-502292925 tempest-DeleteServersTestJSON-502292925-project] 10.222.0.43 "GET /compute/v2.1/servers/8b3f01d1-ac00-4bfb-8ae3-be75720b8ad1" status: 200 len: 1314 microversion: 2.1 time: 1.026851 Jun 22 10:16:22.588077 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 34/77] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:16:21 2022] GET /compute/v2.1/servers/8b3f01d1-ac00-4bfb-8ae3-be75720b8ad1 => generated 1314 bytes in 1028 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:16:22.592932 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-e13c1edf-b73b-4c9b-8944-22d20031f7b1 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Calling method '>' {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:16:22.593533 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.compute.api [None req-e13c1edf-b73b-4c9b-8944-22d20031f7b1 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] [instance: 73dbd5ab-5688-4de4-9da2-0b89d7cefb11] Fetching instance by UUID {{(pid=117873) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:16:22.600318 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-e13c1edf-b73b-4c9b-8944-22d20031f7b1 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:16:22.600769 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-e13c1edf-b73b-4c9b-8944-22d20031f7b1 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:16:22.601531 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-e13c1edf-b73b-4c9b-8944-22d20031f7b1 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:16:22.601990 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-e13c1edf-b73b-4c9b-8944-22d20031f7b1 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:16:22.791760 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.policy [None req-69c03e04-3d18-40cb-b070-7b571af722c3 tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7be3d844dcee4d19966fc7944463a0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78629282e2b74418a2c1cdac32576ef1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117874) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:16:22.843101 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [None req-69c03e04-3d18-40cb-b070-7b571af722c3 tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] 10.222.0.43 "GET /compute/v2.1/servers/5828c9dc-3439-4da7-a94c-f81cbbfdcb99" status: 200 len: 1365 microversion: 2.1 time: 0.485788 Jun 22 10:16:22.844656 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 44/78] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:16:22 2022] GET /compute/v2.1/servers/5828c9dc-3439-4da7-a94c-f81cbbfdcb99 => generated 1365 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:16:22.901100 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.policy [None req-e13c1edf-b73b-4c9b-8944-22d20031f7b1 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75753b29a78640df9622d4e2655baf9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee9d603d9cc4a8797f55d544f189720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117873) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:16:22.905818 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-c5c3643f-ad58-470b-a5f6-e4f2fe56a7a1 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Calling method '>' {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:16:22.906838 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.compute.api [None req-c5c3643f-ad58-470b-a5f6-e4f2fe56a7a1 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] [instance: 9f07e4bb-f4e9-428e-8feb-db50b3ff2109] Fetching instance by UUID {{(pid=117874) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:16:22.911283 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.policy [None req-e13c1edf-b73b-4c9b-8944-22d20031f7b1 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75753b29a78640df9622d4e2655baf9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee9d603d9cc4a8797f55d544f189720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117873) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:16:22.912812 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.policy [None req-e13c1edf-b73b-4c9b-8944-22d20031f7b1 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75753b29a78640df9622d4e2655baf9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee9d603d9cc4a8797f55d544f189720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117873) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:16:22.926126 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [None req-e13c1edf-b73b-4c9b-8944-22d20031f7b1 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] 10.222.0.43 "GET /compute/v2.1/servers/73dbd5ab-5688-4de4-9da2-0b89d7cefb11" status: 200 len: 1407 microversion: 2.20 time: 0.324744 Jun 22 10:16:22.926778 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 35/79] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jun 22 10:16:22 2022] GET /compute/v2.1/servers/73dbd5ab-5688-4de4-9da2-0b89d7cefb11 => generated 1407 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 10:16:22.951403 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-c5c3643f-ad58-470b-a5f6-e4f2fe56a7a1 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:16:22.953374 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-c5c3643f-ad58-470b-a5f6-e4f2fe56a7a1 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:16:22.956468 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-c5c3643f-ad58-470b-a5f6-e4f2fe56a7a1 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:16:22.957261 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-c5c3643f-ad58-470b-a5f6-e4f2fe56a7a1 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:16:23.293958 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-6f63419e-6fd1-4306-bb68-96e137eb2989 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Calling method '>' {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:16:23.295944 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.compute.api [None req-6f63419e-6fd1-4306-bb68-96e137eb2989 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] [instance: eb851ab6-0e89-41d2-be52-d76cdc8644d6] Fetching instance by UUID {{(pid=117873) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:16:23.319103 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-6f63419e-6fd1-4306-bb68-96e137eb2989 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:16:23.319764 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-6f63419e-6fd1-4306-bb68-96e137eb2989 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:16:23.324968 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-6f63419e-6fd1-4306-bb68-96e137eb2989 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:16:23.325624 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-6f63419e-6fd1-4306-bb68-96e137eb2989 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:16:23.459145 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.policy [None req-6f63419e-6fd1-4306-bb68-96e137eb2989 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78fe3fc4334c43d7a5ef6d70f9f57523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad52333bcbec425089c44c3e55df97ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117873) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:16:23.468768 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [None req-6f63419e-6fd1-4306-bb68-96e137eb2989 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] 10.222.0.43 "GET /compute/v2.1/servers/eb851ab6-0e89-41d2-be52-d76cdc8644d6" status: 200 len: 1296 microversion: 2.1 time: 0.180765 Jun 22 10:16:23.472119 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 36/80] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:16:23 2022] GET /compute/v2.1/servers/eb851ab6-0e89-41d2-be52-d76cdc8644d6 => generated 1296 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:16:23.511555 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.policy [None req-c5c3643f-ad58-470b-a5f6-e4f2fe56a7a1 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d7292401816437fba46d073c4746e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3277b9cbc4b4a8bbacee8440cea1ed2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117874) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:16:23.523425 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [None req-c5c3643f-ad58-470b-a5f6-e4f2fe56a7a1 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] 10.222.0.43 "GET /compute/v2.1/servers/9f07e4bb-f4e9-428e-8feb-db50b3ff2109" status: 200 len: 1321 microversion: 2.1 time: 0.625642 Jun 22 10:16:23.524403 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 45/81] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:16:22 2022] GET /compute/v2.1/servers/9f07e4bb-f4e9-428e-8feb-db50b3ff2109 => generated 1321 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:16:23.605574 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-db3caebf-1f6e-4668-9729-5849eaf424a6 tempest-DeleteServersTestJSON-502292925 tempest-DeleteServersTestJSON-502292925-project] Calling method '>' {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:16:23.606888 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.compute.api [None req-db3caebf-1f6e-4668-9729-5849eaf424a6 tempest-DeleteServersTestJSON-502292925 tempest-DeleteServersTestJSON-502292925-project] [instance: 8b3f01d1-ac00-4bfb-8ae3-be75720b8ad1] Fetching instance by UUID {{(pid=117873) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:16:23.626180 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-db3caebf-1f6e-4668-9729-5849eaf424a6 tempest-DeleteServersTestJSON-502292925 tempest-DeleteServersTestJSON-502292925-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:16:23.627688 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-db3caebf-1f6e-4668-9729-5849eaf424a6 tempest-DeleteServersTestJSON-502292925 tempest-DeleteServersTestJSON-502292925-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:16:23.628604 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-db3caebf-1f6e-4668-9729-5849eaf424a6 tempest-DeleteServersTestJSON-502292925 tempest-DeleteServersTestJSON-502292925-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:16:23.629137 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-db3caebf-1f6e-4668-9729-5849eaf424a6 tempest-DeleteServersTestJSON-502292925 tempest-DeleteServersTestJSON-502292925-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:16:23.871636 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-48a259f5-9ae8-46a7-8e14-0301aa0f35c7 tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Calling method '>' {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:16:23.874609 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.compute.api [None req-48a259f5-9ae8-46a7-8e14-0301aa0f35c7 tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] [instance: 5828c9dc-3439-4da7-a94c-f81cbbfdcb99] Fetching instance by UUID {{(pid=117874) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:16:23.888418 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-48a259f5-9ae8-46a7-8e14-0301aa0f35c7 tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:16:23.890209 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG dbcounter [-] [117873] Writing DB stats nova_cell0:SELECT=8 {{(pid=117873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:16:23.891217 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-48a259f5-9ae8-46a7-8e14-0301aa0f35c7 tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:16:23.892996 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-48a259f5-9ae8-46a7-8e14-0301aa0f35c7 tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:16:23.898387 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-48a259f5-9ae8-46a7-8e14-0301aa0f35c7 tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:16:24.199798 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.policy [None req-db3caebf-1f6e-4668-9729-5849eaf424a6 tempest-DeleteServersTestJSON-502292925 tempest-DeleteServersTestJSON-502292925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3af9bfaaaa4dcca0747f776115c826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4765b82e21647a9b391a98f446a0e17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117873) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:16:24.209139 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [None req-db3caebf-1f6e-4668-9729-5849eaf424a6 tempest-DeleteServersTestJSON-502292925 tempest-DeleteServersTestJSON-502292925-project] 10.222.0.43 "GET /compute/v2.1/servers/8b3f01d1-ac00-4bfb-8ae3-be75720b8ad1" status: 200 len: 1314 microversion: 2.1 time: 0.608517 Jun 22 10:16:24.209761 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 37/82] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:16:23 2022] GET /compute/v2.1/servers/8b3f01d1-ac00-4bfb-8ae3-be75720b8ad1 => generated 1314 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:16:24.227900 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-2c411837-e052-4190-a32d-1d5459dd5d0a tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Calling method '>' {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:16:24.228518 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.compute.api [None req-2c411837-e052-4190-a32d-1d5459dd5d0a tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] [instance: 73dbd5ab-5688-4de4-9da2-0b89d7cefb11] Fetching instance by UUID {{(pid=117873) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:16:24.263666 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-2c411837-e052-4190-a32d-1d5459dd5d0a tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:16:24.264118 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-2c411837-e052-4190-a32d-1d5459dd5d0a tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:16:24.264895 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-2c411837-e052-4190-a32d-1d5459dd5d0a tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:16:24.265329 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-2c411837-e052-4190-a32d-1d5459dd5d0a tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:16:24.417106 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.policy [None req-48a259f5-9ae8-46a7-8e14-0301aa0f35c7 tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7be3d844dcee4d19966fc7944463a0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78629282e2b74418a2c1cdac32576ef1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117874) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:16:24.425367 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [None req-48a259f5-9ae8-46a7-8e14-0301aa0f35c7 tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] 10.222.0.43 "GET /compute/v2.1/servers/5828c9dc-3439-4da7-a94c-f81cbbfdcb99" status: 200 len: 1365 microversion: 2.1 time: 0.566517 Jun 22 10:16:24.426200 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 46/83] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:16:23 2022] GET /compute/v2.1/servers/5828c9dc-3439-4da7-a94c-f81cbbfdcb99 => generated 1365 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:16:24.577727 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.policy [None req-2c411837-e052-4190-a32d-1d5459dd5d0a tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75753b29a78640df9622d4e2655baf9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee9d603d9cc4a8797f55d544f189720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117873) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:16:24.590896 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.policy [None req-2c411837-e052-4190-a32d-1d5459dd5d0a tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75753b29a78640df9622d4e2655baf9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee9d603d9cc4a8797f55d544f189720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117873) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:16:24.592510 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.policy [None req-2c411837-e052-4190-a32d-1d5459dd5d0a tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75753b29a78640df9622d4e2655baf9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee9d603d9cc4a8797f55d544f189720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117873) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:16:24.593944 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [None req-2c411837-e052-4190-a32d-1d5459dd5d0a tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] 10.222.0.43 "GET /compute/v2.1/servers/73dbd5ab-5688-4de4-9da2-0b89d7cefb11" status: 200 len: 1407 microversion: 2.20 time: 0.374832 Jun 22 10:16:24.594541 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 38/84] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jun 22 10:16:24 2022] GET /compute/v2.1/servers/73dbd5ab-5688-4de4-9da2-0b89d7cefb11 => generated 1407 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 10:16:24.641434 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [req-5ef421d0-10f4-4d55-a707-166b3c0fe382 req-bae5f562-7920-4ea1-9d90-65b4f875467e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8b3f01d1-ac00-4bfb-8ae3-be75720b8ad1", "name": "network-vif-plugged", "status": "completed", "tag": "bd80709c-555a-4184-b601-e49f7cd8bdc4"}]} {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:16:24.651901 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [req-5ef421d0-10f4-4d55-a707-166b3c0fe382 req-bae5f562-7920-4ea1-9d90-65b4f875467e service nova] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:16:24.652341 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [req-5ef421d0-10f4-4d55-a707-166b3c0fe382 req-bae5f562-7920-4ea1-9d90-65b4f875467e service nova] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:16:24.665730 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.compute.server_external_events [req-5ef421d0-10f4-4d55-a707-166b3c0fe382 req-bae5f562-7920-4ea1-9d90-65b4f875467e service nova] Creating event network-vif-plugged:bd80709c-555a-4184-b601-e49f7cd8bdc4 for instance 8b3f01d1-ac00-4bfb-8ae3-be75720b8ad1 on hv-cinder-84713 Jun 22 10:16:24.671237 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [req-5ef421d0-10f4-4d55-a707-166b3c0fe382 req-bae5f562-7920-4ea1-9d90-65b4f875467e service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.243714 Jun 22 10:16:24.672238 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 47/85] 10.222.0.43 () {64 vars in 1317 bytes} [Wed Jun 22 10:16:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 10:16:24.679124 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-a726a798-822d-49db-8629-f12bffa10b49 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Calling method '>' {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:16:24.679833 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.compute.api [None req-a726a798-822d-49db-8629-f12bffa10b49 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] [instance: eb851ab6-0e89-41d2-be52-d76cdc8644d6] Fetching instance by UUID {{(pid=117874) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:16:24.687466 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-a726a798-822d-49db-8629-f12bffa10b49 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:16:24.688449 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-a726a798-822d-49db-8629-f12bffa10b49 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:16:24.689736 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-a726a798-822d-49db-8629-f12bffa10b49 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:16:24.690481 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-a726a798-822d-49db-8629-f12bffa10b49 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:16:24.709339 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-8fe25d24-9b7f-4d20-90ab-7a6304b69136 tempest-VolumesNegativeTest-165361948 tempest-VolumesNegativeTest-165361948-project] Action: 'create', calling method: .version_select at 0x7f36bf12c1f0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-682122916", "metadata": {"Type": "work"}}} {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:16:24.727388 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-8fe25d24-9b7f-4d20-90ab-7a6304b69136 tempest-VolumesNegativeTest-165361948 tempest-VolumesNegativeTest-165361948-project] Request method failure captured: Jun 22 10:16:24.727388 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jun 22 10:16:24.727388 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: Accept: application/json Jun 22 10:16:24.727388 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: Accept-Encoding: identity Jun 22 10:16:24.727388 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: Connection: close Jun 22 10:16:24.727388 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: Content-Length: 121 Jun 22 10:16:24.727388 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: Content-Type: application/json Jun 22 10:16:24.727388 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: Host: 10.222.0.43 Jun 22 10:16:24.727388 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: Openstack-System-Scope: None Jun 22 10:16:24.727388 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: User-Agent: python-urllib3/1.26.9 Jun 22 10:16:24.727388 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-Auth-Token: gAAAAABisuv4XBHu3wXWxB58YcqTRADkQ535PQWHWrnHdZ6AS2mdfj3WIju9f02qkJrf_3JA4vb2HVKPdHf8z_vjqvFkTa7Dw8S80kvwPSv-e1dvSMf-sSddBQ2CobGo4mGQqpjFVfCRHuiaLkn-LwggDpoGnY3QXdgVHF31dLQpKcDCvXMC3bU Jun 22 10:16:24.727388 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-Domain-Id: None Jun 22 10:16:24.727388 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-Domain-Name: None Jun 22 10:16:24.727388 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-Identity-Status: Confirmed Jun 22 10:16:24.727388 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-Is-Admin-Project: True Jun 22 10:16:24.727388 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-Project-Domain-Id: default Jun 22 10:16:24.727388 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-Project-Domain-Name: Default Jun 22 10:16:24.727388 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-Project-Id: 1f86edb1750441af89ecefc44ac2dba2 Jun 22 10:16:24.727388 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-Project-Name: tempest-VolumesNegativeTest-165361948 Jun 22 10:16:24.727388 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-Role: reader,member Jun 22 10:16:24.727388 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-Roles: reader,member Jun 22 10:16:24.728804 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/1f86edb1750441af89ecefc44ac2dba2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/1f86edb1750441af89ecefc44ac2dba2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_1f86edb1750441af89ecefc44ac2dba2", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/1f86edb1750441af89ecefc44ac2dba2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}] Jun 22 10:16:24.728804 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-Tenant: tempest-VolumesNegativeTest-165361948 Jun 22 10:16:24.728804 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-Tenant-Id: 1f86edb1750441af89ecefc44ac2dba2 Jun 22 10:16:24.728804 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-Tenant-Name: tempest-VolumesNegativeTest-165361948 Jun 22 10:16:24.728804 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-User: tempest-VolumesNegativeTest-165361948-project Jun 22 10:16:24.728804 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-User-Domain-Id: default Jun 22 10:16:24.728804 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-User-Domain-Name: Default Jun 22 10:16:24.728804 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-User-Id: ea52f49e642b4ad3aef61a93eea7fb04 Jun 22 10:16:24.728804 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-User-Name: tempest-VolumesNegativeTest-165361948-project Jun 22 10:16:24.728804 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: Jun 22 10:16:24.728804 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-682122916", "metadata": {"Type": "work"}}} Jun 22 10:16:24.728804 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: method: Jun 22 10:16:24.728804 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jun 22 10:16:24.729920 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-682122916', 'metadata': {'Type': 'work'}}}} Jun 22 10:16:24.729920 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 10:16:24.729920 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:16:24.729920 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 22 10:16:24.729920 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 22 10:16:24.729920 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 22 10:16:24.729920 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi raise error Jun 22 10:16:24.729920 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Jun 22 10:16:24.729920 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi Jun 22 10:16:24.729920 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jun 22 10:16:24.729920 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jun 22 10:16:24.729920 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi Jun 22 10:16:24.729920 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi On instance['volume']: Jun 22 10:16:24.729920 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi '#$%' Jun 22 10:16:24.729920 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi Jun 22 10:16:24.729920 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 10:16:24.729920 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi Jun 22 10:16:24.729920 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:16:24.729920 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 10:16:24.729920 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 10:16:24.729920 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 10:16:24.729920 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 10:16:24.731286 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 22 10:16:24.731286 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 22 10:16:24.731286 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 10:16:24.731286 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 10:16:24.731286 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 22 10:16:24.731286 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 22 10:16:24.731286 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 22 10:16:24.731286 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 22 10:16:24.731286 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 22 10:16:24.731286 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 22 10:16:24.731286 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jun 22 10:16:24.731286 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi Jun 22 10:16:24.731286 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 10:16:24.731286 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi Jun 22 10:16:24.731286 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:16:24.731286 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 10:16:24.731286 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 10:16:24.731286 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 22 10:16:24.731286 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 22 10:16:24.732313 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jun 22 10:16:24.732313 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi Jun 22 10:16:24.732313 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-8fe25d24-9b7f-4d20-90ab-7a6304b69136 tempest-VolumesNegativeTest-165361948 tempest-VolumesNegativeTest-165361948-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=117873) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 10:16:24.732313 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [None req-8fe25d24-9b7f-4d20-90ab-7a6304b69136 tempest-VolumesNegativeTest-165361948 tempest-VolumesNegativeTest-165361948-project] 10.222.0.43 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.132547 Jun 22 10:16:24.732313 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 39/86] 10.222.0.43 () {60 vars in 1155 bytes} [Wed Jun 22 10:16:24 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 134 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 22 10:16:24.734362 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-a4a6f895-9a2e-4d1d-a57d-992e248003fd tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Calling method '>' {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:16:24.736080 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.compute.api [None req-a4a6f895-9a2e-4d1d-a57d-992e248003fd tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] [instance: 9f07e4bb-f4e9-428e-8feb-db50b3ff2109] Fetching instance by UUID {{(pid=117873) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:16:24.745068 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-a4a6f895-9a2e-4d1d-a57d-992e248003fd tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:16:24.746123 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-a4a6f895-9a2e-4d1d-a57d-992e248003fd tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:16:24.747753 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-a4a6f895-9a2e-4d1d-a57d-992e248003fd tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:16:24.748476 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-a4a6f895-9a2e-4d1d-a57d-992e248003fd tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:16:24.782033 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.policy [None req-a726a798-822d-49db-8629-f12bffa10b49 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78fe3fc4334c43d7a5ef6d70f9f57523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad52333bcbec425089c44c3e55df97ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117874) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:16:24.792749 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [None req-a726a798-822d-49db-8629-f12bffa10b49 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] 10.222.0.43 "GET /compute/v2.1/servers/eb851ab6-0e89-41d2-be52-d76cdc8644d6" status: 200 len: 1296 microversion: 2.1 time: 0.119327 Jun 22 10:16:24.793434 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 48/87] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:16:24 2022] GET /compute/v2.1/servers/eb851ab6-0e89-41d2-be52-d76cdc8644d6 => generated 1296 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:16:24.808909 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [req-ae5febed-f213-4ede-8e62-a05d01a3deb6 req-93ff19fc-974f-4af7-a846-13fdf6cef170 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "73dbd5ab-5688-4de4-9da2-0b89d7cefb11", "tag": "468a7090-7d3f-43e5-8303-b6f8870ced56"}, {"name": "network-changed", "server_uuid": "9f07e4bb-f4e9-428e-8feb-db50b3ff2109", "tag": "211d6c80-be72-4645-8f0a-ec8e4b68c761"}]} {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:16:24.819464 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [req-ae5febed-f213-4ede-8e62-a05d01a3deb6 req-93ff19fc-974f-4af7-a846-13fdf6cef170 service nova] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:16:24.820013 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [req-ae5febed-f213-4ede-8e62-a05d01a3deb6 req-93ff19fc-974f-4af7-a846-13fdf6cef170 service nova] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:16:24.832886 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.compute.server_external_events [req-ae5febed-f213-4ede-8e62-a05d01a3deb6 req-93ff19fc-974f-4af7-a846-13fdf6cef170 service nova] Creating event network-changed:468a7090-7d3f-43e5-8303-b6f8870ced56 for instance 73dbd5ab-5688-4de4-9da2-0b89d7cefb11 on hv-cinder-84713 Jun 22 10:16:24.833387 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.compute.server_external_events [req-ae5febed-f213-4ede-8e62-a05d01a3deb6 req-93ff19fc-974f-4af7-a846-13fdf6cef170 service nova] Creating event network-changed:211d6c80-be72-4645-8f0a-ec8e4b68c761 for instance 9f07e4bb-f4e9-428e-8feb-db50b3ff2109 on hv-cinder-84713 Jun 22 10:16:24.840289 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [req-ae5febed-f213-4ede-8e62-a05d01a3deb6 req-93ff19fc-974f-4af7-a846-13fdf6cef170 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.034914 Jun 22 10:16:24.841275 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 49/88] 10.222.0.43 () {64 vars in 1317 bytes} [Wed Jun 22 10:16:24 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 10:16:24.847619 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-214a7b32-cd47-40cc-b564-34c8154624ae tempest-VolumesNegativeTest-165361948 tempest-VolumesNegativeTest-165361948-project] Action: 'create', calling method: .version_select at 0x7f36be8af940>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-241157898", "metadata": {"Type": "work"}}} {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:16:24.851103 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-214a7b32-cd47-40cc-b564-34c8154624ae tempest-VolumesNegativeTest-165361948 tempest-VolumesNegativeTest-165361948-project] Request method failure captured: Jun 22 10:16:24.851103 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jun 22 10:16:24.851103 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: Accept: application/json Jun 22 10:16:24.851103 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: Accept-Encoding: identity Jun 22 10:16:24.851103 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: Connection: close Jun 22 10:16:24.851103 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: Content-Length: 119 Jun 22 10:16:24.851103 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: Content-Type: application/json Jun 22 10:16:24.851103 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: Host: 10.222.0.43 Jun 22 10:16:24.851103 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: Openstack-System-Scope: None Jun 22 10:16:24.851103 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: User-Agent: python-urllib3/1.26.9 Jun 22 10:16:24.851103 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-Auth-Token: gAAAAABisuv4XBHu3wXWxB58YcqTRADkQ535PQWHWrnHdZ6AS2mdfj3WIju9f02qkJrf_3JA4vb2HVKPdHf8z_vjqvFkTa7Dw8S80kvwPSv-e1dvSMf-sSddBQ2CobGo4mGQqpjFVfCRHuiaLkn-LwggDpoGnY3QXdgVHF31dLQpKcDCvXMC3bU Jun 22 10:16:24.851103 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-Domain-Id: None Jun 22 10:16:24.851103 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-Domain-Name: None Jun 22 10:16:24.851103 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-Identity-Status: Confirmed Jun 22 10:16:24.851103 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-Is-Admin-Project: True Jun 22 10:16:24.851103 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-Project-Domain-Id: default Jun 22 10:16:24.851103 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-Project-Domain-Name: Default Jun 22 10:16:24.851103 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-Project-Id: 1f86edb1750441af89ecefc44ac2dba2 Jun 22 10:16:24.851103 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-Project-Name: tempest-VolumesNegativeTest-165361948 Jun 22 10:16:24.851103 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-Role: reader,member Jun 22 10:16:24.851103 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-Roles: reader,member Jun 22 10:16:24.852395 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/1f86edb1750441af89ecefc44ac2dba2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/1f86edb1750441af89ecefc44ac2dba2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_1f86edb1750441af89ecefc44ac2dba2", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/1f86edb1750441af89ecefc44ac2dba2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}] Jun 22 10:16:24.852395 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-Tenant: tempest-VolumesNegativeTest-165361948 Jun 22 10:16:24.852395 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-Tenant-Id: 1f86edb1750441af89ecefc44ac2dba2 Jun 22 10:16:24.852395 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-Tenant-Name: tempest-VolumesNegativeTest-165361948 Jun 22 10:16:24.852395 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-User: tempest-VolumesNegativeTest-165361948-project Jun 22 10:16:24.852395 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-User-Domain-Id: default Jun 22 10:16:24.852395 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-User-Domain-Name: Default Jun 22 10:16:24.852395 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-User-Id: ea52f49e642b4ad3aef61a93eea7fb04 Jun 22 10:16:24.852395 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-User-Name: tempest-VolumesNegativeTest-165361948-project Jun 22 10:16:24.852395 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: Jun 22 10:16:24.852395 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-241157898", "metadata": {"Type": "work"}}} Jun 22 10:16:24.852395 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: method: Jun 22 10:16:24.852395 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jun 22 10:16:24.853145 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-241157898', 'metadata': {'Type': 'work'}}}} Jun 22 10:16:24.853145 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 10:16:24.853145 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:16:24.853145 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 22 10:16:24.853145 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 22 10:16:24.853145 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 22 10:16:24.853145 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi raise error Jun 22 10:16:24.853145 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Jun 22 10:16:24.853145 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi Jun 22 10:16:24.853145 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Jun 22 10:16:24.853145 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jun 22 10:16:24.853145 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi Jun 22 10:16:24.853145 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi On instance['volume']: Jun 22 10:16:24.853145 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi '0' Jun 22 10:16:24.853145 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi Jun 22 10:16:24.853145 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 10:16:24.853145 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi Jun 22 10:16:24.853145 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:16:24.853145 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 10:16:24.853145 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 10:16:24.853145 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 10:16:24.853145 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 10:16:24.854715 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 22 10:16:24.854715 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 22 10:16:24.854715 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 10:16:24.854715 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 10:16:24.854715 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 22 10:16:24.854715 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 22 10:16:24.854715 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 22 10:16:24.854715 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 22 10:16:24.854715 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 22 10:16:24.854715 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 22 10:16:24.854715 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jun 22 10:16:24.854715 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi Jun 22 10:16:24.854715 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 10:16:24.854715 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi Jun 22 10:16:24.854715 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:16:24.854715 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 10:16:24.854715 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 10:16:24.854715 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 22 10:16:24.854715 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 22 10:16:24.855851 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jun 22 10:16:24.855851 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi Jun 22 10:16:24.856728 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-214a7b32-cd47-40cc-b564-34c8154624ae tempest-VolumesNegativeTest-165361948 tempest-VolumesNegativeTest-165361948-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=117874) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 10:16:24.857541 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [None req-214a7b32-cd47-40cc-b564-34c8154624ae tempest-VolumesNegativeTest-165361948 tempest-VolumesNegativeTest-165361948-project] 10.222.0.43 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.014917 Jun 22 10:16:24.858122 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 50/89] 10.222.0.43 () {60 vars in 1155 bytes} [Wed Jun 22 10:16:24 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 16 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 22 10:16:24.867700 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-d7bd63b2-9f15-4f24-8f28-7791b30ba009 tempest-VolumesNegativeTest-165361948 tempest-VolumesNegativeTest-165361948-project] Action: 'create', calling method: .version_select at 0x7f36bf9248b0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-548516386", "metadata": {"Type": "work"}}} {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:16:24.870009 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-d7bd63b2-9f15-4f24-8f28-7791b30ba009 tempest-VolumesNegativeTest-165361948 tempest-VolumesNegativeTest-165361948-project] Request method failure captured: Jun 22 10:16:24.870009 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jun 22 10:16:24.870009 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: Accept: application/json Jun 22 10:16:24.870009 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: Accept-Encoding: identity Jun 22 10:16:24.870009 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: Connection: close Jun 22 10:16:24.870009 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: Content-Length: 118 Jun 22 10:16:24.870009 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: Content-Type: application/json Jun 22 10:16:24.870009 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: Host: 10.222.0.43 Jun 22 10:16:24.870009 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: Openstack-System-Scope: None Jun 22 10:16:24.870009 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: User-Agent: python-urllib3/1.26.9 Jun 22 10:16:24.870009 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-Auth-Token: gAAAAABisuv4XBHu3wXWxB58YcqTRADkQ535PQWHWrnHdZ6AS2mdfj3WIju9f02qkJrf_3JA4vb2HVKPdHf8z_vjqvFkTa7Dw8S80kvwPSv-e1dvSMf-sSddBQ2CobGo4mGQqpjFVfCRHuiaLkn-LwggDpoGnY3QXdgVHF31dLQpKcDCvXMC3bU Jun 22 10:16:24.870009 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-Domain-Id: None Jun 22 10:16:24.870009 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-Domain-Name: None Jun 22 10:16:24.870009 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-Identity-Status: Confirmed Jun 22 10:16:24.870009 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-Is-Admin-Project: True Jun 22 10:16:24.870009 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-Project-Domain-Id: default Jun 22 10:16:24.870009 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-Project-Domain-Name: Default Jun 22 10:16:24.870009 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-Project-Id: 1f86edb1750441af89ecefc44ac2dba2 Jun 22 10:16:24.870009 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-Project-Name: tempest-VolumesNegativeTest-165361948 Jun 22 10:16:24.870009 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-Role: reader,member Jun 22 10:16:24.870009 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-Roles: reader,member Jun 22 10:16:24.871322 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/1f86edb1750441af89ecefc44ac2dba2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/1f86edb1750441af89ecefc44ac2dba2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_1f86edb1750441af89ecefc44ac2dba2", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/1f86edb1750441af89ecefc44ac2dba2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}] Jun 22 10:16:24.871322 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-Tenant: tempest-VolumesNegativeTest-165361948 Jun 22 10:16:24.871322 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-Tenant-Id: 1f86edb1750441af89ecefc44ac2dba2 Jun 22 10:16:24.871322 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-Tenant-Name: tempest-VolumesNegativeTest-165361948 Jun 22 10:16:24.871322 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-User: tempest-VolumesNegativeTest-165361948-project Jun 22 10:16:24.871322 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-User-Domain-Id: default Jun 22 10:16:24.871322 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-User-Domain-Name: Default Jun 22 10:16:24.871322 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-User-Id: ea52f49e642b4ad3aef61a93eea7fb04 Jun 22 10:16:24.871322 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-User-Name: tempest-VolumesNegativeTest-165361948-project Jun 22 10:16:24.871322 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: Jun 22 10:16:24.871322 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-548516386", "metadata": {"Type": "work"}}} Jun 22 10:16:24.871322 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: method: Jun 22 10:16:24.871322 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jun 22 10:16:24.872190 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-548516386', 'metadata': {'Type': 'work'}}}} Jun 22 10:16:24.872190 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 10:16:24.872190 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:16:24.872190 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 22 10:16:24.872190 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 22 10:16:24.872190 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 22 10:16:24.872190 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi raise error Jun 22 10:16:24.872190 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Jun 22 10:16:24.872190 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi Jun 22 10:16:24.872190 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jun 22 10:16:24.872190 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jun 22 10:16:24.872190 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi Jun 22 10:16:24.872190 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi On instance['volume']: Jun 22 10:16:24.872190 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi '' Jun 22 10:16:24.872190 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi Jun 22 10:16:24.872190 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 10:16:24.872190 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi Jun 22 10:16:24.872190 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:16:24.872190 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 10:16:24.872190 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 10:16:24.872190 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 10:16:24.872190 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 10:16:24.873466 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 22 10:16:24.873466 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 22 10:16:24.873466 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 10:16:24.873466 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 10:16:24.873466 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 22 10:16:24.873466 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 22 10:16:24.873466 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 22 10:16:24.873466 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 22 10:16:24.873466 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 22 10:16:24.873466 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 22 10:16:24.873466 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jun 22 10:16:24.873466 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi Jun 22 10:16:24.873466 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 10:16:24.873466 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi Jun 22 10:16:24.873466 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:16:24.873466 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 10:16:24.873466 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 10:16:24.873466 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 22 10:16:24.873466 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 22 10:16:24.874637 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jun 22 10:16:24.874637 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi Jun 22 10:16:24.874637 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-d7bd63b2-9f15-4f24-8f28-7791b30ba009 tempest-VolumesNegativeTest-165361948 tempest-VolumesNegativeTest-165361948-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=117874) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 10:16:24.874637 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [None req-d7bd63b2-9f15-4f24-8f28-7791b30ba009 tempest-VolumesNegativeTest-165361948 tempest-VolumesNegativeTest-165361948-project] 10.222.0.43 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.007746 Jun 22 10:16:24.876023 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 51/90] 10.222.0.43 () {60 vars in 1155 bytes} [Wed Jun 22 10:16:24 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 13 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jun 22 10:16:24.882311 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-eed4d80d-4899-40fd-ae12-b6feff98822e tempest-VolumesNegativeTest-165361948 tempest-VolumesNegativeTest-165361948-project] Calling method '.version_select at 0x7f36bf924430>' {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:16:24.915356 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.policy [None req-a4a6f895-9a2e-4d1d-a57d-992e248003fd tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d7292401816437fba46d073c4746e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3277b9cbc4b4a8bbacee8440cea1ed2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117873) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:16:24.923330 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.wsgi [None req-eed4d80d-4899-40fd-ae12-b6feff98822e tempest-VolumesNegativeTest-165361948 tempest-VolumesNegativeTest-165361948-project] HTTP exception thrown: Volume tempest-invalid-1987652044 could not be found. Jun 22 10:16:24.925372 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [None req-a4a6f895-9a2e-4d1d-a57d-992e248003fd tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] 10.222.0.43 "GET /compute/v2.1/servers/9f07e4bb-f4e9-428e-8feb-db50b3ff2109" status: 200 len: 1321 microversion: 2.1 time: 0.194515 Jun 22 10:16:24.926004 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 40/91] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:16:24 2022] GET /compute/v2.1/servers/9f07e4bb-f4e9-428e-8feb-db50b3ff2109 => generated 1321 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:16:24.930554 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-eed4d80d-4899-40fd-ae12-b6feff98822e tempest-VolumesNegativeTest-165361948 tempest-VolumesNegativeTest-165361948-project] Request method failure captured: Jun 22 10:16:24.930554 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1987652044 HTTP/1.1 Jun 22 10:16:24.930554 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: Accept: application/json Jun 22 10:16:24.930554 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: Accept-Encoding: identity Jun 22 10:16:24.930554 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: Connection: close Jun 22 10:16:24.930554 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: Content-Length: 0 Jun 22 10:16:24.930554 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: Content-Type: application/json Jun 22 10:16:24.930554 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: Host: 10.222.0.43 Jun 22 10:16:24.930554 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: Openstack-System-Scope: None Jun 22 10:16:24.930554 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: User-Agent: python-urllib3/1.26.9 Jun 22 10:16:24.930554 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-Auth-Token: gAAAAABisuv4XBHu3wXWxB58YcqTRADkQ535PQWHWrnHdZ6AS2mdfj3WIju9f02qkJrf_3JA4vb2HVKPdHf8z_vjqvFkTa7Dw8S80kvwPSv-e1dvSMf-sSddBQ2CobGo4mGQqpjFVfCRHuiaLkn-LwggDpoGnY3QXdgVHF31dLQpKcDCvXMC3bU Jun 22 10:16:24.930554 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-Domain-Id: None Jun 22 10:16:24.930554 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-Domain-Name: None Jun 22 10:16:24.930554 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-Identity-Status: Confirmed Jun 22 10:16:24.930554 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-Is-Admin-Project: True Jun 22 10:16:24.930554 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-Project-Domain-Id: default Jun 22 10:16:24.930554 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-Project-Domain-Name: Default Jun 22 10:16:24.930554 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-Project-Id: 1f86edb1750441af89ecefc44ac2dba2 Jun 22 10:16:24.930554 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-Project-Name: tempest-VolumesNegativeTest-165361948 Jun 22 10:16:24.930554 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-Role: reader,member Jun 22 10:16:24.930554 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-Roles: reader,member Jun 22 10:16:24.931701 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/1f86edb1750441af89ecefc44ac2dba2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/1f86edb1750441af89ecefc44ac2dba2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_1f86edb1750441af89ecefc44ac2dba2", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/1f86edb1750441af89ecefc44ac2dba2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}] Jun 22 10:16:24.931701 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-Tenant: tempest-VolumesNegativeTest-165361948 Jun 22 10:16:24.931701 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-Tenant-Id: 1f86edb1750441af89ecefc44ac2dba2 Jun 22 10:16:24.931701 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-Tenant-Name: tempest-VolumesNegativeTest-165361948 Jun 22 10:16:24.931701 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-User: tempest-VolumesNegativeTest-165361948-project Jun 22 10:16:24.931701 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-User-Domain-Id: default Jun 22 10:16:24.931701 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-User-Domain-Name: Default Jun 22 10:16:24.931701 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-User-Id: ea52f49e642b4ad3aef61a93eea7fb04 Jun 22 10:16:24.931701 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-User-Name: tempest-VolumesNegativeTest-165361948-project Jun 22 10:16:24.931701 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: method: Jun 22 10:16:24.931701 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: exception: Volume tempest-invalid-1987652044 could not be found. Jun 22 10:16:24.931701 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: action_args: {'id': 'tempest-invalid-1987652044'} Jun 22 10:16:24.931701 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 10:16:24.932391 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:16:24.932391 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 22 10:16:24.932391 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 22 10:16:24.932391 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 22 10:16:24.932391 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 22 10:16:24.932391 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 22 10:16:24.932391 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 22 10:16:24.932391 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 22 10:16:24.932391 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 22 10:16:24.932391 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 22 10:16:24.932391 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 22 10:16:24.932391 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 22 10:16:24.932391 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 22 10:16:24.932391 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 22 10:16:24.932391 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 22 10:16:24.932391 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1987652044 could not be found. (HTTP 404) (Request-ID: req-f33627ca-cb60-4b2e-b1bb-88a20a752515) Jun 22 10:16:24.932391 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi Jun 22 10:16:24.932391 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 10:16:24.932391 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi Jun 22 10:16:24.933370 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:16:24.933370 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jun 22 10:16:24.933370 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jun 22 10:16:24.933370 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 22 10:16:24.933370 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 22 10:16:24.933370 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 22 10:16:24.933370 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 22 10:16:24.933370 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 22 10:16:24.933370 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 22 10:16:24.933370 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 22 10:16:24.933370 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 22 10:16:24.933370 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 22 10:16:24.933370 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 22 10:16:24.933370 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 22 10:16:24.933370 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 22 10:16:24.933370 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 22 10:16:24.933370 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 22 10:16:24.933370 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 22 10:16:24.933370 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 22 10:16:24.934602 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 22 10:16:24.934602 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 22 10:16:24.934602 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 22 10:16:24.934602 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 22 10:16:24.934602 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1987652044 could not be found. Jun 22 10:16:24.934602 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi Jun 22 10:16:24.934602 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 10:16:24.934602 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi Jun 22 10:16:24.934602 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:16:24.934602 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 10:16:24.934602 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 10:16:24.934602 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 10:16:24.934602 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 10:16:24.934602 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 22 10:16:24.934602 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 22 10:16:24.934602 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 10:16:24.934602 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 10:16:24.934602 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jun 22 10:16:24.934602 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 22 10:16:24.934602 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1987652044 could not be found. Jun 22 10:16:24.935876 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi Jun 22 10:16:24.935876 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 10:16:24.935876 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi Jun 22 10:16:24.935876 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:16:24.935876 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 10:16:24.935876 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 10:16:24.935876 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 10:16:24.935876 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 10:16:24.935876 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1987652044 could not be found. Jun 22 10:16:24.935876 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi Jun 22 10:16:24.937358 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-eed4d80d-4899-40fd-ae12-b6feff98822e tempest-VolumesNegativeTest-165361948 tempest-VolumesNegativeTest-165361948-project] Returning 404 to user: Volume tempest-invalid-1987652044 could not be found. {{(pid=117874) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 10:16:24.938373 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [None req-eed4d80d-4899-40fd-ae12-b6feff98822e tempest-VolumesNegativeTest-165361948 tempest-VolumesNegativeTest-165361948-project] 10.222.0.43 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1987652044" status: 404 len: 99 microversion: 2.1 time: 0.060510 Jun 22 10:16:24.939800 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 52/92] 10.222.0.43 () {58 vars in 1217 bytes} [Wed Jun 22 10:16:24 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1987652044 => generated 99 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jun 22 10:16:24.950898 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [None req-e7d20d87-f871-487c-91b2-c4c2e2f6acc9 tempest-VolumesNegativeTest-165361948 tempest-VolumesNegativeTest-165361948-project] 10.222.0.43 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.005729 Jun 22 10:16:24.951557 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 41/93] 10.222.0.43 () {58 vars in 1139 bytes} [Wed Jun 22 10:16:24 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 7 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jun 22 10:16:24.961232 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [None req-b205c6d0-3678-4853-b190-1306faa158c1 tempest-VolumesNegativeTest-165361948 tempest-VolumesNegativeTest-165361948-project] 10.222.0.43 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003815 Jun 22 10:16:24.961658 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 53/94] 10.222.0.43 () {58 vars in 1136 bytes} [Wed Jun 22 10:16:24 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jun 22 10:16:24.971409 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-a1ef1a0d-5dc9-442b-adc1-c331b4ce3990 tempest-VolumesNegativeTest-165361948 tempest-VolumesNegativeTest-165361948-project] Calling method '.version_select at 0x7f36bf14a670>' {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:16:25.006567 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.wsgi [None req-a1ef1a0d-5dc9-442b-adc1-c331b4ce3990 tempest-VolumesNegativeTest-165361948 tempest-VolumesNegativeTest-165361948-project] HTTP exception thrown: Volume 003faa39-aed7-4562-ba86-8569ab2d91ae could not be found. Jun 22 10:16:25.008731 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-a1ef1a0d-5dc9-442b-adc1-c331b4ce3990 tempest-VolumesNegativeTest-165361948 tempest-VolumesNegativeTest-165361948-project] Request method failure captured: Jun 22 10:16:25.008731 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: request: DELETE /compute/v2.1/os-volumes/003faa39-aed7-4562-ba86-8569ab2d91ae HTTP/1.1 Jun 22 10:16:25.008731 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: Accept: application/json Jun 22 10:16:25.008731 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: Accept-Encoding: identity Jun 22 10:16:25.008731 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: Connection: close Jun 22 10:16:25.008731 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: Content-Length: 0 Jun 22 10:16:25.008731 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: Content-Type: application/json Jun 22 10:16:25.008731 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: Host: 10.222.0.43 Jun 22 10:16:25.008731 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: Openstack-System-Scope: None Jun 22 10:16:25.008731 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: User-Agent: python-urllib3/1.26.9 Jun 22 10:16:25.008731 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-Auth-Token: gAAAAABisuv4XBHu3wXWxB58YcqTRADkQ535PQWHWrnHdZ6AS2mdfj3WIju9f02qkJrf_3JA4vb2HVKPdHf8z_vjqvFkTa7Dw8S80kvwPSv-e1dvSMf-sSddBQ2CobGo4mGQqpjFVfCRHuiaLkn-LwggDpoGnY3QXdgVHF31dLQpKcDCvXMC3bU Jun 22 10:16:25.008731 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-Domain-Id: None Jun 22 10:16:25.008731 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-Domain-Name: None Jun 22 10:16:25.008731 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-Identity-Status: Confirmed Jun 22 10:16:25.008731 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-Is-Admin-Project: True Jun 22 10:16:25.008731 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-Project-Domain-Id: default Jun 22 10:16:25.008731 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-Project-Domain-Name: Default Jun 22 10:16:25.008731 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-Project-Id: 1f86edb1750441af89ecefc44ac2dba2 Jun 22 10:16:25.008731 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-Project-Name: tempest-VolumesNegativeTest-165361948 Jun 22 10:16:25.008731 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-Role: reader,member Jun 22 10:16:25.008731 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-Roles: reader,member Jun 22 10:16:25.010086 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/1f86edb1750441af89ecefc44ac2dba2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/1f86edb1750441af89ecefc44ac2dba2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_1f86edb1750441af89ecefc44ac2dba2", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/1f86edb1750441af89ecefc44ac2dba2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}] Jun 22 10:16:25.010086 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-Tenant: tempest-VolumesNegativeTest-165361948 Jun 22 10:16:25.010086 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-Tenant-Id: 1f86edb1750441af89ecefc44ac2dba2 Jun 22 10:16:25.010086 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-Tenant-Name: tempest-VolumesNegativeTest-165361948 Jun 22 10:16:25.010086 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-User: tempest-VolumesNegativeTest-165361948-project Jun 22 10:16:25.010086 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-User-Domain-Id: default Jun 22 10:16:25.010086 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-User-Domain-Name: Default Jun 22 10:16:25.010086 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-User-Id: ea52f49e642b4ad3aef61a93eea7fb04 Jun 22 10:16:25.010086 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-User-Name: tempest-VolumesNegativeTest-165361948-project Jun 22 10:16:25.010086 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: method: Jun 22 10:16:25.010086 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: exception: Volume 003faa39-aed7-4562-ba86-8569ab2d91ae could not be found. Jun 22 10:16:25.010086 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: action_args: {'id': '003faa39-aed7-4562-ba86-8569ab2d91ae'} Jun 22 10:16:25.010086 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 10:16:25.010882 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:16:25.010882 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 22 10:16:25.010882 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 22 10:16:25.010882 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 22 10:16:25.010882 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 22 10:16:25.010882 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 22 10:16:25.010882 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 22 10:16:25.010882 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 22 10:16:25.010882 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 22 10:16:25.010882 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 22 10:16:25.010882 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 22 10:16:25.010882 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 22 10:16:25.010882 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 22 10:16:25.010882 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 22 10:16:25.010882 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 22 10:16:25.010882 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 003faa39-aed7-4562-ba86-8569ab2d91ae could not be found. (HTTP 404) (Request-ID: req-b56a8ae7-9acc-4f64-b85e-4d59b625ff15) Jun 22 10:16:25.010882 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi Jun 22 10:16:25.010882 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 10:16:25.010882 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi Jun 22 10:16:25.012024 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:16:25.012024 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jun 22 10:16:25.012024 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jun 22 10:16:25.012024 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 22 10:16:25.012024 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 22 10:16:25.012024 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 22 10:16:25.012024 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 22 10:16:25.012024 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 22 10:16:25.012024 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 22 10:16:25.012024 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 22 10:16:25.012024 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 22 10:16:25.012024 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 22 10:16:25.012024 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 22 10:16:25.012024 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 22 10:16:25.012024 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 22 10:16:25.012024 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 22 10:16:25.012024 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 22 10:16:25.012024 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 22 10:16:25.012024 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 22 10:16:25.013154 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 22 10:16:25.013154 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 22 10:16:25.013154 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 22 10:16:25.013154 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 22 10:16:25.013154 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 003faa39-aed7-4562-ba86-8569ab2d91ae could not be found. Jun 22 10:16:25.013154 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi Jun 22 10:16:25.013154 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 10:16:25.013154 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi Jun 22 10:16:25.013154 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:16:25.013154 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 10:16:25.013154 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 10:16:25.013154 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 10:16:25.013154 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 10:16:25.013154 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 22 10:16:25.013154 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 22 10:16:25.013154 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 10:16:25.013154 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 10:16:25.013154 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jun 22 10:16:25.013154 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 22 10:16:25.014463 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 003faa39-aed7-4562-ba86-8569ab2d91ae could not be found. Jun 22 10:16:25.014463 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi Jun 22 10:16:25.014463 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 10:16:25.014463 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi Jun 22 10:16:25.014463 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:16:25.014463 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 10:16:25.014463 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 10:16:25.014463 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 10:16:25.014463 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 10:16:25.014463 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 003faa39-aed7-4562-ba86-8569ab2d91ae could not be found. Jun 22 10:16:25.014463 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi Jun 22 10:16:25.014463 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-a1ef1a0d-5dc9-442b-adc1-c331b4ce3990 tempest-VolumesNegativeTest-165361948 tempest-VolumesNegativeTest-165361948-project] Returning 404 to user: Volume 003faa39-aed7-4562-ba86-8569ab2d91ae could not be found. {{(pid=117873) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 10:16:25.014463 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [None req-a1ef1a0d-5dc9-442b-adc1-c331b4ce3990 tempest-VolumesNegativeTest-165361948 tempest-VolumesNegativeTest-165361948-project] 10.222.0.43 "DELETE /compute/v2.1/os-volumes/003faa39-aed7-4562-ba86-8569ab2d91ae" status: 404 len: 109 microversion: 2.1 time: 0.047423 Jun 22 10:16:25.019335 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 42/95] 10.222.0.43 () {58 vars in 1247 bytes} [Wed Jun 22 10:16:24 2022] DELETE /compute/v2.1/os-volumes/003faa39-aed7-4562-ba86-8569ab2d91ae => generated 109 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 22 10:16:25.024385 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-afcdfb1a-bf9d-4393-a4d6-29ceecf82d68 tempest-VolumesNegativeTest-165361948 tempest-VolumesNegativeTest-165361948-project] Calling method '.version_select at 0x7f36be8af4c0>' {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:16:25.054573 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.wsgi [None req-afcdfb1a-bf9d-4393-a4d6-29ceecf82d68 tempest-VolumesNegativeTest-165361948 tempest-VolumesNegativeTest-165361948-project] HTTP exception thrown: Volume 0544b91e-0b64-463f-9efd-efce71bca945 could not be found. Jun 22 10:16:25.056634 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-afcdfb1a-bf9d-4393-a4d6-29ceecf82d68 tempest-VolumesNegativeTest-165361948 tempest-VolumesNegativeTest-165361948-project] Request method failure captured: Jun 22 10:16:25.056634 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: request: GET /compute/v2.1/os-volumes/0544b91e-0b64-463f-9efd-efce71bca945 HTTP/1.1 Jun 22 10:16:25.056634 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: Accept: application/json Jun 22 10:16:25.056634 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: Accept-Encoding: identity Jun 22 10:16:25.056634 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: Connection: close Jun 22 10:16:25.056634 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: Content-Length: 0 Jun 22 10:16:25.056634 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: Content-Type: application/json Jun 22 10:16:25.056634 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: Host: 10.222.0.43 Jun 22 10:16:25.056634 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: Openstack-System-Scope: None Jun 22 10:16:25.056634 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: User-Agent: python-urllib3/1.26.9 Jun 22 10:16:25.056634 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-Auth-Token: gAAAAABisuv4XBHu3wXWxB58YcqTRADkQ535PQWHWrnHdZ6AS2mdfj3WIju9f02qkJrf_3JA4vb2HVKPdHf8z_vjqvFkTa7Dw8S80kvwPSv-e1dvSMf-sSddBQ2CobGo4mGQqpjFVfCRHuiaLkn-LwggDpoGnY3QXdgVHF31dLQpKcDCvXMC3bU Jun 22 10:16:25.056634 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-Domain-Id: None Jun 22 10:16:25.056634 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-Domain-Name: None Jun 22 10:16:25.056634 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-Identity-Status: Confirmed Jun 22 10:16:25.056634 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-Is-Admin-Project: True Jun 22 10:16:25.056634 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-Project-Domain-Id: default Jun 22 10:16:25.056634 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-Project-Domain-Name: Default Jun 22 10:16:25.056634 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-Project-Id: 1f86edb1750441af89ecefc44ac2dba2 Jun 22 10:16:25.056634 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-Project-Name: tempest-VolumesNegativeTest-165361948 Jun 22 10:16:25.056634 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-Role: reader,member Jun 22 10:16:25.056634 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-Roles: reader,member Jun 22 10:16:25.058040 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/1f86edb1750441af89ecefc44ac2dba2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/1f86edb1750441af89ecefc44ac2dba2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_1f86edb1750441af89ecefc44ac2dba2", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/1f86edb1750441af89ecefc44ac2dba2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}] Jun 22 10:16:25.058040 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-Tenant: tempest-VolumesNegativeTest-165361948 Jun 22 10:16:25.058040 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-Tenant-Id: 1f86edb1750441af89ecefc44ac2dba2 Jun 22 10:16:25.058040 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-Tenant-Name: tempest-VolumesNegativeTest-165361948 Jun 22 10:16:25.058040 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-User: tempest-VolumesNegativeTest-165361948-project Jun 22 10:16:25.058040 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-User-Domain-Id: default Jun 22 10:16:25.058040 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-User-Domain-Name: Default Jun 22 10:16:25.058040 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-User-Id: ea52f49e642b4ad3aef61a93eea7fb04 Jun 22 10:16:25.058040 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-User-Name: tempest-VolumesNegativeTest-165361948-project Jun 22 10:16:25.058040 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: method: Jun 22 10:16:25.058040 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: exception: Volume 0544b91e-0b64-463f-9efd-efce71bca945 could not be found. Jun 22 10:16:25.058040 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: action_args: {'id': '0544b91e-0b64-463f-9efd-efce71bca945'} Jun 22 10:16:25.058040 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 10:16:25.058899 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:16:25.058899 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 22 10:16:25.058899 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 22 10:16:25.058899 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 22 10:16:25.058899 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 22 10:16:25.058899 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 22 10:16:25.058899 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 22 10:16:25.058899 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 22 10:16:25.058899 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 22 10:16:25.058899 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 22 10:16:25.058899 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 22 10:16:25.058899 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 22 10:16:25.058899 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 22 10:16:25.058899 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 22 10:16:25.058899 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 22 10:16:25.058899 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 0544b91e-0b64-463f-9efd-efce71bca945 could not be found. (HTTP 404) (Request-ID: req-1f561f73-1504-4783-8c9d-35265f773057) Jun 22 10:16:25.058899 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi Jun 22 10:16:25.058899 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 10:16:25.058899 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi Jun 22 10:16:25.062651 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:16:25.062651 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 22 10:16:25.062651 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 22 10:16:25.062651 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 22 10:16:25.062651 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 22 10:16:25.062651 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 22 10:16:25.062651 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 22 10:16:25.062651 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 22 10:16:25.062651 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 22 10:16:25.062651 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 22 10:16:25.062651 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 22 10:16:25.062651 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 22 10:16:25.062651 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 22 10:16:25.062651 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 22 10:16:25.062651 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 22 10:16:25.062651 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 22 10:16:25.062651 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 22 10:16:25.062651 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 22 10:16:25.062651 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 22 10:16:25.063683 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 22 10:16:25.063683 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 22 10:16:25.063683 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 22 10:16:25.063683 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 22 10:16:25.063683 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 0544b91e-0b64-463f-9efd-efce71bca945 could not be found. Jun 22 10:16:25.063683 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi Jun 22 10:16:25.063683 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 10:16:25.063683 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi Jun 22 10:16:25.063683 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:16:25.063683 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 10:16:25.063683 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 10:16:25.063683 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 10:16:25.063683 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 10:16:25.063683 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 22 10:16:25.063683 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 22 10:16:25.063683 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 10:16:25.063683 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 10:16:25.063683 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 22 10:16:25.063683 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 22 10:16:25.064998 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 0544b91e-0b64-463f-9efd-efce71bca945 could not be found. Jun 22 10:16:25.064998 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi Jun 22 10:16:25.064998 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 10:16:25.064998 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi Jun 22 10:16:25.064998 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:16:25.064998 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 10:16:25.064998 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 10:16:25.064998 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 10:16:25.064998 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 10:16:25.064998 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 0544b91e-0b64-463f-9efd-efce71bca945 could not be found. Jun 22 10:16:25.064998 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi Jun 22 10:16:25.064998 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-afcdfb1a-bf9d-4393-a4d6-29ceecf82d68 tempest-VolumesNegativeTest-165361948 tempest-VolumesNegativeTest-165361948-project] Returning 404 to user: Volume 0544b91e-0b64-463f-9efd-efce71bca945 could not be found. {{(pid=117874) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 10:16:25.064998 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [None req-afcdfb1a-bf9d-4393-a4d6-29ceecf82d68 tempest-VolumesNegativeTest-165361948 tempest-VolumesNegativeTest-165361948-project] 10.222.0.43 "GET /compute/v2.1/os-volumes/0544b91e-0b64-463f-9efd-efce71bca945" status: 404 len: 109 microversion: 2.1 time: 0.038333 Jun 22 10:16:25.064998 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 54/96] 10.222.0.43 () {58 vars in 1244 bytes} [Wed Jun 22 10:16:25 2022] GET /compute/v2.1/os-volumes/0544b91e-0b64-463f-9efd-efce71bca945 => generated 109 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 22 10:16:25.225276 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-4e652fb8-b2b9-42c3-b510-e5a276eab656 tempest-DeleteServersTestJSON-502292925 tempest-DeleteServersTestJSON-502292925-project] Calling method '>' {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:16:25.226127 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.compute.api [None req-4e652fb8-b2b9-42c3-b510-e5a276eab656 tempest-DeleteServersTestJSON-502292925 tempest-DeleteServersTestJSON-502292925-project] [instance: 8b3f01d1-ac00-4bfb-8ae3-be75720b8ad1] Fetching instance by UUID {{(pid=117873) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:16:25.233716 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-4e652fb8-b2b9-42c3-b510-e5a276eab656 tempest-DeleteServersTestJSON-502292925 tempest-DeleteServersTestJSON-502292925-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:16:25.234273 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-4e652fb8-b2b9-42c3-b510-e5a276eab656 tempest-DeleteServersTestJSON-502292925 tempest-DeleteServersTestJSON-502292925-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:16:25.235236 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-4e652fb8-b2b9-42c3-b510-e5a276eab656 tempest-DeleteServersTestJSON-502292925 tempest-DeleteServersTestJSON-502292925-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:16:25.236517 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-4e652fb8-b2b9-42c3-b510-e5a276eab656 tempest-DeleteServersTestJSON-502292925 tempest-DeleteServersTestJSON-502292925-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:16:25.297572 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG dbcounter [-] [117873] Writing DB stats nova_cell0:SELECT=30 {{(pid=117873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:16:25.398652 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.policy [None req-4e652fb8-b2b9-42c3-b510-e5a276eab656 tempest-DeleteServersTestJSON-502292925 tempest-DeleteServersTestJSON-502292925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3af9bfaaaa4dcca0747f776115c826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4765b82e21647a9b391a98f446a0e17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117873) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:16:25.406352 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [None req-4e652fb8-b2b9-42c3-b510-e5a276eab656 tempest-DeleteServersTestJSON-502292925 tempest-DeleteServersTestJSON-502292925-project] 10.222.0.43 "GET /compute/v2.1/servers/8b3f01d1-ac00-4bfb-8ae3-be75720b8ad1" status: 200 len: 1314 microversion: 2.1 time: 0.184900 Jun 22 10:16:25.406940 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 43/97] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:16:25 2022] GET /compute/v2.1/servers/8b3f01d1-ac00-4bfb-8ae3-be75720b8ad1 => generated 1314 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:16:25.443606 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-feae9750-a9b9-414d-a9c8-cfec16950ad6 tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Calling method '>' {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:16:25.444813 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.compute.api [None req-feae9750-a9b9-414d-a9c8-cfec16950ad6 tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] [instance: 5828c9dc-3439-4da7-a94c-f81cbbfdcb99] Fetching instance by UUID {{(pid=117874) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:16:25.451489 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-feae9750-a9b9-414d-a9c8-cfec16950ad6 tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:16:25.451992 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-feae9750-a9b9-414d-a9c8-cfec16950ad6 tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:16:25.452685 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-feae9750-a9b9-414d-a9c8-cfec16950ad6 tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:16:25.453292 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-feae9750-a9b9-414d-a9c8-cfec16950ad6 tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:16:25.603570 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.policy [None req-feae9750-a9b9-414d-a9c8-cfec16950ad6 tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7be3d844dcee4d19966fc7944463a0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78629282e2b74418a2c1cdac32576ef1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117874) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:16:25.612756 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [None req-feae9750-a9b9-414d-a9c8-cfec16950ad6 tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] 10.222.0.43 "GET /compute/v2.1/servers/5828c9dc-3439-4da7-a94c-f81cbbfdcb99" status: 200 len: 1365 microversion: 2.1 time: 0.173686 Jun 22 10:16:25.613041 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-ed8ce3af-3c22-4a38-b436-3220b513ffee tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Calling method '>' {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:16:25.613640 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.compute.api [None req-ed8ce3af-3c22-4a38-b436-3220b513ffee tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] [instance: 73dbd5ab-5688-4de4-9da2-0b89d7cefb11] Fetching instance by UUID {{(pid=117873) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:16:25.614156 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 55/98] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:16:25 2022] GET /compute/v2.1/servers/5828c9dc-3439-4da7-a94c-f81cbbfdcb99 => generated 1365 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:16:25.619781 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-ed8ce3af-3c22-4a38-b436-3220b513ffee tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:16:25.620206 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-ed8ce3af-3c22-4a38-b436-3220b513ffee tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:16:25.620962 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-ed8ce3af-3c22-4a38-b436-3220b513ffee tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:16:25.621383 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-ed8ce3af-3c22-4a38-b436-3220b513ffee tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:16:25.763839 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.policy [None req-ed8ce3af-3c22-4a38-b436-3220b513ffee tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75753b29a78640df9622d4e2655baf9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee9d603d9cc4a8797f55d544f189720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117873) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:16:25.776973 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.policy [None req-ed8ce3af-3c22-4a38-b436-3220b513ffee tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75753b29a78640df9622d4e2655baf9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee9d603d9cc4a8797f55d544f189720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117873) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:16:25.778773 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.policy [None req-ed8ce3af-3c22-4a38-b436-3220b513ffee tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75753b29a78640df9622d4e2655baf9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee9d603d9cc4a8797f55d544f189720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117873) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:16:25.780399 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [None req-ed8ce3af-3c22-4a38-b436-3220b513ffee tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] 10.222.0.43 "GET /compute/v2.1/servers/73dbd5ab-5688-4de4-9da2-0b89d7cefb11" status: 200 len: 1407 microversion: 2.20 time: 0.171412 Jun 22 10:16:25.781495 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 44/99] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jun 22 10:16:25 2022] GET /compute/v2.1/servers/73dbd5ab-5688-4de4-9da2-0b89d7cefb11 => generated 1407 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 22 10:16:25.813036 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-63600b89-bcf7-45bb-9498-32fa8e7652f4 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Calling method '>' {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:16:25.814466 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.compute.api [None req-63600b89-bcf7-45bb-9498-32fa8e7652f4 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] [instance: eb851ab6-0e89-41d2-be52-d76cdc8644d6] Fetching instance by UUID {{(pid=117874) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:16:25.821325 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-63600b89-bcf7-45bb-9498-32fa8e7652f4 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:16:25.821817 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-63600b89-bcf7-45bb-9498-32fa8e7652f4 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:16:25.822590 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-63600b89-bcf7-45bb-9498-32fa8e7652f4 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:16:25.823182 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-63600b89-bcf7-45bb-9498-32fa8e7652f4 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:16:25.943953 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-edf87b3d-5152-48c9-9029-b55842fa0df6 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Calling method '>' {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:16:25.944573 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.compute.api [None req-edf87b3d-5152-48c9-9029-b55842fa0df6 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] [instance: 9f07e4bb-f4e9-428e-8feb-db50b3ff2109] Fetching instance by UUID {{(pid=117873) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:16:25.951919 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-edf87b3d-5152-48c9-9029-b55842fa0df6 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:16:25.953918 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-edf87b3d-5152-48c9-9029-b55842fa0df6 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:16:25.955298 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-edf87b3d-5152-48c9-9029-b55842fa0df6 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:16:25.955740 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-edf87b3d-5152-48c9-9029-b55842fa0df6 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:16:25.980412 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.policy [None req-63600b89-bcf7-45bb-9498-32fa8e7652f4 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78fe3fc4334c43d7a5ef6d70f9f57523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad52333bcbec425089c44c3e55df97ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117874) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:16:25.994033 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [None req-63600b89-bcf7-45bb-9498-32fa8e7652f4 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] 10.222.0.43 "GET /compute/v2.1/servers/eb851ab6-0e89-41d2-be52-d76cdc8644d6" status: 200 len: 1363 microversion: 2.1 time: 0.186439 Jun 22 10:16:25.994774 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 56/100] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:16:25 2022] GET /compute/v2.1/servers/eb851ab6-0e89-41d2-be52-d76cdc8644d6 => generated 1363 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:16:26.135258 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.policy [None req-edf87b3d-5152-48c9-9029-b55842fa0df6 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d7292401816437fba46d073c4746e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3277b9cbc4b4a8bbacee8440cea1ed2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117873) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:16:26.144783 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [None req-edf87b3d-5152-48c9-9029-b55842fa0df6 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] 10.222.0.43 "GET /compute/v2.1/servers/9f07e4bb-f4e9-428e-8feb-db50b3ff2109" status: 200 len: 1321 microversion: 2.1 time: 0.207081 Jun 22 10:16:26.145587 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 45/101] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:16:25 2022] GET /compute/v2.1/servers/9f07e4bb-f4e9-428e-8feb-db50b3ff2109 => generated 1321 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:16:26.426594 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-db0984ec-e186-4556-b56a-1576cc0589d9 tempest-DeleteServersTestJSON-502292925 tempest-DeleteServersTestJSON-502292925-project] Calling method '>' {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:16:26.429603 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.compute.api [None req-db0984ec-e186-4556-b56a-1576cc0589d9 tempest-DeleteServersTestJSON-502292925 tempest-DeleteServersTestJSON-502292925-project] [instance: 8b3f01d1-ac00-4bfb-8ae3-be75720b8ad1] Fetching instance by UUID {{(pid=117874) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:16:26.449492 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-db0984ec-e186-4556-b56a-1576cc0589d9 tempest-DeleteServersTestJSON-502292925 tempest-DeleteServersTestJSON-502292925-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:16:26.450372 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-db0984ec-e186-4556-b56a-1576cc0589d9 tempest-DeleteServersTestJSON-502292925 tempest-DeleteServersTestJSON-502292925-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:16:26.455682 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-db0984ec-e186-4556-b56a-1576cc0589d9 tempest-DeleteServersTestJSON-502292925 tempest-DeleteServersTestJSON-502292925-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:16:26.457807 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-db0984ec-e186-4556-b56a-1576cc0589d9 tempest-DeleteServersTestJSON-502292925 tempest-DeleteServersTestJSON-502292925-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:16:26.632189 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-bc6b7fa0-1312-48ff-b6ea-4f4d9cc54656 tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Calling method '>' {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:16:26.632810 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.compute.api [None req-bc6b7fa0-1312-48ff-b6ea-4f4d9cc54656 tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] [instance: 5828c9dc-3439-4da7-a94c-f81cbbfdcb99] Fetching instance by UUID {{(pid=117873) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:16:26.645589 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-bc6b7fa0-1312-48ff-b6ea-4f4d9cc54656 tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:16:26.646186 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-bc6b7fa0-1312-48ff-b6ea-4f4d9cc54656 tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:16:26.648177 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-bc6b7fa0-1312-48ff-b6ea-4f4d9cc54656 tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:16:26.648792 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-bc6b7fa0-1312-48ff-b6ea-4f4d9cc54656 tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:16:26.986592 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.policy [None req-db0984ec-e186-4556-b56a-1576cc0589d9 tempest-DeleteServersTestJSON-502292925 tempest-DeleteServersTestJSON-502292925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3af9bfaaaa4dcca0747f776115c826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4765b82e21647a9b391a98f446a0e17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117874) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:16:27.011168 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [None req-db0984ec-e186-4556-b56a-1576cc0589d9 tempest-DeleteServersTestJSON-502292925 tempest-DeleteServersTestJSON-502292925-project] 10.222.0.43 "GET /compute/v2.1/servers/8b3f01d1-ac00-4bfb-8ae3-be75720b8ad1" status: 200 len: 1314 microversion: 2.1 time: 0.590816 Jun 22 10:16:27.012851 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 57/102] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:16:26 2022] GET /compute/v2.1/servers/8b3f01d1-ac00-4bfb-8ae3-be75720b8ad1 => generated 1314 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:16:27.022679 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-76dc3019-75fe-46f4-8ad7-13b459cbe80f tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Calling method '>' {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:16:27.027041 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.compute.api [None req-76dc3019-75fe-46f4-8ad7-13b459cbe80f tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] [instance: 73dbd5ab-5688-4de4-9da2-0b89d7cefb11] Fetching instance by UUID {{(pid=117874) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:16:27.038169 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-76dc3019-75fe-46f4-8ad7-13b459cbe80f tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:16:27.038688 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-76dc3019-75fe-46f4-8ad7-13b459cbe80f tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:16:27.039798 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-76dc3019-75fe-46f4-8ad7-13b459cbe80f tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:16:27.040319 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-76dc3019-75fe-46f4-8ad7-13b459cbe80f tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:16:27.060234 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.policy [None req-bc6b7fa0-1312-48ff-b6ea-4f4d9cc54656 tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7be3d844dcee4d19966fc7944463a0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78629282e2b74418a2c1cdac32576ef1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117873) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:16:27.070121 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [None req-bc6b7fa0-1312-48ff-b6ea-4f4d9cc54656 tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] 10.222.0.43 "GET /compute/v2.1/servers/5828c9dc-3439-4da7-a94c-f81cbbfdcb99" status: 200 len: 1365 microversion: 2.1 time: 0.443687 Jun 22 10:16:27.081147 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 46/103] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:16:26 2022] GET /compute/v2.1/servers/5828c9dc-3439-4da7-a94c-f81cbbfdcb99 => generated 1365 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 10:16:27.088115 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-38029e17-06b3-4c0b-a096-c699d4aae538 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Calling method '>' {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:16:27.089311 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.compute.api [None req-38029e17-06b3-4c0b-a096-c699d4aae538 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] [instance: eb851ab6-0e89-41d2-be52-d76cdc8644d6] Fetching instance by UUID {{(pid=117873) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:16:27.097386 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-38029e17-06b3-4c0b-a096-c699d4aae538 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:16:27.098171 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-38029e17-06b3-4c0b-a096-c699d4aae538 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:16:27.099177 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-38029e17-06b3-4c0b-a096-c699d4aae538 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:16:27.099875 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-38029e17-06b3-4c0b-a096-c699d4aae538 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:16:27.358186 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.policy [None req-76dc3019-75fe-46f4-8ad7-13b459cbe80f tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75753b29a78640df9622d4e2655baf9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee9d603d9cc4a8797f55d544f189720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117874) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:16:27.370981 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.policy [None req-76dc3019-75fe-46f4-8ad7-13b459cbe80f tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75753b29a78640df9622d4e2655baf9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee9d603d9cc4a8797f55d544f189720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117874) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:16:27.377671 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.policy [None req-76dc3019-75fe-46f4-8ad7-13b459cbe80f tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75753b29a78640df9622d4e2655baf9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee9d603d9cc4a8797f55d544f189720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117874) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:16:27.378981 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [None req-76dc3019-75fe-46f4-8ad7-13b459cbe80f tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] 10.222.0.43 "GET /compute/v2.1/servers/73dbd5ab-5688-4de4-9da2-0b89d7cefb11" status: 200 len: 1407 microversion: 2.20 time: 0.363154 Jun 22 10:16:27.383094 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 58/104] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jun 22 10:16:27 2022] GET /compute/v2.1/servers/73dbd5ab-5688-4de4-9da2-0b89d7cefb11 => generated 1407 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 10:16:27.400371 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-4689206b-b1b8-434a-8f67-dcbd595fabe5 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Calling method '>' {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:16:27.401364 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.compute.api [None req-4689206b-b1b8-434a-8f67-dcbd595fabe5 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] [instance: 9f07e4bb-f4e9-428e-8feb-db50b3ff2109] Fetching instance by UUID {{(pid=117874) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:16:27.418499 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-4689206b-b1b8-434a-8f67-dcbd595fabe5 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:16:27.418499 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-4689206b-b1b8-434a-8f67-dcbd595fabe5 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:16:27.418499 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-4689206b-b1b8-434a-8f67-dcbd595fabe5 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:16:27.421564 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-4689206b-b1b8-434a-8f67-dcbd595fabe5 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:16:27.454121 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.policy [None req-38029e17-06b3-4c0b-a096-c699d4aae538 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78fe3fc4334c43d7a5ef6d70f9f57523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad52333bcbec425089c44c3e55df97ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117873) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:16:27.477644 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [None req-38029e17-06b3-4c0b-a096-c699d4aae538 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] 10.222.0.43 "GET /compute/v2.1/servers/eb851ab6-0e89-41d2-be52-d76cdc8644d6" status: 200 len: 1363 microversion: 2.1 time: 0.394952 Jun 22 10:16:27.480114 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 47/105] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:16:27 2022] GET /compute/v2.1/servers/eb851ab6-0e89-41d2-be52-d76cdc8644d6 => generated 1363 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:16:27.958229 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.policy [None req-4689206b-b1b8-434a-8f67-dcbd595fabe5 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d7292401816437fba46d073c4746e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3277b9cbc4b4a8bbacee8440cea1ed2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117874) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:16:27.964890 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [req-2bc48719-5b2b-4855-8220-aa7a2415ec7f req-232891b5-c673-418d-a7a9-51d2f73e8f5a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eb851ab6-0e89-41d2-be52-d76cdc8644d6", "tag": "d017dd0e-ef63-4ffa-af06-35b32a6bf63f"}]} {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:16:27.977563 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [req-2bc48719-5b2b-4855-8220-aa7a2415ec7f req-232891b5-c673-418d-a7a9-51d2f73e8f5a service nova] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:16:27.978434 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [req-2bc48719-5b2b-4855-8220-aa7a2415ec7f req-232891b5-c673-418d-a7a9-51d2f73e8f5a service nova] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:16:28.014602 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.compute.server_external_events [req-2bc48719-5b2b-4855-8220-aa7a2415ec7f req-232891b5-c673-418d-a7a9-51d2f73e8f5a service nova] Creating event network-changed:d017dd0e-ef63-4ffa-af06-35b32a6bf63f for instance eb851ab6-0e89-41d2-be52-d76cdc8644d6 on hv-cinder-84713 Jun 22 10:16:28.015451 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [req-2bc48719-5b2b-4855-8220-aa7a2415ec7f req-232891b5-c673-418d-a7a9-51d2f73e8f5a service nova] Acquired lock "compute-rpcapi-router" {{(pid=117873) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jun 22 10:16:28.018248 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-6cbb0337-4fdc-4e52-b042-0802ae4bb78d None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:16:28.018978 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-6cbb0337-4fdc-4e52-b042-0802ae4bb78d None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:16:28.020064 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-6cbb0337-4fdc-4e52-b042-0802ae4bb78d None None] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:16:28.021387 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-6cbb0337-4fdc-4e52-b042-0802ae4bb78d None None] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:16:28.035425 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [None req-4689206b-b1b8-434a-8f67-dcbd595fabe5 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] 10.222.0.43 "GET /compute/v2.1/servers/9f07e4bb-f4e9-428e-8feb-db50b3ff2109" status: 200 len: 1321 microversion: 2.1 time: 0.647863 Jun 22 10:16:28.039853 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 59/106] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:16:27 2022] GET /compute/v2.1/servers/9f07e4bb-f4e9-428e-8feb-db50b3ff2109 => generated 1321 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:16:28.055527 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-67fc1b7b-82e8-4b7c-9f36-a627b23ddad5 tempest-DeleteServersTestJSON-502292925 tempest-DeleteServersTestJSON-502292925-project] Calling method '>' {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:16:28.057746 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.compute.rpcapi [None req-6cbb0337-4fdc-4e52-b042-0802ae4bb78d None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jun 22 10:16:28.065128 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-6cbb0337-4fdc-4e52-b042-0802ae4bb78d None None] Releasing lock "compute-rpcapi-router" {{(pid=117873) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jun 22 10:16:28.065871 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.compute.api [None req-67fc1b7b-82e8-4b7c-9f36-a627b23ddad5 tempest-DeleteServersTestJSON-502292925 tempest-DeleteServersTestJSON-502292925-project] [instance: 8b3f01d1-ac00-4bfb-8ae3-be75720b8ad1] Fetching instance by UUID {{(pid=117874) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:16:28.084238 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-67fc1b7b-82e8-4b7c-9f36-a627b23ddad5 tempest-DeleteServersTestJSON-502292925 tempest-DeleteServersTestJSON-502292925-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:16:28.084691 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-67fc1b7b-82e8-4b7c-9f36-a627b23ddad5 tempest-DeleteServersTestJSON-502292925 tempest-DeleteServersTestJSON-502292925-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:16:28.088367 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-67fc1b7b-82e8-4b7c-9f36-a627b23ddad5 tempest-DeleteServersTestJSON-502292925 tempest-DeleteServersTestJSON-502292925-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:16:28.088849 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-67fc1b7b-82e8-4b7c-9f36-a627b23ddad5 tempest-DeleteServersTestJSON-502292925 tempest-DeleteServersTestJSON-502292925-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:16:28.098127 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [None req-6cbb0337-4fdc-4e52-b042-0802ae4bb78d None None] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.136604 Jun 22 10:16:28.108346 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 48/107] 10.222.0.43 () {64 vars in 1317 bytes} [Wed Jun 22 10:16:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 22 10:16:28.116008 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-8e619044-1bce-4ed1-9752-d66edd30b6db tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Calling method '>' {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:16:28.116975 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.compute.api [None req-8e619044-1bce-4ed1-9752-d66edd30b6db tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] [instance: 5828c9dc-3439-4da7-a94c-f81cbbfdcb99] Fetching instance by UUID {{(pid=117873) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:16:28.125069 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-8e619044-1bce-4ed1-9752-d66edd30b6db tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:16:28.126053 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-8e619044-1bce-4ed1-9752-d66edd30b6db tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:16:28.129086 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-8e619044-1bce-4ed1-9752-d66edd30b6db tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:16:28.129925 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-8e619044-1bce-4ed1-9752-d66edd30b6db tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:16:28.576994 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.policy [None req-67fc1b7b-82e8-4b7c-9f36-a627b23ddad5 tempest-DeleteServersTestJSON-502292925 tempest-DeleteServersTestJSON-502292925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3af9bfaaaa4dcca0747f776115c826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4765b82e21647a9b391a98f446a0e17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117874) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:16:28.589673 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [None req-67fc1b7b-82e8-4b7c-9f36-a627b23ddad5 tempest-DeleteServersTestJSON-502292925 tempest-DeleteServersTestJSON-502292925-project] 10.222.0.43 "GET /compute/v2.1/servers/8b3f01d1-ac00-4bfb-8ae3-be75720b8ad1" status: 200 len: 1314 microversion: 2.1 time: 0.547156 Jun 22 10:16:28.600450 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.policy [None req-8e619044-1bce-4ed1-9752-d66edd30b6db tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7be3d844dcee4d19966fc7944463a0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78629282e2b74418a2c1cdac32576ef1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117873) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:16:28.600767 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 60/108] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:16:28 2022] GET /compute/v2.1/servers/8b3f01d1-ac00-4bfb-8ae3-be75720b8ad1 => generated 1314 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:16:28.606220 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-06be8f9d-0c67-4296-83bb-e828edf32eba tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Calling method '>' {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:16:28.607046 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.compute.api [None req-06be8f9d-0c67-4296-83bb-e828edf32eba tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] [instance: 73dbd5ab-5688-4de4-9da2-0b89d7cefb11] Fetching instance by UUID {{(pid=117874) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:16:28.616018 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-06be8f9d-0c67-4296-83bb-e828edf32eba tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:16:28.616623 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-06be8f9d-0c67-4296-83bb-e828edf32eba tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:16:28.617539 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-06be8f9d-0c67-4296-83bb-e828edf32eba tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:16:28.618364 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-06be8f9d-0c67-4296-83bb-e828edf32eba tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:16:28.621557 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [None req-8e619044-1bce-4ed1-9752-d66edd30b6db tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] 10.222.0.43 "GET /compute/v2.1/servers/5828c9dc-3439-4da7-a94c-f81cbbfdcb99" status: 200 len: 1365 microversion: 2.1 time: 0.510988 Jun 22 10:16:28.626198 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 49/109] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:16:28 2022] GET /compute/v2.1/servers/5828c9dc-3439-4da7-a94c-f81cbbfdcb99 => generated 1365 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:16:28.638663 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-2f6ab39f-b918-47ab-878e-6e4e9ee2ea07 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Calling method '>' {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:16:28.640109 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.compute.api [None req-2f6ab39f-b918-47ab-878e-6e4e9ee2ea07 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] [instance: eb851ab6-0e89-41d2-be52-d76cdc8644d6] Fetching instance by UUID {{(pid=117873) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:16:28.651523 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-2f6ab39f-b918-47ab-878e-6e4e9ee2ea07 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:16:28.652584 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-2f6ab39f-b918-47ab-878e-6e4e9ee2ea07 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:16:28.655475 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-2f6ab39f-b918-47ab-878e-6e4e9ee2ea07 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:16:28.656718 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-2f6ab39f-b918-47ab-878e-6e4e9ee2ea07 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:16:28.917981 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.policy [None req-06be8f9d-0c67-4296-83bb-e828edf32eba tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75753b29a78640df9622d4e2655baf9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee9d603d9cc4a8797f55d544f189720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117874) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:16:28.933853 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.policy [None req-06be8f9d-0c67-4296-83bb-e828edf32eba tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75753b29a78640df9622d4e2655baf9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee9d603d9cc4a8797f55d544f189720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117874) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:16:28.936428 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.policy [None req-06be8f9d-0c67-4296-83bb-e828edf32eba tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75753b29a78640df9622d4e2655baf9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee9d603d9cc4a8797f55d544f189720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117874) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:16:28.938173 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [None req-06be8f9d-0c67-4296-83bb-e828edf32eba tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] 10.222.0.43 "GET /compute/v2.1/servers/73dbd5ab-5688-4de4-9da2-0b89d7cefb11" status: 200 len: 1407 microversion: 2.20 time: 0.336140 Jun 22 10:16:28.940803 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 61/110] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jun 22 10:16:28 2022] GET /compute/v2.1/servers/73dbd5ab-5688-4de4-9da2-0b89d7cefb11 => generated 1407 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 10:16:28.961091 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [req-9b032757-aac3-444a-87f9-022e36bfe833 req-9b452022-9814-4d36-98c0-3c651dc472b6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5828c9dc-3439-4da7-a94c-f81cbbfdcb99", "name": "network-vif-plugged", "status": "completed", "tag": "f9ce6858-55e5-4d8b-b5fe-2cff5d9c4f08"}]} {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:16:28.962641 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.policy [None req-2f6ab39f-b918-47ab-878e-6e4e9ee2ea07 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78fe3fc4334c43d7a5ef6d70f9f57523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad52333bcbec425089c44c3e55df97ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117873) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:16:28.970395 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [None req-2f6ab39f-b918-47ab-878e-6e4e9ee2ea07 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] 10.222.0.43 "GET /compute/v2.1/servers/eb851ab6-0e89-41d2-be52-d76cdc8644d6" status: 200 len: 1363 microversion: 2.1 time: 0.340851 Jun 22 10:16:28.970829 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 50/111] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:16:28 2022] GET /compute/v2.1/servers/eb851ab6-0e89-41d2-be52-d76cdc8644d6 => generated 1363 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:16:28.972162 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [req-9b032757-aac3-444a-87f9-022e36bfe833 req-9b452022-9814-4d36-98c0-3c651dc472b6 service nova] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:16:28.972619 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [req-9b032757-aac3-444a-87f9-022e36bfe833 req-9b452022-9814-4d36-98c0-3c651dc472b6 service nova] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:16:28.985030 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.compute.server_external_events [req-9b032757-aac3-444a-87f9-022e36bfe833 req-9b452022-9814-4d36-98c0-3c651dc472b6 service nova] Creating event network-vif-plugged:f9ce6858-55e5-4d8b-b5fe-2cff5d9c4f08 for instance 5828c9dc-3439-4da7-a94c-f81cbbfdcb99 on hv-cinder-84713 Jun 22 10:16:28.991060 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [req-9b032757-aac3-444a-87f9-022e36bfe833 req-9b452022-9814-4d36-98c0-3c651dc472b6 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048789 Jun 22 10:16:28.992033 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 62/112] 10.222.0.43 () {64 vars in 1317 bytes} [Wed Jun 22 10:16:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 10:16:29.061611 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-4f71a699-bf03-4d2f-9ca0-532c652f002d tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Calling method '>' {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:16:29.062424 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.compute.api [None req-4f71a699-bf03-4d2f-9ca0-532c652f002d tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] [instance: 9f07e4bb-f4e9-428e-8feb-db50b3ff2109] Fetching instance by UUID {{(pid=117873) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:16:29.070767 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-4f71a699-bf03-4d2f-9ca0-532c652f002d tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:16:29.071450 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-4f71a699-bf03-4d2f-9ca0-532c652f002d tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:16:29.072445 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-4f71a699-bf03-4d2f-9ca0-532c652f002d tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:16:29.073853 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-4f71a699-bf03-4d2f-9ca0-532c652f002d tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:16:29.271780 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.policy [None req-4f71a699-bf03-4d2f-9ca0-532c652f002d tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d7292401816437fba46d073c4746e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3277b9cbc4b4a8bbacee8440cea1ed2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117873) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:16:29.274852 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG dbcounter [-] [117873] Writing DB stats nova_cell1:SELECT=100 {{(pid=117873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:16:29.283363 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [None req-4f71a699-bf03-4d2f-9ca0-532c652f002d tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] 10.222.0.43 "GET /compute/v2.1/servers/9f07e4bb-f4e9-428e-8feb-db50b3ff2109" status: 200 len: 1321 microversion: 2.1 time: 0.226347 Jun 22 10:16:29.284707 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 51/113] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:16:29 2022] GET /compute/v2.1/servers/9f07e4bb-f4e9-428e-8feb-db50b3ff2109 => generated 1321 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:16:29.609782 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-10e75dd0-9949-4561-ae43-04da6877f3c3 tempest-DeleteServersTestJSON-502292925 tempest-DeleteServersTestJSON-502292925-project] Calling method '>' {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:16:29.611288 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.compute.api [None req-10e75dd0-9949-4561-ae43-04da6877f3c3 tempest-DeleteServersTestJSON-502292925 tempest-DeleteServersTestJSON-502292925-project] [instance: 8b3f01d1-ac00-4bfb-8ae3-be75720b8ad1] Fetching instance by UUID {{(pid=117874) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:16:29.626826 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-10e75dd0-9949-4561-ae43-04da6877f3c3 tempest-DeleteServersTestJSON-502292925 tempest-DeleteServersTestJSON-502292925-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:16:29.627348 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-10e75dd0-9949-4561-ae43-04da6877f3c3 tempest-DeleteServersTestJSON-502292925 tempest-DeleteServersTestJSON-502292925-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:16:29.628189 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-10e75dd0-9949-4561-ae43-04da6877f3c3 tempest-DeleteServersTestJSON-502292925 tempest-DeleteServersTestJSON-502292925-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:16:29.628805 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-10e75dd0-9949-4561-ae43-04da6877f3c3 tempest-DeleteServersTestJSON-502292925 tempest-DeleteServersTestJSON-502292925-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:16:29.640582 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-e8561b0f-33e8-431e-ad9b-14dd6c1c49bf tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Calling method '>' {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:16:29.641294 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.compute.api [None req-e8561b0f-33e8-431e-ad9b-14dd6c1c49bf tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] [instance: 5828c9dc-3439-4da7-a94c-f81cbbfdcb99] Fetching instance by UUID {{(pid=117873) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:16:29.656866 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-e8561b0f-33e8-431e-ad9b-14dd6c1c49bf tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:16:29.657535 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-e8561b0f-33e8-431e-ad9b-14dd6c1c49bf tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:16:29.658478 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-e8561b0f-33e8-431e-ad9b-14dd6c1c49bf tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:16:29.659848 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-e8561b0f-33e8-431e-ad9b-14dd6c1c49bf tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:16:29.962393 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.policy [None req-10e75dd0-9949-4561-ae43-04da6877f3c3 tempest-DeleteServersTestJSON-502292925 tempest-DeleteServersTestJSON-502292925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3af9bfaaaa4dcca0747f776115c826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4765b82e21647a9b391a98f446a0e17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117874) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:16:29.980227 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [None req-10e75dd0-9949-4561-ae43-04da6877f3c3 tempest-DeleteServersTestJSON-502292925 tempest-DeleteServersTestJSON-502292925-project] 10.222.0.43 "GET /compute/v2.1/servers/8b3f01d1-ac00-4bfb-8ae3-be75720b8ad1" status: 200 len: 1314 microversion: 2.1 time: 0.375753 Jun 22 10:16:29.981013 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 63/114] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:16:29 2022] GET /compute/v2.1/servers/8b3f01d1-ac00-4bfb-8ae3-be75720b8ad1 => generated 1314 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:16:29.986293 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-3f83d6f6-b894-4c04-8804-b3764e20ddd0 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Calling method '>' {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:16:29.987057 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.compute.api [None req-3f83d6f6-b894-4c04-8804-b3764e20ddd0 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] [instance: 73dbd5ab-5688-4de4-9da2-0b89d7cefb11] Fetching instance by UUID {{(pid=117874) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:16:29.993416 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-3f83d6f6-b894-4c04-8804-b3764e20ddd0 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:16:29.994080 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-3f83d6f6-b894-4c04-8804-b3764e20ddd0 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:16:29.995297 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-3f83d6f6-b894-4c04-8804-b3764e20ddd0 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:16:29.995939 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-3f83d6f6-b894-4c04-8804-b3764e20ddd0 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:16:30.009791 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.policy [None req-e8561b0f-33e8-431e-ad9b-14dd6c1c49bf tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7be3d844dcee4d19966fc7944463a0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78629282e2b74418a2c1cdac32576ef1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117873) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:16:30.019431 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [None req-e8561b0f-33e8-431e-ad9b-14dd6c1c49bf tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] 10.222.0.43 "GET /compute/v2.1/servers/5828c9dc-3439-4da7-a94c-f81cbbfdcb99" status: 200 len: 1365 microversion: 2.1 time: 0.382704 Jun 22 10:16:30.020248 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 52/115] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:16:29 2022] GET /compute/v2.1/servers/5828c9dc-3439-4da7-a94c-f81cbbfdcb99 => generated 1365 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 10:16:30.031964 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-0b32dfd7-00bd-46d1-a6b7-e799a9e4e052 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Calling method '>' {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:16:30.033860 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.compute.api [None req-0b32dfd7-00bd-46d1-a6b7-e799a9e4e052 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] [instance: eb851ab6-0e89-41d2-be52-d76cdc8644d6] Fetching instance by UUID {{(pid=117873) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:16:30.042912 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-0b32dfd7-00bd-46d1-a6b7-e799a9e4e052 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:16:30.043650 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-0b32dfd7-00bd-46d1-a6b7-e799a9e4e052 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:16:30.045476 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-0b32dfd7-00bd-46d1-a6b7-e799a9e4e052 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:16:30.046252 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-0b32dfd7-00bd-46d1-a6b7-e799a9e4e052 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:16:30.331085 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.policy [None req-0b32dfd7-00bd-46d1-a6b7-e799a9e4e052 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78fe3fc4334c43d7a5ef6d70f9f57523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad52333bcbec425089c44c3e55df97ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117873) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:16:30.341875 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [None req-0b32dfd7-00bd-46d1-a6b7-e799a9e4e052 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] 10.222.0.43 "GET /compute/v2.1/servers/eb851ab6-0e89-41d2-be52-d76cdc8644d6" status: 200 len: 1363 microversion: 2.1 time: 0.320319 Jun 22 10:16:30.342689 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 53/116] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:16:30 2022] GET /compute/v2.1/servers/eb851ab6-0e89-41d2-be52-d76cdc8644d6 => generated 1363 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:16:30.358133 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-70449a97-1acd-4c5d-b21b-b0eaba9f1559 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Calling method '>' {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:16:30.358938 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.compute.api [None req-70449a97-1acd-4c5d-b21b-b0eaba9f1559 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] [instance: 9f07e4bb-f4e9-428e-8feb-db50b3ff2109] Fetching instance by UUID {{(pid=117873) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:16:30.359300 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.policy [None req-3f83d6f6-b894-4c04-8804-b3764e20ddd0 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75753b29a78640df9622d4e2655baf9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee9d603d9cc4a8797f55d544f189720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117874) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:16:30.366470 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-70449a97-1acd-4c5d-b21b-b0eaba9f1559 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:16:30.367144 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-70449a97-1acd-4c5d-b21b-b0eaba9f1559 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:16:30.368071 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-70449a97-1acd-4c5d-b21b-b0eaba9f1559 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:16:30.368727 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-70449a97-1acd-4c5d-b21b-b0eaba9f1559 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:16:30.380598 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.policy [None req-3f83d6f6-b894-4c04-8804-b3764e20ddd0 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75753b29a78640df9622d4e2655baf9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee9d603d9cc4a8797f55d544f189720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117874) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:16:30.383472 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.policy [None req-3f83d6f6-b894-4c04-8804-b3764e20ddd0 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75753b29a78640df9622d4e2655baf9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee9d603d9cc4a8797f55d544f189720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117874) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:16:30.385677 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [None req-3f83d6f6-b894-4c04-8804-b3764e20ddd0 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] 10.222.0.43 "GET /compute/v2.1/servers/73dbd5ab-5688-4de4-9da2-0b89d7cefb11" status: 200 len: 1407 microversion: 2.20 time: 0.403574 Jun 22 10:16:30.386597 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 64/117] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jun 22 10:16:29 2022] GET /compute/v2.1/servers/73dbd5ab-5688-4de4-9da2-0b89d7cefb11 => generated 1407 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 10:16:30.669506 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.policy [None req-70449a97-1acd-4c5d-b21b-b0eaba9f1559 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d7292401816437fba46d073c4746e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3277b9cbc4b4a8bbacee8440cea1ed2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117873) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:16:30.685619 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [None req-70449a97-1acd-4c5d-b21b-b0eaba9f1559 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] 10.222.0.43 "GET /compute/v2.1/servers/9f07e4bb-f4e9-428e-8feb-db50b3ff2109" status: 200 len: 1321 microversion: 2.1 time: 0.341729 Jun 22 10:16:30.692884 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 54/118] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:16:30 2022] GET /compute/v2.1/servers/9f07e4bb-f4e9-428e-8feb-db50b3ff2109 => generated 1321 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:16:30.996989 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-c35e5b12-666f-49cd-8c44-037793856d47 tempest-DeleteServersTestJSON-502292925 tempest-DeleteServersTestJSON-502292925-project] Calling method '>' {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:16:30.998223 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.compute.api [None req-c35e5b12-666f-49cd-8c44-037793856d47 tempest-DeleteServersTestJSON-502292925 tempest-DeleteServersTestJSON-502292925-project] [instance: 8b3f01d1-ac00-4bfb-8ae3-be75720b8ad1] Fetching instance by UUID {{(pid=117874) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:16:31.006601 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-c35e5b12-666f-49cd-8c44-037793856d47 tempest-DeleteServersTestJSON-502292925 tempest-DeleteServersTestJSON-502292925-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:16:31.007305 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-c35e5b12-666f-49cd-8c44-037793856d47 tempest-DeleteServersTestJSON-502292925 tempest-DeleteServersTestJSON-502292925-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:16:31.008270 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-c35e5b12-666f-49cd-8c44-037793856d47 tempest-DeleteServersTestJSON-502292925 tempest-DeleteServersTestJSON-502292925-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:16:31.008878 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-c35e5b12-666f-49cd-8c44-037793856d47 tempest-DeleteServersTestJSON-502292925 tempest-DeleteServersTestJSON-502292925-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:16:31.012731 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [req-d23d52b2-605c-4198-ae77-c44e05ed5a6e req-60975566-1a4d-4567-a33b-2e02e61125bc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a8d495ae-295a-4ffa-a2d9-5774249e687d", "name": "network-vif-plugged", "status": "completed", "tag": "fae1b3df-59c5-40aa-9acc-2d668ec3c54d"}]} {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:16:31.014903 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG dbcounter [-] [117874] Writing DB stats nova_cell1:SELECT=100 {{(pid=117874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:16:31.028204 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [req-d23d52b2-605c-4198-ae77-c44e05ed5a6e req-60975566-1a4d-4567-a33b-2e02e61125bc service nova] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:16:31.028889 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [req-d23d52b2-605c-4198-ae77-c44e05ed5a6e req-60975566-1a4d-4567-a33b-2e02e61125bc service nova] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:16:31.044948 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.compute.server_external_events [req-d23d52b2-605c-4198-ae77-c44e05ed5a6e req-60975566-1a4d-4567-a33b-2e02e61125bc service nova] Creating event network-vif-plugged:fae1b3df-59c5-40aa-9acc-2d668ec3c54d for instance a8d495ae-295a-4ffa-a2d9-5774249e687d on hv-cinder-84713 Jun 22 10:16:31.059412 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [req-d23d52b2-605c-4198-ae77-c44e05ed5a6e req-60975566-1a4d-4567-a33b-2e02e61125bc service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050034 Jun 22 10:16:31.061552 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 55/119] 10.222.0.43 () {64 vars in 1317 bytes} [Wed Jun 22 10:16:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 22 10:16:31.068072 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-7c8ed37c-2ed4-4ee1-90d8-f47165720852 tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Calling method '>' {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:16:31.069102 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.compute.api [None req-7c8ed37c-2ed4-4ee1-90d8-f47165720852 tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] [instance: 5828c9dc-3439-4da7-a94c-f81cbbfdcb99] Fetching instance by UUID {{(pid=117873) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:16:31.081173 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-7c8ed37c-2ed4-4ee1-90d8-f47165720852 tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:16:31.082173 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-7c8ed37c-2ed4-4ee1-90d8-f47165720852 tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:16:31.084016 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-7c8ed37c-2ed4-4ee1-90d8-f47165720852 tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:16:31.084661 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-7c8ed37c-2ed4-4ee1-90d8-f47165720852 tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:16:31.160357 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG dbcounter [-] [117874] Writing DB stats nova_cell0:SELECT=6 {{(pid=117874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:16:31.299647 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.policy [None req-c35e5b12-666f-49cd-8c44-037793856d47 tempest-DeleteServersTestJSON-502292925 tempest-DeleteServersTestJSON-502292925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3af9bfaaaa4dcca0747f776115c826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4765b82e21647a9b391a98f446a0e17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117874) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:16:31.314246 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [None req-c35e5b12-666f-49cd-8c44-037793856d47 tempest-DeleteServersTestJSON-502292925 tempest-DeleteServersTestJSON-502292925-project] 10.222.0.43 "GET /compute/v2.1/servers/8b3f01d1-ac00-4bfb-8ae3-be75720b8ad1" status: 200 len: 1501 microversion: 2.1 time: 0.321130 Jun 22 10:16:31.323461 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 65/120] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:16:30 2022] GET /compute/v2.1/servers/8b3f01d1-ac00-4bfb-8ae3-be75720b8ad1 => generated 1501 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:16:31.361026 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-9f2f761e-5ec7-41ec-aca8-a6b461b518d4 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Calling method '>' {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:16:31.362245 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.compute.api [None req-9f2f761e-5ec7-41ec-aca8-a6b461b518d4 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] [instance: eb851ab6-0e89-41d2-be52-d76cdc8644d6] Fetching instance by UUID {{(pid=117874) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:16:31.395786 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-9f2f761e-5ec7-41ec-aca8-a6b461b518d4 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:16:31.396236 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-9f2f761e-5ec7-41ec-aca8-a6b461b518d4 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:16:31.397008 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-9f2f761e-5ec7-41ec-aca8-a6b461b518d4 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:16:31.397438 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-9f2f761e-5ec7-41ec-aca8-a6b461b518d4 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:16:31.445588 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.policy [None req-7c8ed37c-2ed4-4ee1-90d8-f47165720852 tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7be3d844dcee4d19966fc7944463a0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78629282e2b74418a2c1cdac32576ef1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117873) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:16:31.456953 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [None req-7c8ed37c-2ed4-4ee1-90d8-f47165720852 tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] 10.222.0.43 "GET /compute/v2.1/servers/5828c9dc-3439-4da7-a94c-f81cbbfdcb99" status: 200 len: 1365 microversion: 2.1 time: 0.393945 Jun 22 10:16:31.470878 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 56/121] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:16:31 2022] GET /compute/v2.1/servers/5828c9dc-3439-4da7-a94c-f81cbbfdcb99 => generated 1365 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:16:31.482956 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-bdeb9622-583f-440c-85e9-b66136993d49 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Calling method '>' {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:16:31.489856 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.compute.api [None req-bdeb9622-583f-440c-85e9-b66136993d49 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] [instance: 73dbd5ab-5688-4de4-9da2-0b89d7cefb11] Fetching instance by UUID {{(pid=117873) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:16:31.500078 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-bdeb9622-583f-440c-85e9-b66136993d49 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:16:31.503629 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-bdeb9622-583f-440c-85e9-b66136993d49 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:16:31.509862 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-bdeb9622-583f-440c-85e9-b66136993d49 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:16:31.510559 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-bdeb9622-583f-440c-85e9-b66136993d49 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:16:31.876701 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.policy [None req-9f2f761e-5ec7-41ec-aca8-a6b461b518d4 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78fe3fc4334c43d7a5ef6d70f9f57523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad52333bcbec425089c44c3e55df97ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117874) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:16:31.888341 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [None req-9f2f761e-5ec7-41ec-aca8-a6b461b518d4 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] 10.222.0.43 "GET /compute/v2.1/servers/eb851ab6-0e89-41d2-be52-d76cdc8644d6" status: 200 len: 1363 microversion: 2.1 time: 0.530209 Jun 22 10:16:31.890425 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 66/122] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:16:31 2022] GET /compute/v2.1/servers/eb851ab6-0e89-41d2-be52-d76cdc8644d6 => generated 1363 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 10:16:31.900885 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-80ac36e8-8261-4a4d-a99d-9ee14ff5bffe tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Calling method '>' {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:16:31.904895 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.compute.api [None req-80ac36e8-8261-4a4d-a99d-9ee14ff5bffe tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] [instance: 9f07e4bb-f4e9-428e-8feb-db50b3ff2109] Fetching instance by UUID {{(pid=117874) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:16:31.921300 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-80ac36e8-8261-4a4d-a99d-9ee14ff5bffe tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:16:31.922109 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-80ac36e8-8261-4a4d-a99d-9ee14ff5bffe tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:16:31.923314 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-80ac36e8-8261-4a4d-a99d-9ee14ff5bffe tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:16:31.933468 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-80ac36e8-8261-4a4d-a99d-9ee14ff5bffe tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:16:31.947103 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.policy [None req-bdeb9622-583f-440c-85e9-b66136993d49 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75753b29a78640df9622d4e2655baf9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee9d603d9cc4a8797f55d544f189720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117873) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:16:31.959569 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.policy [None req-bdeb9622-583f-440c-85e9-b66136993d49 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75753b29a78640df9622d4e2655baf9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee9d603d9cc4a8797f55d544f189720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117873) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:16:31.961033 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.policy [None req-bdeb9622-583f-440c-85e9-b66136993d49 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75753b29a78640df9622d4e2655baf9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee9d603d9cc4a8797f55d544f189720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117873) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:16:31.965026 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [None req-bdeb9622-583f-440c-85e9-b66136993d49 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] 10.222.0.43 "GET /compute/v2.1/servers/73dbd5ab-5688-4de4-9da2-0b89d7cefb11" status: 200 len: 1407 microversion: 2.20 time: 0.489901 Jun 22 10:16:31.966262 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 57/123] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jun 22 10:16:31 2022] GET /compute/v2.1/servers/73dbd5ab-5688-4de4-9da2-0b89d7cefb11 => generated 1407 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 10:16:32.231751 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.policy [None req-80ac36e8-8261-4a4d-a99d-9ee14ff5bffe tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d7292401816437fba46d073c4746e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3277b9cbc4b4a8bbacee8440cea1ed2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117874) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:16:32.240004 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [None req-80ac36e8-8261-4a4d-a99d-9ee14ff5bffe tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] 10.222.0.43 "GET /compute/v2.1/servers/9f07e4bb-f4e9-428e-8feb-db50b3ff2109" status: 200 len: 1321 microversion: 2.1 time: 0.348340 Jun 22 10:16:32.241129 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 67/124] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:16:31 2022] GET /compute/v2.1/servers/9f07e4bb-f4e9-428e-8feb-db50b3ff2109 => generated 1321 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:16:32.478616 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-fea72341-e158-4fff-8be0-365bb7ebd6cd tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Calling method '>' {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:16:32.479548 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.compute.api [None req-fea72341-e158-4fff-8be0-365bb7ebd6cd tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] [instance: 5828c9dc-3439-4da7-a94c-f81cbbfdcb99] Fetching instance by UUID {{(pid=117873) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:16:32.494881 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-fea72341-e158-4fff-8be0-365bb7ebd6cd tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:16:32.495334 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-fea72341-e158-4fff-8be0-365bb7ebd6cd tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:16:32.502691 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-fea72341-e158-4fff-8be0-365bb7ebd6cd tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:16:32.503141 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-fea72341-e158-4fff-8be0-365bb7ebd6cd tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:16:32.785212 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.policy [None req-fea72341-e158-4fff-8be0-365bb7ebd6cd tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7be3d844dcee4d19966fc7944463a0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78629282e2b74418a2c1cdac32576ef1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117873) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:16:32.797560 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [None req-fea72341-e158-4fff-8be0-365bb7ebd6cd tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] 10.222.0.43 "GET /compute/v2.1/servers/5828c9dc-3439-4da7-a94c-f81cbbfdcb99" status: 200 len: 1365 microversion: 2.1 time: 0.323761 Jun 22 10:16:32.799979 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 58/125] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:16:32 2022] GET /compute/v2.1/servers/5828c9dc-3439-4da7-a94c-f81cbbfdcb99 => generated 1365 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 10:16:32.908785 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-32b01b2f-ecdd-4b91-bd14-21f76e0e5ff7 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Calling method '>' {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:16:32.909733 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.compute.api [None req-32b01b2f-ecdd-4b91-bd14-21f76e0e5ff7 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] [instance: eb851ab6-0e89-41d2-be52-d76cdc8644d6] Fetching instance by UUID {{(pid=117874) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:16:32.916645 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG dbcounter [-] [117874] Writing DB stats nova_cell0:SELECT=8 {{(pid=117874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:16:32.919339 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-32b01b2f-ecdd-4b91-bd14-21f76e0e5ff7 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:16:32.920040 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-32b01b2f-ecdd-4b91-bd14-21f76e0e5ff7 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:16:32.921000 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-32b01b2f-ecdd-4b91-bd14-21f76e0e5ff7 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:16:32.921863 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-32b01b2f-ecdd-4b91-bd14-21f76e0e5ff7 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:16:32.995176 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-1d2ac722-ce18-4f91-86b2-f89f87d36498 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Calling method '>' {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:16:32.995902 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.compute.api [None req-1d2ac722-ce18-4f91-86b2-f89f87d36498 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] [instance: 73dbd5ab-5688-4de4-9da2-0b89d7cefb11] Fetching instance by UUID {{(pid=117873) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:16:33.004225 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-1d2ac722-ce18-4f91-86b2-f89f87d36498 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:16:33.004677 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-1d2ac722-ce18-4f91-86b2-f89f87d36498 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:16:33.005637 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-1d2ac722-ce18-4f91-86b2-f89f87d36498 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:16:33.007101 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-1d2ac722-ce18-4f91-86b2-f89f87d36498 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:16:33.641284 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.policy [None req-32b01b2f-ecdd-4b91-bd14-21f76e0e5ff7 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78fe3fc4334c43d7a5ef6d70f9f57523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad52333bcbec425089c44c3e55df97ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117874) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:16:33.654303 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [None req-32b01b2f-ecdd-4b91-bd14-21f76e0e5ff7 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] 10.222.0.43 "GET /compute/v2.1/servers/eb851ab6-0e89-41d2-be52-d76cdc8644d6" status: 200 len: 1363 microversion: 2.1 time: 0.748640 Jun 22 10:16:33.655161 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 68/126] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:16:32 2022] GET /compute/v2.1/servers/eb851ab6-0e89-41d2-be52-d76cdc8644d6 => generated 1363 bytes in 753 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:16:33.661651 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.policy [None req-1d2ac722-ce18-4f91-86b2-f89f87d36498 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75753b29a78640df9622d4e2655baf9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee9d603d9cc4a8797f55d544f189720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117873) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:16:33.671988 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.policy [None req-1d2ac722-ce18-4f91-86b2-f89f87d36498 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75753b29a78640df9622d4e2655baf9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee9d603d9cc4a8797f55d544f189720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117873) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:16:33.675202 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-ae04c768-de96-4656-893b-057ce8d2c1c9 tempest-DeleteServersTestJSON-502292925 tempest-DeleteServersTestJSON-502292925-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "689b7d21-e407-4479-96ce-e02b22f7eaef"}} {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:16:33.677155 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.policy [None req-1d2ac722-ce18-4f91-86b2-f89f87d36498 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75753b29a78640df9622d4e2655baf9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee9d603d9cc4a8797f55d544f189720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117873) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:16:33.678517 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [None req-1d2ac722-ce18-4f91-86b2-f89f87d36498 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] 10.222.0.43 "GET /compute/v2.1/servers/73dbd5ab-5688-4de4-9da2-0b89d7cefb11" status: 200 len: 1407 microversion: 2.20 time: 0.694403 Jun 22 10:16:33.679905 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.compute.api [None req-ae04c768-de96-4656-893b-057ce8d2c1c9 tempest-DeleteServersTestJSON-502292925 tempest-DeleteServersTestJSON-502292925-project] [instance: 8b3f01d1-ac00-4bfb-8ae3-be75720b8ad1] Fetching instance by UUID {{(pid=117874) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:16:33.680959 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 59/127] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jun 22 10:16:32 2022] GET /compute/v2.1/servers/73dbd5ab-5688-4de4-9da2-0b89d7cefb11 => generated 1407 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 22 10:16:33.685556 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [req-47e9aeb8-0ed1-46d7-b216-34f3c8c6c757 req-01536d58-a6bb-473d-aca7-1607749eaf21 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "73dbd5ab-5688-4de4-9da2-0b89d7cefb11", "name": "network-vif-plugged", "status": "completed", "tag": "468a7090-7d3f-43e5-8303-b6f8870ced56"}]} {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:16:33.714978 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-ae04c768-de96-4656-893b-057ce8d2c1c9 tempest-DeleteServersTestJSON-502292925 tempest-DeleteServersTestJSON-502292925-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:16:33.715583 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-ae04c768-de96-4656-893b-057ce8d2c1c9 tempest-DeleteServersTestJSON-502292925 tempest-DeleteServersTestJSON-502292925-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:16:33.716450 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-ae04c768-de96-4656-893b-057ce8d2c1c9 tempest-DeleteServersTestJSON-502292925 tempest-DeleteServersTestJSON-502292925-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:16:33.716601 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [req-47e9aeb8-0ed1-46d7-b216-34f3c8c6c757 req-01536d58-a6bb-473d-aca7-1607749eaf21 service nova] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:16:33.717082 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-ae04c768-de96-4656-893b-057ce8d2c1c9 tempest-DeleteServersTestJSON-502292925 tempest-DeleteServersTestJSON-502292925-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:16:33.717343 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [req-47e9aeb8-0ed1-46d7-b216-34f3c8c6c757 req-01536d58-a6bb-473d-aca7-1607749eaf21 service nova] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:16:33.737008 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.compute.server_external_events [req-47e9aeb8-0ed1-46d7-b216-34f3c8c6c757 req-01536d58-a6bb-473d-aca7-1607749eaf21 service nova] Creating event network-vif-plugged:468a7090-7d3f-43e5-8303-b6f8870ced56 for instance 73dbd5ab-5688-4de4-9da2-0b89d7cefb11 on hv-cinder-84713 Jun 22 10:16:33.745501 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [req-47e9aeb8-0ed1-46d7-b216-34f3c8c6c757 req-01536d58-a6bb-473d-aca7-1607749eaf21 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063199 Jun 22 10:16:33.751606 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 60/128] 10.222.0.43 () {64 vars in 1317 bytes} [Wed Jun 22 10:16:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 10:16:33.762957 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-9d864acf-9ca0-4730-856e-6ee713dc5b30 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Calling method '>' {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:16:33.763913 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.compute.api [None req-9d864acf-9ca0-4730-856e-6ee713dc5b30 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] [instance: 9f07e4bb-f4e9-428e-8feb-db50b3ff2109] Fetching instance by UUID {{(pid=117873) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:16:33.778038 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-9d864acf-9ca0-4730-856e-6ee713dc5b30 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:16:33.778666 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-9d864acf-9ca0-4730-856e-6ee713dc5b30 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:16:33.782996 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-9d864acf-9ca0-4730-856e-6ee713dc5b30 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:16:33.786127 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-9d864acf-9ca0-4730-856e-6ee713dc5b30 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:16:34.076592 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.policy [None req-9d864acf-9ca0-4730-856e-6ee713dc5b30 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d7292401816437fba46d073c4746e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3277b9cbc4b4a8bbacee8440cea1ed2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117873) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:16:34.089707 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [None req-9d864acf-9ca0-4730-856e-6ee713dc5b30 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] 10.222.0.43 "GET /compute/v2.1/servers/9f07e4bb-f4e9-428e-8feb-db50b3ff2109" status: 200 len: 1321 microversion: 2.1 time: 0.336272 Jun 22 10:16:34.091328 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 61/129] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:16:33 2022] GET /compute/v2.1/servers/9f07e4bb-f4e9-428e-8feb-db50b3ff2109 => generated 1321 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:16:34.098205 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-6c0f5050-1854-44fb-91ce-f6f5b02627ff tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Calling method '>' {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:16:34.099788 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.compute.api [None req-6c0f5050-1854-44fb-91ce-f6f5b02627ff tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] [instance: 5828c9dc-3439-4da7-a94c-f81cbbfdcb99] Fetching instance by UUID {{(pid=117873) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:16:34.109465 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-6c0f5050-1854-44fb-91ce-f6f5b02627ff tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:16:34.110044 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-6c0f5050-1854-44fb-91ce-f6f5b02627ff tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:16:34.111225 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-6c0f5050-1854-44fb-91ce-f6f5b02627ff tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:16:34.112262 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-6c0f5050-1854-44fb-91ce-f6f5b02627ff tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:16:34.322664 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.policy [None req-6c0f5050-1854-44fb-91ce-f6f5b02627ff tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7be3d844dcee4d19966fc7944463a0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78629282e2b74418a2c1cdac32576ef1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117873) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:16:34.330036 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [None req-6c0f5050-1854-44fb-91ce-f6f5b02627ff tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] 10.222.0.43 "GET /compute/v2.1/servers/5828c9dc-3439-4da7-a94c-f81cbbfdcb99" status: 200 len: 1554 microversion: 2.1 time: 0.237096 Jun 22 10:16:34.330622 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 62/130] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:16:34 2022] GET /compute/v2.1/servers/5828c9dc-3439-4da7-a94c-f81cbbfdcb99 => generated 1554 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:16:34.346660 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-eac81c96-5c27-410a-b12d-f5000841420e tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Calling method '>' {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:16:34.347310 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.compute.api [None req-eac81c96-5c27-410a-b12d-f5000841420e tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] [instance: 5828c9dc-3439-4da7-a94c-f81cbbfdcb99] Fetching instance by UUID {{(pid=117873) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:16:34.353232 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-eac81c96-5c27-410a-b12d-f5000841420e tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:16:34.353679 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-eac81c96-5c27-410a-b12d-f5000841420e tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:16:34.354724 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-eac81c96-5c27-410a-b12d-f5000841420e tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:16:34.355166 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-eac81c96-5c27-410a-b12d-f5000841420e tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:16:34.471864 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [None req-eac81c96-5c27-410a-b12d-f5000841420e tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] 10.222.0.43 "GET /compute/v2.1/servers/5828c9dc-3439-4da7-a94c-f81cbbfdcb99/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.129082 Jun 22 10:16:34.472553 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 63/131] 10.222.0.43 () {58 vars in 1274 bytes} [Wed Jun 22 10:16:34 2022] GET /compute/v2.1/servers/5828c9dc-3439-4da7-a94c-f81cbbfdcb99/os-interface => generated 284 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 22 10:16:34.677402 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-7da2cf8e-294c-4ba9-a0ee-d37b289f3ac7 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Calling method '>' {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:16:34.678714 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.compute.api [None req-7da2cf8e-294c-4ba9-a0ee-d37b289f3ac7 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] [instance: eb851ab6-0e89-41d2-be52-d76cdc8644d6] Fetching instance by UUID {{(pid=117873) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:16:34.689848 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-7da2cf8e-294c-4ba9-a0ee-d37b289f3ac7 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:16:34.690286 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-7da2cf8e-294c-4ba9-a0ee-d37b289f3ac7 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:16:34.691057 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-7da2cf8e-294c-4ba9-a0ee-d37b289f3ac7 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:16:34.691487 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-7da2cf8e-294c-4ba9-a0ee-d37b289f3ac7 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:16:34.852099 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [None req-ae04c768-de96-4656-893b-057ce8d2c1c9 tempest-DeleteServersTestJSON-502292925 tempest-DeleteServersTestJSON-502292925-project] 10.222.0.43 "POST /compute/v2.1/servers/8b3f01d1-ac00-4bfb-8ae3-be75720b8ad1/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.193474 Jun 22 10:16:34.853419 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 69/132] 10.222.0.43 () {60 vars in 1322 bytes} [Wed Jun 22 10:16:33 2022] POST /compute/v2.1/servers/8b3f01d1-ac00-4bfb-8ae3-be75720b8ad1/os-volume_attachments => generated 194 bytes in 1197 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 10:16:34.874793 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-ba43c243-bd4b-4f86-b622-76bde64bf3cc tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Calling method '>' {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:16:34.879944 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.compute.api [None req-ba43c243-bd4b-4f86-b622-76bde64bf3cc tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] [instance: 73dbd5ab-5688-4de4-9da2-0b89d7cefb11] Fetching instance by UUID {{(pid=117874) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:16:34.899745 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-ba43c243-bd4b-4f86-b622-76bde64bf3cc tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:16:34.900477 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-ba43c243-bd4b-4f86-b622-76bde64bf3cc tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:16:34.901571 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-ba43c243-bd4b-4f86-b622-76bde64bf3cc tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:16:34.902324 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-ba43c243-bd4b-4f86-b622-76bde64bf3cc tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:16:35.308863 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.policy [None req-7da2cf8e-294c-4ba9-a0ee-d37b289f3ac7 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78fe3fc4334c43d7a5ef6d70f9f57523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad52333bcbec425089c44c3e55df97ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117873) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:16:35.320256 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [None req-7da2cf8e-294c-4ba9-a0ee-d37b289f3ac7 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] 10.222.0.43 "GET /compute/v2.1/servers/eb851ab6-0e89-41d2-be52-d76cdc8644d6" status: 200 len: 1363 microversion: 2.1 time: 0.651488 Jun 22 10:16:35.321188 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 64/133] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:16:34 2022] GET /compute/v2.1/servers/eb851ab6-0e89-41d2-be52-d76cdc8644d6 => generated 1363 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 10:16:35.336753 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-c24092df-952d-42c7-ba44-4e8d3c8ce59a tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Calling method '>' {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:16:35.342250 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.compute.api [None req-c24092df-952d-42c7-ba44-4e8d3c8ce59a tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] [instance: 9f07e4bb-f4e9-428e-8feb-db50b3ff2109] Fetching instance by UUID {{(pid=117873) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:16:35.350598 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-c24092df-952d-42c7-ba44-4e8d3c8ce59a tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:16:35.351275 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-c24092df-952d-42c7-ba44-4e8d3c8ce59a tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:16:35.352221 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-c24092df-952d-42c7-ba44-4e8d3c8ce59a tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:16:35.352806 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-c24092df-952d-42c7-ba44-4e8d3c8ce59a tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:16:35.475344 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.policy [None req-ba43c243-bd4b-4f86-b622-76bde64bf3cc tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75753b29a78640df9622d4e2655baf9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee9d603d9cc4a8797f55d544f189720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117874) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:16:35.486875 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.policy [None req-ba43c243-bd4b-4f86-b622-76bde64bf3cc tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75753b29a78640df9622d4e2655baf9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee9d603d9cc4a8797f55d544f189720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117874) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:16:35.488280 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.policy [None req-ba43c243-bd4b-4f86-b622-76bde64bf3cc tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75753b29a78640df9622d4e2655baf9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee9d603d9cc4a8797f55d544f189720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117874) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:16:35.489825 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [None req-ba43c243-bd4b-4f86-b622-76bde64bf3cc tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] 10.222.0.43 "GET /compute/v2.1/servers/73dbd5ab-5688-4de4-9da2-0b89d7cefb11" status: 200 len: 1407 microversion: 2.20 time: 0.634331 Jun 22 10:16:35.502927 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 70/134] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jun 22 10:16:34 2022] GET /compute/v2.1/servers/73dbd5ab-5688-4de4-9da2-0b89d7cefb11 => generated 1407 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 10:16:35.767020 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [req-7bd7adb3-0999-4958-84d2-3ab37353685e req-960dcae3-5b7f-495c-a6a3-a20349b969a7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eb851ab6-0e89-41d2-be52-d76cdc8644d6", "name": "network-vif-plugged", "status": "completed", "tag": "d017dd0e-ef63-4ffa-af06-35b32a6bf63f"}, {"server_uuid": "9f07e4bb-f4e9-428e-8feb-db50b3ff2109", "name": "network-vif-plugged", "status": "completed", "tag": "211d6c80-be72-4645-8f0a-ec8e4b68c761"}]} {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:16:35.776640 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [req-7bd7adb3-0999-4958-84d2-3ab37353685e req-960dcae3-5b7f-495c-a6a3-a20349b969a7 service nova] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:16:35.777081 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [req-7bd7adb3-0999-4958-84d2-3ab37353685e req-960dcae3-5b7f-495c-a6a3-a20349b969a7 service nova] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:16:35.790417 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.compute.server_external_events [req-7bd7adb3-0999-4958-84d2-3ab37353685e req-960dcae3-5b7f-495c-a6a3-a20349b969a7 service nova] Creating event network-vif-plugged:d017dd0e-ef63-4ffa-af06-35b32a6bf63f for instance eb851ab6-0e89-41d2-be52-d76cdc8644d6 on hv-cinder-84713 Jun 22 10:16:35.791016 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.compute.server_external_events [req-7bd7adb3-0999-4958-84d2-3ab37353685e req-960dcae3-5b7f-495c-a6a3-a20349b969a7 service nova] Creating event network-vif-plugged:211d6c80-be72-4645-8f0a-ec8e4b68c761 for instance 9f07e4bb-f4e9-428e-8feb-db50b3ff2109 on hv-cinder-84713 Jun 22 10:16:35.797337 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [req-7bd7adb3-0999-4958-84d2-3ab37353685e req-960dcae3-5b7f-495c-a6a3-a20349b969a7 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.034218 Jun 22 10:16:35.799059 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 71/135] 10.222.0.43 () {64 vars in 1317 bytes} [Wed Jun 22 10:16:35 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 22 10:16:35.946641 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.policy [None req-c24092df-952d-42c7-ba44-4e8d3c8ce59a tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d7292401816437fba46d073c4746e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3277b9cbc4b4a8bbacee8440cea1ed2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117873) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:16:35.962690 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [None req-c24092df-952d-42c7-ba44-4e8d3c8ce59a tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] 10.222.0.43 "GET /compute/v2.1/servers/9f07e4bb-f4e9-428e-8feb-db50b3ff2109" status: 200 len: 1321 microversion: 2.1 time: 0.640400 Jun 22 10:16:35.963434 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 65/136] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:16:35 2022] GET /compute/v2.1/servers/9f07e4bb-f4e9-428e-8feb-db50b3ff2109 => generated 1321 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:16:36.341769 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-9a30b39b-b4b6-4af9-9f8f-781aea3e31e0 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Calling method '>' {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:16:36.343100 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.compute.api [None req-9a30b39b-b4b6-4af9-9f8f-781aea3e31e0 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] [instance: eb851ab6-0e89-41d2-be52-d76cdc8644d6] Fetching instance by UUID {{(pid=117874) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:16:36.350175 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-9a30b39b-b4b6-4af9-9f8f-781aea3e31e0 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:16:36.350838 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-9a30b39b-b4b6-4af9-9f8f-781aea3e31e0 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:16:36.351623 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-9a30b39b-b4b6-4af9-9f8f-781aea3e31e0 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:16:36.352065 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-9a30b39b-b4b6-4af9-9f8f-781aea3e31e0 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:16:36.508188 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-19647617-dc0a-4ebc-b068-3e7873d137a6 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Calling method '>' {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:16:36.508802 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.compute.api [None req-19647617-dc0a-4ebc-b068-3e7873d137a6 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] [instance: 73dbd5ab-5688-4de4-9da2-0b89d7cefb11] Fetching instance by UUID {{(pid=117873) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:16:36.517494 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-19647617-dc0a-4ebc-b068-3e7873d137a6 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:16:36.518380 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-19647617-dc0a-4ebc-b068-3e7873d137a6 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:16:36.519425 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-19647617-dc0a-4ebc-b068-3e7873d137a6 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:16:36.519866 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-19647617-dc0a-4ebc-b068-3e7873d137a6 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:16:36.594296 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.policy [None req-9a30b39b-b4b6-4af9-9f8f-781aea3e31e0 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78fe3fc4334c43d7a5ef6d70f9f57523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad52333bcbec425089c44c3e55df97ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117874) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:16:36.603317 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [None req-9a30b39b-b4b6-4af9-9f8f-781aea3e31e0 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] 10.222.0.43 "GET /compute/v2.1/servers/eb851ab6-0e89-41d2-be52-d76cdc8644d6" status: 200 len: 1363 microversion: 2.1 time: 0.267641 Jun 22 10:16:36.614178 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 72/137] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:16:36 2022] GET /compute/v2.1/servers/eb851ab6-0e89-41d2-be52-d76cdc8644d6 => generated 1363 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:16:36.622726 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [req-683505e8-6adc-45ef-a4d1-b90f8d47c780 req-c401b0bd-2acb-4c1d-8635-3ed2d36a0245 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5828c9dc-3439-4da7-a94c-f81cbbfdcb99", "tag": "f9ce6858-55e5-4d8b-b5fe-2cff5d9c4f08"}]} {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:16:36.640328 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [req-683505e8-6adc-45ef-a4d1-b90f8d47c780 req-c401b0bd-2acb-4c1d-8635-3ed2d36a0245 service nova] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:16:36.643032 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [req-683505e8-6adc-45ef-a4d1-b90f8d47c780 req-c401b0bd-2acb-4c1d-8635-3ed2d36a0245 service nova] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:16:36.667032 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.compute.server_external_events [req-683505e8-6adc-45ef-a4d1-b90f8d47c780 req-c401b0bd-2acb-4c1d-8635-3ed2d36a0245 service nova] Creating event network-changed:f9ce6858-55e5-4d8b-b5fe-2cff5d9c4f08 for instance 5828c9dc-3439-4da7-a94c-f81cbbfdcb99 on hv-cinder-84713 Jun 22 10:16:36.674223 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [req-683505e8-6adc-45ef-a4d1-b90f8d47c780 req-c401b0bd-2acb-4c1d-8635-3ed2d36a0245 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057229 Jun 22 10:16:36.675240 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 73/138] 10.222.0.43 () {64 vars in 1317 bytes} [Wed Jun 22 10:16:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 10:16:36.742582 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.policy [None req-19647617-dc0a-4ebc-b068-3e7873d137a6 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75753b29a78640df9622d4e2655baf9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee9d603d9cc4a8797f55d544f189720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117873) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:16:36.750669 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.policy [None req-19647617-dc0a-4ebc-b068-3e7873d137a6 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75753b29a78640df9622d4e2655baf9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee9d603d9cc4a8797f55d544f189720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117873) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:16:36.752801 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.policy [None req-19647617-dc0a-4ebc-b068-3e7873d137a6 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75753b29a78640df9622d4e2655baf9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee9d603d9cc4a8797f55d544f189720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117873) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:16:36.754188 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [None req-19647617-dc0a-4ebc-b068-3e7873d137a6 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] 10.222.0.43 "GET /compute/v2.1/servers/73dbd5ab-5688-4de4-9da2-0b89d7cefb11" status: 200 len: 1407 microversion: 2.20 time: 0.249942 Jun 22 10:16:36.755283 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 66/139] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jun 22 10:16:36 2022] GET /compute/v2.1/servers/73dbd5ab-5688-4de4-9da2-0b89d7cefb11 => generated 1407 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 22 10:16:36.981839 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-be50addc-8883-4da7-ab2d-97661dffa5b3 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Calling method '>' {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:16:36.982654 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.compute.api [None req-be50addc-8883-4da7-ab2d-97661dffa5b3 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] [instance: 9f07e4bb-f4e9-428e-8feb-db50b3ff2109] Fetching instance by UUID {{(pid=117874) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:16:36.990035 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-be50addc-8883-4da7-ab2d-97661dffa5b3 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:16:36.990584 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-be50addc-8883-4da7-ab2d-97661dffa5b3 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:16:36.991441 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-be50addc-8883-4da7-ab2d-97661dffa5b3 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:16:36.991941 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-be50addc-8883-4da7-ab2d-97661dffa5b3 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:16:37.140394 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.policy [None req-be50addc-8883-4da7-ab2d-97661dffa5b3 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d7292401816437fba46d073c4746e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3277b9cbc4b4a8bbacee8440cea1ed2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117874) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:16:37.149816 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [None req-be50addc-8883-4da7-ab2d-97661dffa5b3 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] 10.222.0.43 "GET /compute/v2.1/servers/9f07e4bb-f4e9-428e-8feb-db50b3ff2109" status: 200 len: 1321 microversion: 2.1 time: 0.173068 Jun 22 10:16:37.150393 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 74/140] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:16:36 2022] GET /compute/v2.1/servers/9f07e4bb-f4e9-428e-8feb-db50b3ff2109 => generated 1321 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:16:37.621754 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-6fa79e7b-84bb-4ff5-a2d1-f6b21167a5c2 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Calling method '>' {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:16:37.622421 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.compute.api [None req-6fa79e7b-84bb-4ff5-a2d1-f6b21167a5c2 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] [instance: eb851ab6-0e89-41d2-be52-d76cdc8644d6] Fetching instance by UUID {{(pid=117873) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:16:37.630368 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-6fa79e7b-84bb-4ff5-a2d1-f6b21167a5c2 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:16:37.631292 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-6fa79e7b-84bb-4ff5-a2d1-f6b21167a5c2 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:16:37.632341 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-6fa79e7b-84bb-4ff5-a2d1-f6b21167a5c2 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:16:37.632920 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-6fa79e7b-84bb-4ff5-a2d1-f6b21167a5c2 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:16:37.773927 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-becfcc00-c929-46c4-94ab-2f7f14aef0d2 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Calling method '>' {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:16:37.775135 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.compute.api [None req-becfcc00-c929-46c4-94ab-2f7f14aef0d2 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] [instance: 73dbd5ab-5688-4de4-9da2-0b89d7cefb11] Fetching instance by UUID {{(pid=117874) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:16:37.784228 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-becfcc00-c929-46c4-94ab-2f7f14aef0d2 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:16:37.784539 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-becfcc00-c929-46c4-94ab-2f7f14aef0d2 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:16:37.785314 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-becfcc00-c929-46c4-94ab-2f7f14aef0d2 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:16:37.785834 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-becfcc00-c929-46c4-94ab-2f7f14aef0d2 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:16:37.786788 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.policy [None req-6fa79e7b-84bb-4ff5-a2d1-f6b21167a5c2 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78fe3fc4334c43d7a5ef6d70f9f57523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad52333bcbec425089c44c3e55df97ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117873) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:16:37.797012 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [None req-6fa79e7b-84bb-4ff5-a2d1-f6b21167a5c2 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] 10.222.0.43 "GET /compute/v2.1/servers/eb851ab6-0e89-41d2-be52-d76cdc8644d6" status: 200 len: 1363 microversion: 2.1 time: 0.179390 Jun 22 10:16:37.797795 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 67/141] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:16:37 2022] GET /compute/v2.1/servers/eb851ab6-0e89-41d2-be52-d76cdc8644d6 => generated 1363 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:16:37.934866 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.policy [None req-becfcc00-c929-46c4-94ab-2f7f14aef0d2 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75753b29a78640df9622d4e2655baf9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee9d603d9cc4a8797f55d544f189720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117874) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:16:37.943337 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.policy [None req-becfcc00-c929-46c4-94ab-2f7f14aef0d2 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75753b29a78640df9622d4e2655baf9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee9d603d9cc4a8797f55d544f189720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117874) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:16:37.944860 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.policy [None req-becfcc00-c929-46c4-94ab-2f7f14aef0d2 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75753b29a78640df9622d4e2655baf9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee9d603d9cc4a8797f55d544f189720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117874) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:16:37.946007 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [None req-becfcc00-c929-46c4-94ab-2f7f14aef0d2 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] 10.222.0.43 "GET /compute/v2.1/servers/73dbd5ab-5688-4de4-9da2-0b89d7cefb11" status: 200 len: 1407 microversion: 2.20 time: 0.176267 Jun 22 10:16:37.946901 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 75/142] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jun 22 10:16:37 2022] GET /compute/v2.1/servers/73dbd5ab-5688-4de4-9da2-0b89d7cefb11 => generated 1407 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 10:16:38.166722 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-95d3558f-b7a9-4eee-9d7a-d60b87d7ccf8 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Calling method '>' {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:16:38.167402 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.compute.api [None req-95d3558f-b7a9-4eee-9d7a-d60b87d7ccf8 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] [instance: 9f07e4bb-f4e9-428e-8feb-db50b3ff2109] Fetching instance by UUID {{(pid=117873) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:16:38.170196 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG dbcounter [-] [117873] Writing DB stats nova_cell0:SELECT=2 {{(pid=117873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:16:38.177871 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-95d3558f-b7a9-4eee-9d7a-d60b87d7ccf8 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:16:38.178477 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-95d3558f-b7a9-4eee-9d7a-d60b87d7ccf8 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:16:38.179392 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-95d3558f-b7a9-4eee-9d7a-d60b87d7ccf8 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:16:38.179892 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-95d3558f-b7a9-4eee-9d7a-d60b87d7ccf8 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:16:38.326215 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.policy [None req-95d3558f-b7a9-4eee-9d7a-d60b87d7ccf8 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d7292401816437fba46d073c4746e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3277b9cbc4b4a8bbacee8440cea1ed2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117873) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:16:38.335035 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [None req-95d3558f-b7a9-4eee-9d7a-d60b87d7ccf8 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] 10.222.0.43 "GET /compute/v2.1/servers/9f07e4bb-f4e9-428e-8feb-db50b3ff2109" status: 200 len: 1321 microversion: 2.1 time: 0.172390 Jun 22 10:16:38.335910 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 68/143] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:16:38 2022] GET /compute/v2.1/servers/9f07e4bb-f4e9-428e-8feb-db50b3ff2109 => generated 1321 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:16:38.815300 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-1408c516-b421-441d-b6bc-2dfcb022299a tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Calling method '>' {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:16:38.816573 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.compute.api [None req-1408c516-b421-441d-b6bc-2dfcb022299a tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] [instance: eb851ab6-0e89-41d2-be52-d76cdc8644d6] Fetching instance by UUID {{(pid=117874) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:16:38.823506 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-1408c516-b421-441d-b6bc-2dfcb022299a tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:16:38.823947 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-1408c516-b421-441d-b6bc-2dfcb022299a tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:16:38.824824 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-1408c516-b421-441d-b6bc-2dfcb022299a tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:16:38.825243 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-1408c516-b421-441d-b6bc-2dfcb022299a tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:16:38.964685 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-01ef0df9-f139-4755-8993-88c08bbcdac0 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Calling method '>' {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:16:38.965915 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.compute.api [None req-01ef0df9-f139-4755-8993-88c08bbcdac0 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] [instance: 73dbd5ab-5688-4de4-9da2-0b89d7cefb11] Fetching instance by UUID {{(pid=117873) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:16:38.973583 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-01ef0df9-f139-4755-8993-88c08bbcdac0 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:16:38.976309 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-01ef0df9-f139-4755-8993-88c08bbcdac0 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:16:38.977384 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-01ef0df9-f139-4755-8993-88c08bbcdac0 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:16:38.978031 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-01ef0df9-f139-4755-8993-88c08bbcdac0 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:16:39.195982 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.policy [None req-1408c516-b421-441d-b6bc-2dfcb022299a tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78fe3fc4334c43d7a5ef6d70f9f57523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad52333bcbec425089c44c3e55df97ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117874) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:16:39.204198 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [None req-1408c516-b421-441d-b6bc-2dfcb022299a tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] 10.222.0.43 "GET /compute/v2.1/servers/eb851ab6-0e89-41d2-be52-d76cdc8644d6" status: 200 len: 1363 microversion: 2.1 time: 0.393731 Jun 22 10:16:39.204799 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 76/144] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:16:38 2022] GET /compute/v2.1/servers/eb851ab6-0e89-41d2-be52-d76cdc8644d6 => generated 1363 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:16:39.226282 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.policy [None req-01ef0df9-f139-4755-8993-88c08bbcdac0 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75753b29a78640df9622d4e2655baf9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee9d603d9cc4a8797f55d544f189720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117873) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:16:39.236306 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.policy [None req-01ef0df9-f139-4755-8993-88c08bbcdac0 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75753b29a78640df9622d4e2655baf9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee9d603d9cc4a8797f55d544f189720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117873) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:16:39.237939 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.policy [None req-01ef0df9-f139-4755-8993-88c08bbcdac0 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75753b29a78640df9622d4e2655baf9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee9d603d9cc4a8797f55d544f189720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117873) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:16:39.239122 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [None req-01ef0df9-f139-4755-8993-88c08bbcdac0 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] 10.222.0.43 "GET /compute/v2.1/servers/73dbd5ab-5688-4de4-9da2-0b89d7cefb11" status: 200 len: 1599 microversion: 2.20 time: 0.278524 Jun 22 10:16:39.239674 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 69/145] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jun 22 10:16:38 2022] GET /compute/v2.1/servers/73dbd5ab-5688-4de4-9da2-0b89d7cefb11 => generated 1599 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 10:16:39.257137 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-14d3029e-2e26-4e4c-8a54-6dcfbd626fda tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Calling method '>' {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:16:39.257625 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.compute.api [None req-14d3029e-2e26-4e4c-8a54-6dcfbd626fda tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] [instance: 73dbd5ab-5688-4de4-9da2-0b89d7cefb11] Fetching instance by UUID {{(pid=117874) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:16:39.263652 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-14d3029e-2e26-4e4c-8a54-6dcfbd626fda tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:16:39.264094 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-14d3029e-2e26-4e4c-8a54-6dcfbd626fda tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:16:39.264844 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-14d3029e-2e26-4e4c-8a54-6dcfbd626fda tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:16:39.265273 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-14d3029e-2e26-4e4c-8a54-6dcfbd626fda tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:16:39.340113 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [None req-14d3029e-2e26-4e4c-8a54-6dcfbd626fda tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] 10.222.0.43 "GET /compute/v2.1/servers/73dbd5ab-5688-4de4-9da2-0b89d7cefb11/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.086738 Jun 22 10:16:39.340710 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 77/146] 10.222.0.43 () {60 vars in 1315 bytes} [Wed Jun 22 10:16:39 2022] GET /compute/v2.1/servers/73dbd5ab-5688-4de4-9da2-0b89d7cefb11/os-interface => generated 284 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 22 10:16:39.351363 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-5cae1e43-d39d-4438-a986-5a0100997dfd tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Calling method '>' {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:16:39.351960 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.compute.api [None req-5cae1e43-d39d-4438-a986-5a0100997dfd tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] [instance: 9f07e4bb-f4e9-428e-8feb-db50b3ff2109] Fetching instance by UUID {{(pid=117873) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:16:39.358231 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-5cae1e43-d39d-4438-a986-5a0100997dfd tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:16:39.358664 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-5cae1e43-d39d-4438-a986-5a0100997dfd tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:16:39.359406 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-5cae1e43-d39d-4438-a986-5a0100997dfd tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:16:39.359832 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-5cae1e43-d39d-4438-a986-5a0100997dfd tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:16:39.363884 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG dbcounter [-] [117873] Writing DB stats nova_cell1:SELECT=100 {{(pid=117873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:16:39.496835 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.policy [None req-5cae1e43-d39d-4438-a986-5a0100997dfd tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d7292401816437fba46d073c4746e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3277b9cbc4b4a8bbacee8440cea1ed2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117873) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:16:39.505615 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [None req-5cae1e43-d39d-4438-a986-5a0100997dfd tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] 10.222.0.43 "GET /compute/v2.1/servers/9f07e4bb-f4e9-428e-8feb-db50b3ff2109" status: 200 len: 1321 microversion: 2.1 time: 0.157895 Jun 22 10:16:39.506249 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 70/147] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:16:39 2022] GET /compute/v2.1/servers/9f07e4bb-f4e9-428e-8feb-db50b3ff2109 => generated 1321 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:16:40.222909 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-06857ab7-ea9a-4abf-8407-6b4d65640a81 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Calling method '>' {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:16:40.223513 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.compute.api [None req-06857ab7-ea9a-4abf-8407-6b4d65640a81 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] [instance: eb851ab6-0e89-41d2-be52-d76cdc8644d6] Fetching instance by UUID {{(pid=117874) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:16:40.230359 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-06857ab7-ea9a-4abf-8407-6b4d65640a81 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:16:40.230807 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-06857ab7-ea9a-4abf-8407-6b4d65640a81 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:16:40.231574 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-06857ab7-ea9a-4abf-8407-6b4d65640a81 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:16:40.232004 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-06857ab7-ea9a-4abf-8407-6b4d65640a81 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:16:40.371786 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.policy [None req-06857ab7-ea9a-4abf-8407-6b4d65640a81 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78fe3fc4334c43d7a5ef6d70f9f57523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad52333bcbec425089c44c3e55df97ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117874) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:16:40.379990 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [None req-06857ab7-ea9a-4abf-8407-6b4d65640a81 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] 10.222.0.43 "GET /compute/v2.1/servers/eb851ab6-0e89-41d2-be52-d76cdc8644d6" status: 200 len: 1363 microversion: 2.1 time: 0.162203 Jun 22 10:16:40.380572 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 78/148] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:16:40 2022] GET /compute/v2.1/servers/eb851ab6-0e89-41d2-be52-d76cdc8644d6 => generated 1363 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:16:40.522803 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-65e3560f-f4e2-4dc3-b014-d78c15cb713e tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Calling method '>' {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:16:40.523410 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.compute.api [None req-65e3560f-f4e2-4dc3-b014-d78c15cb713e tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] [instance: 9f07e4bb-f4e9-428e-8feb-db50b3ff2109] Fetching instance by UUID {{(pid=117873) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:16:40.529420 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-65e3560f-f4e2-4dc3-b014-d78c15cb713e tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:16:40.529900 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-65e3560f-f4e2-4dc3-b014-d78c15cb713e tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:16:40.530662 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-65e3560f-f4e2-4dc3-b014-d78c15cb713e tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:16:40.531093 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-65e3560f-f4e2-4dc3-b014-d78c15cb713e tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:16:40.665652 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.policy [None req-65e3560f-f4e2-4dc3-b014-d78c15cb713e tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d7292401816437fba46d073c4746e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3277b9cbc4b4a8bbacee8440cea1ed2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117873) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:16:40.677241 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [None req-65e3560f-f4e2-4dc3-b014-d78c15cb713e tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] 10.222.0.43 "GET /compute/v2.1/servers/9f07e4bb-f4e9-428e-8feb-db50b3ff2109" status: 200 len: 1321 microversion: 2.1 time: 0.155910 Jun 22 10:16:40.677241 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 71/149] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:16:40 2022] GET /compute/v2.1/servers/9f07e4bb-f4e9-428e-8feb-db50b3ff2109 => generated 1321 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:16:40.686618 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [req-9a1ab8d0-2dc5-405b-8493-8679e636770b req-b20b189b-b5f9-405b-aef0-5b6c74478a44 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "73dbd5ab-5688-4de4-9da2-0b89d7cefb11", "tag": "468a7090-7d3f-43e5-8303-b6f8870ced56"}]} {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:16:40.694967 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [req-9a1ab8d0-2dc5-405b-8493-8679e636770b req-b20b189b-b5f9-405b-aef0-5b6c74478a44 service nova] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:16:40.695401 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [req-9a1ab8d0-2dc5-405b-8493-8679e636770b req-b20b189b-b5f9-405b-aef0-5b6c74478a44 service nova] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:16:40.707232 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.compute.server_external_events [req-9a1ab8d0-2dc5-405b-8493-8679e636770b req-b20b189b-b5f9-405b-aef0-5b6c74478a44 service nova] Creating event network-changed:468a7090-7d3f-43e5-8303-b6f8870ced56 for instance 73dbd5ab-5688-4de4-9da2-0b89d7cefb11 on hv-cinder-84713 Jun 22 10:16:40.712497 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [req-9a1ab8d0-2dc5-405b-8493-8679e636770b req-b20b189b-b5f9-405b-aef0-5b6c74478a44 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029364 Jun 22 10:16:40.713125 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 79/150] 10.222.0.43 () {64 vars in 1317 bytes} [Wed Jun 22 10:16:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 10:16:41.396424 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-f96e9194-14ae-4a61-9c74-16997b5d2944 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Calling method '>' {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:16:41.397138 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.compute.api [None req-f96e9194-14ae-4a61-9c74-16997b5d2944 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] [instance: eb851ab6-0e89-41d2-be52-d76cdc8644d6] Fetching instance by UUID {{(pid=117873) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:16:41.403676 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-f96e9194-14ae-4a61-9c74-16997b5d2944 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:16:41.404123 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-f96e9194-14ae-4a61-9c74-16997b5d2944 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:16:41.404886 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-f96e9194-14ae-4a61-9c74-16997b5d2944 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:16:41.405312 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-f96e9194-14ae-4a61-9c74-16997b5d2944 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:16:41.543122 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.policy [None req-f96e9194-14ae-4a61-9c74-16997b5d2944 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78fe3fc4334c43d7a5ef6d70f9f57523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad52333bcbec425089c44c3e55df97ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117873) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:16:41.552051 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [None req-f96e9194-14ae-4a61-9c74-16997b5d2944 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] 10.222.0.43 "GET /compute/v2.1/servers/eb851ab6-0e89-41d2-be52-d76cdc8644d6" status: 200 len: 1363 microversion: 2.1 time: 0.159310 Jun 22 10:16:41.552641 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 72/151] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:16:41 2022] GET /compute/v2.1/servers/eb851ab6-0e89-41d2-be52-d76cdc8644d6 => generated 1363 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:16:41.695824 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-9f751af4-c76c-47c7-bdc6-52cccf861e1e tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Calling method '>' {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:16:41.696522 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.compute.api [None req-9f751af4-c76c-47c7-bdc6-52cccf861e1e tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] [instance: 9f07e4bb-f4e9-428e-8feb-db50b3ff2109] Fetching instance by UUID {{(pid=117874) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:16:41.703180 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-9f751af4-c76c-47c7-bdc6-52cccf861e1e tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:16:41.703652 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-9f751af4-c76c-47c7-bdc6-52cccf861e1e tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:16:41.704544 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-9f751af4-c76c-47c7-bdc6-52cccf861e1e tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:16:41.704974 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-9f751af4-c76c-47c7-bdc6-52cccf861e1e tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:16:41.841438 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.policy [None req-9f751af4-c76c-47c7-bdc6-52cccf861e1e tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d7292401816437fba46d073c4746e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3277b9cbc4b4a8bbacee8440cea1ed2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117874) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:16:41.849674 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [None req-9f751af4-c76c-47c7-bdc6-52cccf861e1e tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] 10.222.0.43 "GET /compute/v2.1/servers/9f07e4bb-f4e9-428e-8feb-db50b3ff2109" status: 200 len: 1321 microversion: 2.1 time: 0.158699 Jun 22 10:16:41.850370 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 80/152] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:16:41 2022] GET /compute/v2.1/servers/9f07e4bb-f4e9-428e-8feb-db50b3ff2109 => generated 1321 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:16:42.568895 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-c04a5203-9e77-4a03-a42a-fe5a8041659d tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Calling method '>' {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:16:42.569437 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.compute.api [None req-c04a5203-9e77-4a03-a42a-fe5a8041659d tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] [instance: eb851ab6-0e89-41d2-be52-d76cdc8644d6] Fetching instance by UUID {{(pid=117873) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:16:42.575402 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-c04a5203-9e77-4a03-a42a-fe5a8041659d tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:16:42.575838 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-c04a5203-9e77-4a03-a42a-fe5a8041659d tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:16:42.576578 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-c04a5203-9e77-4a03-a42a-fe5a8041659d tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:16:42.577004 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-c04a5203-9e77-4a03-a42a-fe5a8041659d tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:16:42.867340 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-d848c8e5-f383-45f2-b072-f6fdc68db373 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Calling method '>' {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:16:42.867957 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.compute.api [None req-d848c8e5-f383-45f2-b072-f6fdc68db373 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] [instance: 9f07e4bb-f4e9-428e-8feb-db50b3ff2109] Fetching instance by UUID {{(pid=117874) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:16:42.870527 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG dbcounter [-] [117874] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=117874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:16:42.877086 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-d848c8e5-f383-45f2-b072-f6fdc68db373 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:16:42.877641 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-d848c8e5-f383-45f2-b072-f6fdc68db373 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:16:42.878426 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-d848c8e5-f383-45f2-b072-f6fdc68db373 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:16:42.878860 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-d848c8e5-f383-45f2-b072-f6fdc68db373 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:16:42.966180 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.policy [None req-c04a5203-9e77-4a03-a42a-fe5a8041659d tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78fe3fc4334c43d7a5ef6d70f9f57523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad52333bcbec425089c44c3e55df97ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117873) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:16:42.974508 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [None req-c04a5203-9e77-4a03-a42a-fe5a8041659d tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] 10.222.0.43 "GET /compute/v2.1/servers/eb851ab6-0e89-41d2-be52-d76cdc8644d6" status: 200 len: 1363 microversion: 2.1 time: 0.409562 Jun 22 10:16:42.975289 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 73/153] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:16:42 2022] GET /compute/v2.1/servers/eb851ab6-0e89-41d2-be52-d76cdc8644d6 => generated 1363 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:16:43.033712 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.policy [None req-d848c8e5-f383-45f2-b072-f6fdc68db373 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d7292401816437fba46d073c4746e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3277b9cbc4b4a8bbacee8440cea1ed2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117874) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:16:43.041378 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [None req-d848c8e5-f383-45f2-b072-f6fdc68db373 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] 10.222.0.43 "GET /compute/v2.1/servers/9f07e4bb-f4e9-428e-8feb-db50b3ff2109" status: 200 len: 1321 microversion: 2.1 time: 0.177826 Jun 22 10:16:43.041989 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 81/154] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:16:42 2022] GET /compute/v2.1/servers/9f07e4bb-f4e9-428e-8feb-db50b3ff2109 => generated 1321 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 10:16:43.991849 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-5f05fd1e-db95-469c-84e2-935aa2ef1cbe tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Calling method '>' {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:16:43.992446 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.compute.api [None req-5f05fd1e-db95-469c-84e2-935aa2ef1cbe tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] [instance: eb851ab6-0e89-41d2-be52-d76cdc8644d6] Fetching instance by UUID {{(pid=117873) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:16:43.998483 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-5f05fd1e-db95-469c-84e2-935aa2ef1cbe tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:16:43.998927 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-5f05fd1e-db95-469c-84e2-935aa2ef1cbe tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:16:43.999669 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-5f05fd1e-db95-469c-84e2-935aa2ef1cbe tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:16:44.000095 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-5f05fd1e-db95-469c-84e2-935aa2ef1cbe tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:16:44.058976 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-5cbb1b77-7a98-49d0-b7b2-65a829a338ca tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Calling method '>' {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:16:44.059717 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.compute.api [None req-5cbb1b77-7a98-49d0-b7b2-65a829a338ca tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] [instance: 9f07e4bb-f4e9-428e-8feb-db50b3ff2109] Fetching instance by UUID {{(pid=117874) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:16:44.067189 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-5cbb1b77-7a98-49d0-b7b2-65a829a338ca tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:16:44.067631 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-5cbb1b77-7a98-49d0-b7b2-65a829a338ca tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:16:44.068399 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-5cbb1b77-7a98-49d0-b7b2-65a829a338ca tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:16:44.068831 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-5cbb1b77-7a98-49d0-b7b2-65a829a338ca tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:16:44.174366 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.policy [None req-5f05fd1e-db95-469c-84e2-935aa2ef1cbe tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78fe3fc4334c43d7a5ef6d70f9f57523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad52333bcbec425089c44c3e55df97ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117873) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:16:44.182026 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [None req-5f05fd1e-db95-469c-84e2-935aa2ef1cbe tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] 10.222.0.43 "GET /compute/v2.1/servers/eb851ab6-0e89-41d2-be52-d76cdc8644d6" status: 200 len: 1363 microversion: 2.1 time: 0.193953 Jun 22 10:16:44.182601 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 74/155] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:16:43 2022] GET /compute/v2.1/servers/eb851ab6-0e89-41d2-be52-d76cdc8644d6 => generated 1363 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:16:44.218409 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.policy [None req-5cbb1b77-7a98-49d0-b7b2-65a829a338ca tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d7292401816437fba46d073c4746e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3277b9cbc4b4a8bbacee8440cea1ed2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117874) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:16:44.222923 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG dbcounter [-] [117874] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:16:44.227671 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [None req-5cbb1b77-7a98-49d0-b7b2-65a829a338ca tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] 10.222.0.43 "GET /compute/v2.1/servers/9f07e4bb-f4e9-428e-8feb-db50b3ff2109" status: 200 len: 1321 microversion: 2.1 time: 0.172506 Jun 22 10:16:44.228233 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 82/156] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:16:44 2022] GET /compute/v2.1/servers/9f07e4bb-f4e9-428e-8feb-db50b3ff2109 => generated 1321 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 10:16:45.198961 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-72926f46-f30c-4b28-88bc-00d876e1ed35 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Calling method '>' {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:16:45.199567 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.compute.api [None req-72926f46-f30c-4b28-88bc-00d876e1ed35 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] [instance: eb851ab6-0e89-41d2-be52-d76cdc8644d6] Fetching instance by UUID {{(pid=117873) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:16:45.206797 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-72926f46-f30c-4b28-88bc-00d876e1ed35 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:16:45.207238 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-72926f46-f30c-4b28-88bc-00d876e1ed35 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:16:45.207988 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-72926f46-f30c-4b28-88bc-00d876e1ed35 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:16:45.208423 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-72926f46-f30c-4b28-88bc-00d876e1ed35 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:16:45.245538 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-ea94118d-b6cc-469d-94d9-c7f8dbea477d tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Calling method '>' {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:16:45.246174 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.compute.api [None req-ea94118d-b6cc-469d-94d9-c7f8dbea477d tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] [instance: 9f07e4bb-f4e9-428e-8feb-db50b3ff2109] Fetching instance by UUID {{(pid=117874) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:16:45.254846 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-ea94118d-b6cc-469d-94d9-c7f8dbea477d tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:16:45.255420 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-ea94118d-b6cc-469d-94d9-c7f8dbea477d tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:16:45.256324 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-ea94118d-b6cc-469d-94d9-c7f8dbea477d tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:16:45.256754 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-ea94118d-b6cc-469d-94d9-c7f8dbea477d tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:16:45.390423 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.policy [None req-72926f46-f30c-4b28-88bc-00d876e1ed35 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78fe3fc4334c43d7a5ef6d70f9f57523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad52333bcbec425089c44c3e55df97ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117873) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:16:45.398097 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [None req-72926f46-f30c-4b28-88bc-00d876e1ed35 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] 10.222.0.43 "GET /compute/v2.1/servers/eb851ab6-0e89-41d2-be52-d76cdc8644d6" status: 200 len: 1363 microversion: 2.1 time: 0.202927 Jun 22 10:16:45.398682 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 75/157] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:16:45 2022] GET /compute/v2.1/servers/eb851ab6-0e89-41d2-be52-d76cdc8644d6 => generated 1363 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:16:45.419423 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.policy [None req-ea94118d-b6cc-469d-94d9-c7f8dbea477d tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d7292401816437fba46d073c4746e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3277b9cbc4b4a8bbacee8440cea1ed2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117874) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:16:45.427474 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [None req-ea94118d-b6cc-469d-94d9-c7f8dbea477d tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] 10.222.0.43 "GET /compute/v2.1/servers/9f07e4bb-f4e9-428e-8feb-db50b3ff2109" status: 200 len: 1321 microversion: 2.1 time: 0.185808 Jun 22 10:16:45.428033 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 83/158] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:16:45 2022] GET /compute/v2.1/servers/9f07e4bb-f4e9-428e-8feb-db50b3ff2109 => generated 1321 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 10:16:46.414950 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-5855102b-5910-40c4-b999-075b4bdc0ba4 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Calling method '>' {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:16:46.415544 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.compute.api [None req-5855102b-5910-40c4-b999-075b4bdc0ba4 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] [instance: eb851ab6-0e89-41d2-be52-d76cdc8644d6] Fetching instance by UUID {{(pid=117873) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:16:46.421762 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-5855102b-5910-40c4-b999-075b4bdc0ba4 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:16:46.422208 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-5855102b-5910-40c4-b999-075b4bdc0ba4 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:16:46.422941 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-5855102b-5910-40c4-b999-075b4bdc0ba4 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:16:46.423368 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-5855102b-5910-40c4-b999-075b4bdc0ba4 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:16:46.445474 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-c0d13e1b-9929-4eea-87f0-1edd1f1063da tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Calling method '>' {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:16:46.446138 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.compute.api [None req-c0d13e1b-9929-4eea-87f0-1edd1f1063da tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] [instance: 9f07e4bb-f4e9-428e-8feb-db50b3ff2109] Fetching instance by UUID {{(pid=117874) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:16:46.452538 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-c0d13e1b-9929-4eea-87f0-1edd1f1063da tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:16:46.453564 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-c0d13e1b-9929-4eea-87f0-1edd1f1063da tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:16:46.454359 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-c0d13e1b-9929-4eea-87f0-1edd1f1063da tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:16:46.454792 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-c0d13e1b-9929-4eea-87f0-1edd1f1063da tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:16:46.610195 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.policy [None req-5855102b-5910-40c4-b999-075b4bdc0ba4 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78fe3fc4334c43d7a5ef6d70f9f57523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad52333bcbec425089c44c3e55df97ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117873) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:16:46.617804 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [None req-5855102b-5910-40c4-b999-075b4bdc0ba4 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] 10.222.0.43 "GET /compute/v2.1/servers/eb851ab6-0e89-41d2-be52-d76cdc8644d6" status: 200 len: 1363 microversion: 2.1 time: 0.206532 Jun 22 10:16:46.618373 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 76/159] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:16:46 2022] GET /compute/v2.1/servers/eb851ab6-0e89-41d2-be52-d76cdc8644d6 => generated 1363 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:16:46.632568 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.policy [None req-c0d13e1b-9929-4eea-87f0-1edd1f1063da tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d7292401816437fba46d073c4746e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3277b9cbc4b4a8bbacee8440cea1ed2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117874) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:16:46.640167 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [None req-c0d13e1b-9929-4eea-87f0-1edd1f1063da tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] 10.222.0.43 "GET /compute/v2.1/servers/9f07e4bb-f4e9-428e-8feb-db50b3ff2109" status: 200 len: 1321 microversion: 2.1 time: 0.199258 Jun 22 10:16:46.640735 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 84/160] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:16:46 2022] GET /compute/v2.1/servers/9f07e4bb-f4e9-428e-8feb-db50b3ff2109 => generated 1321 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:16:47.634693 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-83a0c602-76ac-4177-9c11-51e5c8933f60 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Calling method '>' {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:16:47.635636 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.compute.api [None req-83a0c602-76ac-4177-9c11-51e5c8933f60 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] [instance: eb851ab6-0e89-41d2-be52-d76cdc8644d6] Fetching instance by UUID {{(pid=117873) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:16:47.642012 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-83a0c602-76ac-4177-9c11-51e5c8933f60 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:16:47.642458 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-83a0c602-76ac-4177-9c11-51e5c8933f60 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:16:47.643224 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-83a0c602-76ac-4177-9c11-51e5c8933f60 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:16:47.643873 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-83a0c602-76ac-4177-9c11-51e5c8933f60 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:16:47.660560 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-50cc1bd1-e021-4df2-b796-3c31f5c1d165 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Calling method '>' {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:16:47.662256 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.compute.api [None req-50cc1bd1-e021-4df2-b796-3c31f5c1d165 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] [instance: 9f07e4bb-f4e9-428e-8feb-db50b3ff2109] Fetching instance by UUID {{(pid=117874) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:16:47.680159 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-50cc1bd1-e021-4df2-b796-3c31f5c1d165 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:16:47.680670 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-50cc1bd1-e021-4df2-b796-3c31f5c1d165 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:16:47.681538 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-50cc1bd1-e021-4df2-b796-3c31f5c1d165 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:16:47.682101 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-50cc1bd1-e021-4df2-b796-3c31f5c1d165 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:16:47.839575 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.policy [None req-83a0c602-76ac-4177-9c11-51e5c8933f60 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78fe3fc4334c43d7a5ef6d70f9f57523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad52333bcbec425089c44c3e55df97ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117873) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:16:47.851839 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [None req-83a0c602-76ac-4177-9c11-51e5c8933f60 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] 10.222.0.43 "GET /compute/v2.1/servers/eb851ab6-0e89-41d2-be52-d76cdc8644d6" status: 200 len: 1550 microversion: 2.1 time: 0.220881 Jun 22 10:16:47.852428 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 77/161] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:16:47 2022] GET /compute/v2.1/servers/eb851ab6-0e89-41d2-be52-d76cdc8644d6 => generated 1550 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:16:47.873336 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-16b23d2f-9cfa-4182-b8ec-62e0d3901333 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Calling method '>' {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:16:47.874009 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.compute.api [None req-16b23d2f-9cfa-4182-b8ec-62e0d3901333 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] [instance: eb851ab6-0e89-41d2-be52-d76cdc8644d6] Fetching instance by UUID {{(pid=117873) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:16:47.877228 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.policy [None req-50cc1bd1-e021-4df2-b796-3c31f5c1d165 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d7292401816437fba46d073c4746e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3277b9cbc4b4a8bbacee8440cea1ed2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117874) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:16:47.886342 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-16b23d2f-9cfa-4182-b8ec-62e0d3901333 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:16:47.886767 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [None req-50cc1bd1-e021-4df2-b796-3c31f5c1d165 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] 10.222.0.43 "GET /compute/v2.1/servers/9f07e4bb-f4e9-428e-8feb-db50b3ff2109" status: 200 len: 1515 microversion: 2.1 time: 0.231834 Jun 22 10:16:47.898984 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-16b23d2f-9cfa-4182-b8ec-62e0d3901333 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:16:47.899193 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 85/162] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:16:47 2022] GET /compute/v2.1/servers/9f07e4bb-f4e9-428e-8feb-db50b3ff2109 => generated 1515 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:16:47.899308 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-16b23d2f-9cfa-4182-b8ec-62e0d3901333 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:16:47.899308 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-16b23d2f-9cfa-4182-b8ec-62e0d3901333 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:16:47.906984 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-d93f3553-28b8-4167-af3e-4610e01a41d3 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:16:47.908086 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.compute.api [None req-d93f3553-28b8-4167-af3e-4610e01a41d3 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] [instance: 9f07e4bb-f4e9-428e-8feb-db50b3ff2109] Fetching instance by UUID {{(pid=117874) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:16:47.916014 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-d93f3553-28b8-4167-af3e-4610e01a41d3 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:16:47.916585 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-d93f3553-28b8-4167-af3e-4610e01a41d3 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:16:47.917621 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-d93f3553-28b8-4167-af3e-4610e01a41d3 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:16:47.918093 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-d93f3553-28b8-4167-af3e-4610e01a41d3 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:16:47.943848 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.objects.instance [None req-d93f3553-28b8-4167-af3e-4610e01a41d3 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lazy-loading 'flavor' on Instance uuid 9f07e4bb-f4e9-428e-8feb-db50b3ff2109 {{(pid=117874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 22 10:16:47.986992 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [None req-16b23d2f-9cfa-4182-b8ec-62e0d3901333 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] 10.222.0.43 "GET /compute/v2.1/servers/eb851ab6-0e89-41d2-be52-d76cdc8644d6/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.118763 Jun 22 10:16:47.988223 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 78/163] 10.222.0.43 () {58 vars in 1274 bytes} [Wed Jun 22 10:16:47 2022] GET /compute/v2.1/servers/eb851ab6-0e89-41d2-be52-d76cdc8644d6/os-interface => generated 285 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 10:16:48.079980 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [None req-d93f3553-28b8-4167-af3e-4610e01a41d3 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] 10.222.0.43 "POST /compute/v2.1/servers/9f07e4bb-f4e9-428e-8feb-db50b3ff2109/action" status: 200 len: 32 microversion: 2.1 time: 0.176890 Jun 22 10:16:48.080663 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 86/164] 10.222.0.43 () {60 vars in 1277 bytes} [Wed Jun 22 10:16:47 2022] POST /compute/v2.1/servers/9f07e4bb-f4e9-428e-8feb-db50b3ff2109/action => generated 32 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 22 10:16:48.098595 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-c707f1d3-45ae-42fd-9e33-5f645969d46c tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Calling method '>' {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:16:48.105217 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.compute.api [None req-c707f1d3-45ae-42fd-9e33-5f645969d46c tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] [instance: 9f07e4bb-f4e9-428e-8feb-db50b3ff2109] Fetching instance by UUID {{(pid=117873) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:16:48.113467 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-c707f1d3-45ae-42fd-9e33-5f645969d46c tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:16:48.114276 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-c707f1d3-45ae-42fd-9e33-5f645969d46c tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:16:48.115053 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-c707f1d3-45ae-42fd-9e33-5f645969d46c tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:16:48.115486 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-c707f1d3-45ae-42fd-9e33-5f645969d46c tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:16:48.246615 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.policy [None req-c707f1d3-45ae-42fd-9e33-5f645969d46c tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d7292401816437fba46d073c4746e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3277b9cbc4b4a8bbacee8440cea1ed2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117873) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:16:48.254873 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [None req-c707f1d3-45ae-42fd-9e33-5f645969d46c tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] 10.222.0.43 "GET /compute/v2.1/servers/9f07e4bb-f4e9-428e-8feb-db50b3ff2109" status: 200 len: 1521 microversion: 2.1 time: 0.169157 Jun 22 10:16:48.255662 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 79/165] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:16:48 2022] GET /compute/v2.1/servers/9f07e4bb-f4e9-428e-8feb-db50b3ff2109 => generated 1521 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:16:48.995361 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [req-622a59ef-2b79-4216-9767-613a160b6803 req-045747f1-8f2c-4cde-9f24-b18922bd49d2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eb851ab6-0e89-41d2-be52-d76cdc8644d6", "tag": "d017dd0e-ef63-4ffa-af06-35b32a6bf63f"}]} {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:16:49.008593 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [req-622a59ef-2b79-4216-9767-613a160b6803 req-045747f1-8f2c-4cde-9f24-b18922bd49d2 service nova] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:16:49.009464 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [req-622a59ef-2b79-4216-9767-613a160b6803 req-045747f1-8f2c-4cde-9f24-b18922bd49d2 service nova] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:16:49.021750 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.compute.server_external_events [req-622a59ef-2b79-4216-9767-613a160b6803 req-045747f1-8f2c-4cde-9f24-b18922bd49d2 service nova] Creating event network-changed:d017dd0e-ef63-4ffa-af06-35b32a6bf63f for instance eb851ab6-0e89-41d2-be52-d76cdc8644d6 on hv-cinder-84713 Jun 22 10:16:49.026559 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [req-622a59ef-2b79-4216-9767-613a160b6803 req-045747f1-8f2c-4cde-9f24-b18922bd49d2 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035372 Jun 22 10:16:49.027240 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 87/166] 10.222.0.43 () {64 vars in 1317 bytes} [Wed Jun 22 10:16:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 10:16:49.272742 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-6de26883-ad19-4a3b-a4f6-68258317e090 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Calling method '>' {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:16:49.273281 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.compute.api [None req-6de26883-ad19-4a3b-a4f6-68258317e090 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] [instance: 9f07e4bb-f4e9-428e-8feb-db50b3ff2109] Fetching instance by UUID {{(pid=117873) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:16:49.279665 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-6de26883-ad19-4a3b-a4f6-68258317e090 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:16:49.279978 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-6de26883-ad19-4a3b-a4f6-68258317e090 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:16:49.281031 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-6de26883-ad19-4a3b-a4f6-68258317e090 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:16:49.281470 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-6de26883-ad19-4a3b-a4f6-68258317e090 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:16:49.427030 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.policy [None req-6de26883-ad19-4a3b-a4f6-68258317e090 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d7292401816437fba46d073c4746e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3277b9cbc4b4a8bbacee8440cea1ed2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117873) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:16:49.434705 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [None req-6de26883-ad19-4a3b-a4f6-68258317e090 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] 10.222.0.43 "GET /compute/v2.1/servers/9f07e4bb-f4e9-428e-8feb-db50b3ff2109" status: 200 len: 1521 microversion: 2.1 time: 0.166983 Jun 22 10:16:49.435750 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 80/167] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:16:49 2022] GET /compute/v2.1/servers/9f07e4bb-f4e9-428e-8feb-db50b3ff2109 => generated 1521 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:16:50.453503 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-b186c014-aca9-4b86-9554-628638104ec8 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Calling method '>' {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:16:50.454219 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.compute.api [None req-b186c014-aca9-4b86-9554-628638104ec8 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] [instance: 9f07e4bb-f4e9-428e-8feb-db50b3ff2109] Fetching instance by UUID {{(pid=117874) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:16:50.461161 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-b186c014-aca9-4b86-9554-628638104ec8 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:16:50.461623 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-b186c014-aca9-4b86-9554-628638104ec8 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:16:50.462401 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-b186c014-aca9-4b86-9554-628638104ec8 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:16:50.462836 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-b186c014-aca9-4b86-9554-628638104ec8 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:16:50.632772 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.policy [None req-b186c014-aca9-4b86-9554-628638104ec8 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d7292401816437fba46d073c4746e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3277b9cbc4b4a8bbacee8440cea1ed2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117874) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:16:50.642017 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [None req-b186c014-aca9-4b86-9554-628638104ec8 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] 10.222.0.43 "GET /compute/v2.1/servers/9f07e4bb-f4e9-428e-8feb-db50b3ff2109" status: 200 len: 1521 microversion: 2.1 time: 0.193323 Jun 22 10:16:50.642675 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 88/168] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:16:50 2022] GET /compute/v2.1/servers/9f07e4bb-f4e9-428e-8feb-db50b3ff2109 => generated 1521 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:16:50.923683 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-096b56c7-9a87-4c21-bfdf-38f1ad749a8e tempest-DeleteServersTestJSON-502292925 tempest-DeleteServersTestJSON-502292925-project] Calling method '>' {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:16:50.924295 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.compute.api [None req-096b56c7-9a87-4c21-bfdf-38f1ad749a8e tempest-DeleteServersTestJSON-502292925 tempest-DeleteServersTestJSON-502292925-project] [instance: 8b3f01d1-ac00-4bfb-8ae3-be75720b8ad1] Fetching instance by UUID {{(pid=117873) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:16:50.926127 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG dbcounter [-] [117873] Writing DB stats nova_api:SELECT=92 {{(pid=117873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:16:50.931603 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-096b56c7-9a87-4c21-bfdf-38f1ad749a8e tempest-DeleteServersTestJSON-502292925 tempest-DeleteServersTestJSON-502292925-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:16:50.932085 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-096b56c7-9a87-4c21-bfdf-38f1ad749a8e tempest-DeleteServersTestJSON-502292925 tempest-DeleteServersTestJSON-502292925-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:16:50.932908 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-096b56c7-9a87-4c21-bfdf-38f1ad749a8e tempest-DeleteServersTestJSON-502292925 tempest-DeleteServersTestJSON-502292925-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:16:50.933362 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-096b56c7-9a87-4c21-bfdf-38f1ad749a8e tempest-DeleteServersTestJSON-502292925 tempest-DeleteServersTestJSON-502292925-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:16:50.960813 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.compute.api [None req-096b56c7-9a87-4c21-bfdf-38f1ad749a8e tempest-DeleteServersTestJSON-502292925 tempest-DeleteServersTestJSON-502292925-project] [instance: 8b3f01d1-ac00-4bfb-8ae3-be75720b8ad1] Going to try to terminate instance {{(pid=117873) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 22 10:16:51.051555 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [None req-096b56c7-9a87-4c21-bfdf-38f1ad749a8e tempest-DeleteServersTestJSON-502292925 tempest-DeleteServersTestJSON-502292925-project] 10.222.0.43 "DELETE /compute/v2.1/servers/8b3f01d1-ac00-4bfb-8ae3-be75720b8ad1" status: 204 len: 0 microversion: 2.1 time: 0.131524 Jun 22 10:16:51.052156 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 81/169] 10.222.0.43 () {58 vars in 1238 bytes} [Wed Jun 22 10:16:50 2022] DELETE /compute/v2.1/servers/8b3f01d1-ac00-4bfb-8ae3-be75720b8ad1 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 22 10:16:51.060045 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-e21a0bb3-3a0d-44be-af3f-89efd3dec610 tempest-DeleteServersTestJSON-502292925 tempest-DeleteServersTestJSON-502292925-project] Calling method '>' {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:16:51.060655 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.compute.api [None req-e21a0bb3-3a0d-44be-af3f-89efd3dec610 tempest-DeleteServersTestJSON-502292925 tempest-DeleteServersTestJSON-502292925-project] [instance: 8b3f01d1-ac00-4bfb-8ae3-be75720b8ad1] Fetching instance by UUID {{(pid=117874) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:16:51.067212 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-e21a0bb3-3a0d-44be-af3f-89efd3dec610 tempest-DeleteServersTestJSON-502292925 tempest-DeleteServersTestJSON-502292925-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:16:51.067659 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-e21a0bb3-3a0d-44be-af3f-89efd3dec610 tempest-DeleteServersTestJSON-502292925 tempest-DeleteServersTestJSON-502292925-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:16:51.068410 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-e21a0bb3-3a0d-44be-af3f-89efd3dec610 tempest-DeleteServersTestJSON-502292925 tempest-DeleteServersTestJSON-502292925-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:16:51.068844 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-e21a0bb3-3a0d-44be-af3f-89efd3dec610 tempest-DeleteServersTestJSON-502292925 tempest-DeleteServersTestJSON-502292925-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:16:51.196191 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.policy [None req-e21a0bb3-3a0d-44be-af3f-89efd3dec610 tempest-DeleteServersTestJSON-502292925 tempest-DeleteServersTestJSON-502292925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3af9bfaaaa4dcca0747f776115c826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4765b82e21647a9b391a98f446a0e17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117874) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:16:51.204111 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [None req-e21a0bb3-3a0d-44be-af3f-89efd3dec610 tempest-DeleteServersTestJSON-502292925 tempest-DeleteServersTestJSON-502292925-project] 10.222.0.43 "GET /compute/v2.1/servers/8b3f01d1-ac00-4bfb-8ae3-be75720b8ad1" status: 200 len: 1553 microversion: 2.1 time: 0.147797 Jun 22 10:16:51.204680 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 89/170] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:16:51 2022] GET /compute/v2.1/servers/8b3f01d1-ac00-4bfb-8ae3-be75720b8ad1 => generated 1553 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:16:51.663445 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-54717f65-2efb-4575-add4-985cae9cc552 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Calling method '>' {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:16:51.664133 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.compute.api [None req-54717f65-2efb-4575-add4-985cae9cc552 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] [instance: 9f07e4bb-f4e9-428e-8feb-db50b3ff2109] Fetching instance by UUID {{(pid=117873) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:16:51.670443 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-54717f65-2efb-4575-add4-985cae9cc552 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:16:51.671252 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-54717f65-2efb-4575-add4-985cae9cc552 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:16:51.672614 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-54717f65-2efb-4575-add4-985cae9cc552 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:16:51.673070 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-54717f65-2efb-4575-add4-985cae9cc552 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:16:51.809438 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.policy [None req-54717f65-2efb-4575-add4-985cae9cc552 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d7292401816437fba46d073c4746e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3277b9cbc4b4a8bbacee8440cea1ed2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117873) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:16:51.817517 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [None req-54717f65-2efb-4575-add4-985cae9cc552 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] 10.222.0.43 "GET /compute/v2.1/servers/9f07e4bb-f4e9-428e-8feb-db50b3ff2109" status: 200 len: 1521 microversion: 2.1 time: 0.158601 Jun 22 10:16:51.818304 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 82/171] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:16:51 2022] GET /compute/v2.1/servers/9f07e4bb-f4e9-428e-8feb-db50b3ff2109 => generated 1521 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:16:52.222354 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-9d5c719d-02ea-4cd8-abe3-3f6a89e9491b tempest-DeleteServersTestJSON-502292925 tempest-DeleteServersTestJSON-502292925-project] Calling method '>' {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:16:52.222955 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.compute.api [None req-9d5c719d-02ea-4cd8-abe3-3f6a89e9491b tempest-DeleteServersTestJSON-502292925 tempest-DeleteServersTestJSON-502292925-project] [instance: 8b3f01d1-ac00-4bfb-8ae3-be75720b8ad1] Fetching instance by UUID {{(pid=117874) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:16:52.229954 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-9d5c719d-02ea-4cd8-abe3-3f6a89e9491b tempest-DeleteServersTestJSON-502292925 tempest-DeleteServersTestJSON-502292925-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:16:52.230398 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-9d5c719d-02ea-4cd8-abe3-3f6a89e9491b tempest-DeleteServersTestJSON-502292925 tempest-DeleteServersTestJSON-502292925-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:16:52.231155 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-9d5c719d-02ea-4cd8-abe3-3f6a89e9491b tempest-DeleteServersTestJSON-502292925 tempest-DeleteServersTestJSON-502292925-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:16:52.231618 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-9d5c719d-02ea-4cd8-abe3-3f6a89e9491b tempest-DeleteServersTestJSON-502292925 tempest-DeleteServersTestJSON-502292925-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:16:52.364820 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.policy [None req-9d5c719d-02ea-4cd8-abe3-3f6a89e9491b tempest-DeleteServersTestJSON-502292925 tempest-DeleteServersTestJSON-502292925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3af9bfaaaa4dcca0747f776115c826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4765b82e21647a9b391a98f446a0e17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117874) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:16:52.373439 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [None req-9d5c719d-02ea-4cd8-abe3-3f6a89e9491b tempest-DeleteServersTestJSON-502292925 tempest-DeleteServersTestJSON-502292925-project] 10.222.0.43 "GET /compute/v2.1/servers/8b3f01d1-ac00-4bfb-8ae3-be75720b8ad1" status: 200 len: 1553 microversion: 2.1 time: 0.155487 Jun 22 10:16:52.374037 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 90/172] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:16:52 2022] GET /compute/v2.1/servers/8b3f01d1-ac00-4bfb-8ae3-be75720b8ad1 => generated 1553 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:16:52.834821 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-f83c3dbd-d0a4-42ba-9bd4-2bbddb465e6d tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Calling method '>' {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:16:52.835421 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.compute.api [None req-f83c3dbd-d0a4-42ba-9bd4-2bbddb465e6d tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] [instance: 9f07e4bb-f4e9-428e-8feb-db50b3ff2109] Fetching instance by UUID {{(pid=117873) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:16:52.841528 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-f83c3dbd-d0a4-42ba-9bd4-2bbddb465e6d tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:16:52.842002 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-f83c3dbd-d0a4-42ba-9bd4-2bbddb465e6d tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:16:52.842748 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-f83c3dbd-d0a4-42ba-9bd4-2bbddb465e6d tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:16:52.843182 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-f83c3dbd-d0a4-42ba-9bd4-2bbddb465e6d tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:16:52.977530 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.policy [None req-f83c3dbd-d0a4-42ba-9bd4-2bbddb465e6d tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d7292401816437fba46d073c4746e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3277b9cbc4b4a8bbacee8440cea1ed2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117873) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:16:52.985205 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [None req-f83c3dbd-d0a4-42ba-9bd4-2bbddb465e6d tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] 10.222.0.43 "GET /compute/v2.1/servers/9f07e4bb-f4e9-428e-8feb-db50b3ff2109" status: 200 len: 1521 microversion: 2.1 time: 0.154189 Jun 22 10:16:52.985809 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 83/173] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:16:52 2022] GET /compute/v2.1/servers/9f07e4bb-f4e9-428e-8feb-db50b3ff2109 => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:16:53.390967 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-129e8274-9f63-4fa6-a790-e5353aea8a6f tempest-DeleteServersTestJSON-502292925 tempest-DeleteServersTestJSON-502292925-project] Calling method '>' {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:16:53.391484 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.compute.api [None req-129e8274-9f63-4fa6-a790-e5353aea8a6f tempest-DeleteServersTestJSON-502292925 tempest-DeleteServersTestJSON-502292925-project] [instance: 8b3f01d1-ac00-4bfb-8ae3-be75720b8ad1] Fetching instance by UUID {{(pid=117874) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:16:53.398345 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-129e8274-9f63-4fa6-a790-e5353aea8a6f tempest-DeleteServersTestJSON-502292925 tempest-DeleteServersTestJSON-502292925-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:16:53.398795 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-129e8274-9f63-4fa6-a790-e5353aea8a6f tempest-DeleteServersTestJSON-502292925 tempest-DeleteServersTestJSON-502292925-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:16:53.399553 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-129e8274-9f63-4fa6-a790-e5353aea8a6f tempest-DeleteServersTestJSON-502292925 tempest-DeleteServersTestJSON-502292925-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:16:53.399984 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-129e8274-9f63-4fa6-a790-e5353aea8a6f tempest-DeleteServersTestJSON-502292925 tempest-DeleteServersTestJSON-502292925-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:16:53.610606 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.policy [None req-129e8274-9f63-4fa6-a790-e5353aea8a6f tempest-DeleteServersTestJSON-502292925 tempest-DeleteServersTestJSON-502292925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3af9bfaaaa4dcca0747f776115c826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4765b82e21647a9b391a98f446a0e17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117874) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:16:53.619292 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [None req-129e8274-9f63-4fa6-a790-e5353aea8a6f tempest-DeleteServersTestJSON-502292925 tempest-DeleteServersTestJSON-502292925-project] 10.222.0.43 "GET /compute/v2.1/servers/8b3f01d1-ac00-4bfb-8ae3-be75720b8ad1" status: 200 len: 1553 microversion: 2.1 time: 0.232297 Jun 22 10:16:53.619869 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 91/174] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:16:53 2022] GET /compute/v2.1/servers/8b3f01d1-ac00-4bfb-8ae3-be75720b8ad1 => generated 1553 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:16:54.002809 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-5b556b61-6dba-44e2-b46a-6a426e2bf822 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Calling method '>' {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:16:54.003768 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.compute.api [None req-5b556b61-6dba-44e2-b46a-6a426e2bf822 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] [instance: 9f07e4bb-f4e9-428e-8feb-db50b3ff2109] Fetching instance by UUID {{(pid=117873) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:16:54.009510 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-5b556b61-6dba-44e2-b46a-6a426e2bf822 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:16:54.010038 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-5b556b61-6dba-44e2-b46a-6a426e2bf822 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:16:54.010792 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-5b556b61-6dba-44e2-b46a-6a426e2bf822 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:16:54.011224 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-5b556b61-6dba-44e2-b46a-6a426e2bf822 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:16:54.140393 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.policy [None req-5b556b61-6dba-44e2-b46a-6a426e2bf822 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d7292401816437fba46d073c4746e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3277b9cbc4b4a8bbacee8440cea1ed2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117873) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:16:54.148304 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [None req-5b556b61-6dba-44e2-b46a-6a426e2bf822 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] 10.222.0.43 "GET /compute/v2.1/servers/9f07e4bb-f4e9-428e-8feb-db50b3ff2109" status: 200 len: 1521 microversion: 2.1 time: 0.149808 Jun 22 10:16:54.148803 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 84/175] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:16:53 2022] GET /compute/v2.1/servers/9f07e4bb-f4e9-428e-8feb-db50b3ff2109 => generated 1521 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:16:54.637036 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-f964ee92-b228-4d14-a7cb-746285eb7780 tempest-DeleteServersTestJSON-502292925 tempest-DeleteServersTestJSON-502292925-project] Calling method '>' {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:16:54.637902 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.compute.api [None req-f964ee92-b228-4d14-a7cb-746285eb7780 tempest-DeleteServersTestJSON-502292925 tempest-DeleteServersTestJSON-502292925-project] [instance: 8b3f01d1-ac00-4bfb-8ae3-be75720b8ad1] Fetching instance by UUID {{(pid=117874) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:16:54.646825 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-f964ee92-b228-4d14-a7cb-746285eb7780 tempest-DeleteServersTestJSON-502292925 tempest-DeleteServersTestJSON-502292925-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:16:54.647281 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-f964ee92-b228-4d14-a7cb-746285eb7780 tempest-DeleteServersTestJSON-502292925 tempest-DeleteServersTestJSON-502292925-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:16:54.648037 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-f964ee92-b228-4d14-a7cb-746285eb7780 tempest-DeleteServersTestJSON-502292925 tempest-DeleteServersTestJSON-502292925-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:16:54.648471 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-f964ee92-b228-4d14-a7cb-746285eb7780 tempest-DeleteServersTestJSON-502292925 tempest-DeleteServersTestJSON-502292925-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:16:54.788020 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.policy [None req-f964ee92-b228-4d14-a7cb-746285eb7780 tempest-DeleteServersTestJSON-502292925 tempest-DeleteServersTestJSON-502292925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3af9bfaaaa4dcca0747f776115c826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4765b82e21647a9b391a98f446a0e17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117874) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:16:54.796052 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [None req-f964ee92-b228-4d14-a7cb-746285eb7780 tempest-DeleteServersTestJSON-502292925 tempest-DeleteServersTestJSON-502292925-project] 10.222.0.43 "GET /compute/v2.1/servers/8b3f01d1-ac00-4bfb-8ae3-be75720b8ad1" status: 200 len: 1553 microversion: 2.1 time: 0.163604 Jun 22 10:16:54.796614 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 92/176] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:16:54 2022] GET /compute/v2.1/servers/8b3f01d1-ac00-4bfb-8ae3-be75720b8ad1 => generated 1553 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:16:55.169573 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-b287ceb9-a80d-4dcf-b366-5c882fa7b54c tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Calling method '>' {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:16:55.170497 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.compute.api [None req-b287ceb9-a80d-4dcf-b366-5c882fa7b54c tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] [instance: 9f07e4bb-f4e9-428e-8feb-db50b3ff2109] Fetching instance by UUID {{(pid=117873) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:16:55.179136 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-b287ceb9-a80d-4dcf-b366-5c882fa7b54c tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:16:55.179802 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-b287ceb9-a80d-4dcf-b366-5c882fa7b54c tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:16:55.180725 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-b287ceb9-a80d-4dcf-b366-5c882fa7b54c tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:16:55.181375 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-b287ceb9-a80d-4dcf-b366-5c882fa7b54c tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:16:55.201948 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG dbcounter [-] [117873] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:16:55.413493 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.policy [None req-b287ceb9-a80d-4dcf-b366-5c882fa7b54c tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d7292401816437fba46d073c4746e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3277b9cbc4b4a8bbacee8440cea1ed2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117873) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:16:55.421966 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [None req-b287ceb9-a80d-4dcf-b366-5c882fa7b54c tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] 10.222.0.43 "GET /compute/v2.1/servers/9f07e4bb-f4e9-428e-8feb-db50b3ff2109" status: 200 len: 1521 microversion: 2.1 time: 0.258113 Jun 22 10:16:55.422890 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 85/177] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:16:55 2022] GET /compute/v2.1/servers/9f07e4bb-f4e9-428e-8feb-db50b3ff2109 => generated 1521 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:16:55.812932 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-6e876624-f27d-4c0d-9db2-6ae42d5aa0e8 tempest-DeleteServersTestJSON-502292925 tempest-DeleteServersTestJSON-502292925-project] Calling method '>' {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:16:55.813468 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.compute.api [None req-6e876624-f27d-4c0d-9db2-6ae42d5aa0e8 tempest-DeleteServersTestJSON-502292925 tempest-DeleteServersTestJSON-502292925-project] [instance: 8b3f01d1-ac00-4bfb-8ae3-be75720b8ad1] Fetching instance by UUID {{(pid=117874) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:16:55.821282 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-6e876624-f27d-4c0d-9db2-6ae42d5aa0e8 tempest-DeleteServersTestJSON-502292925 tempest-DeleteServersTestJSON-502292925-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:16:55.821781 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-6e876624-f27d-4c0d-9db2-6ae42d5aa0e8 tempest-DeleteServersTestJSON-502292925 tempest-DeleteServersTestJSON-502292925-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:16:55.822628 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-6e876624-f27d-4c0d-9db2-6ae42d5aa0e8 tempest-DeleteServersTestJSON-502292925 tempest-DeleteServersTestJSON-502292925-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:16:55.823062 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-6e876624-f27d-4c0d-9db2-6ae42d5aa0e8 tempest-DeleteServersTestJSON-502292925 tempest-DeleteServersTestJSON-502292925-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:16:56.033804 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.policy [None req-6e876624-f27d-4c0d-9db2-6ae42d5aa0e8 tempest-DeleteServersTestJSON-502292925 tempest-DeleteServersTestJSON-502292925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3af9bfaaaa4dcca0747f776115c826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4765b82e21647a9b391a98f446a0e17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117874) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:16:56.043222 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [None req-6e876624-f27d-4c0d-9db2-6ae42d5aa0e8 tempest-DeleteServersTestJSON-502292925 tempest-DeleteServersTestJSON-502292925-project] 10.222.0.43 "GET /compute/v2.1/servers/8b3f01d1-ac00-4bfb-8ae3-be75720b8ad1" status: 200 len: 1553 microversion: 2.1 time: 0.234053 Jun 22 10:16:56.046003 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 93/178] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:16:55 2022] GET /compute/v2.1/servers/8b3f01d1-ac00-4bfb-8ae3-be75720b8ad1 => generated 1553 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:16:56.439929 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-6d6729e1-cabf-4069-88df-879cd773ccc8 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Calling method '>' {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:16:56.441201 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.compute.api [None req-6d6729e1-cabf-4069-88df-879cd773ccc8 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] [instance: 9f07e4bb-f4e9-428e-8feb-db50b3ff2109] Fetching instance by UUID {{(pid=117873) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:16:56.449536 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-6d6729e1-cabf-4069-88df-879cd773ccc8 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:16:56.450142 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-6d6729e1-cabf-4069-88df-879cd773ccc8 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:16:56.451011 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-6d6729e1-cabf-4069-88df-879cd773ccc8 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:16:56.451507 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-6d6729e1-cabf-4069-88df-879cd773ccc8 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:16:56.663506 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.policy [None req-6d6729e1-cabf-4069-88df-879cd773ccc8 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d7292401816437fba46d073c4746e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3277b9cbc4b4a8bbacee8440cea1ed2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117873) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:16:56.671622 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [None req-6d6729e1-cabf-4069-88df-879cd773ccc8 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] 10.222.0.43 "GET /compute/v2.1/servers/9f07e4bb-f4e9-428e-8feb-db50b3ff2109" status: 200 len: 1521 microversion: 2.1 time: 0.236482 Jun 22 10:16:56.672390 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 86/179] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:16:56 2022] GET /compute/v2.1/servers/9f07e4bb-f4e9-428e-8feb-db50b3ff2109 => generated 1521 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:16:56.689671 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [req-4ee67f82-3f4e-41f6-9a75-24ea68f2186c req-f8e84cd4-3bc7-48c9-81e3-25092af50dec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8b3f01d1-ac00-4bfb-8ae3-be75720b8ad1", "name": "network-vif-deleted", "tag": "bd80709c-555a-4184-b601-e49f7cd8bdc4"}]} {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:16:56.700295 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [req-4ee67f82-3f4e-41f6-9a75-24ea68f2186c req-f8e84cd4-3bc7-48c9-81e3-25092af50dec service nova] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:16:56.700986 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [req-4ee67f82-3f4e-41f6-9a75-24ea68f2186c req-f8e84cd4-3bc7-48c9-81e3-25092af50dec service nova] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:16:56.712952 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.compute.server_external_events [req-4ee67f82-3f4e-41f6-9a75-24ea68f2186c req-f8e84cd4-3bc7-48c9-81e3-25092af50dec service nova] Creating event network-vif-deleted:bd80709c-555a-4184-b601-e49f7cd8bdc4 for instance 8b3f01d1-ac00-4bfb-8ae3-be75720b8ad1 on hv-cinder-84713 Jun 22 10:16:56.718105 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [req-4ee67f82-3f4e-41f6-9a75-24ea68f2186c req-f8e84cd4-3bc7-48c9-81e3-25092af50dec service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031993 Jun 22 10:16:56.718983 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 94/180] 10.222.0.43 () {64 vars in 1317 bytes} [Wed Jun 22 10:16:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 22 10:16:57.061365 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-c4b2b520-704c-47cd-b5ca-dcc8bba46475 tempest-DeleteServersTestJSON-502292925 tempest-DeleteServersTestJSON-502292925-project] Calling method '>' {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:16:57.061998 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.compute.api [None req-c4b2b520-704c-47cd-b5ca-dcc8bba46475 tempest-DeleteServersTestJSON-502292925 tempest-DeleteServersTestJSON-502292925-project] [instance: 8b3f01d1-ac00-4bfb-8ae3-be75720b8ad1] Fetching instance by UUID {{(pid=117873) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:16:57.069501 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-c4b2b520-704c-47cd-b5ca-dcc8bba46475 tempest-DeleteServersTestJSON-502292925 tempest-DeleteServersTestJSON-502292925-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:16:57.070059 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-c4b2b520-704c-47cd-b5ca-dcc8bba46475 tempest-DeleteServersTestJSON-502292925 tempest-DeleteServersTestJSON-502292925-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:16:57.071082 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-c4b2b520-704c-47cd-b5ca-dcc8bba46475 tempest-DeleteServersTestJSON-502292925 tempest-DeleteServersTestJSON-502292925-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:16:57.071513 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-c4b2b520-704c-47cd-b5ca-dcc8bba46475 tempest-DeleteServersTestJSON-502292925 tempest-DeleteServersTestJSON-502292925-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:16:57.141331 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.policy [None req-c4b2b520-704c-47cd-b5ca-dcc8bba46475 tempest-DeleteServersTestJSON-502292925 tempest-DeleteServersTestJSON-502292925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b3af9bfaaaa4dcca0747f776115c826', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4765b82e21647a9b391a98f446a0e17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117873) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:16:57.149971 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [None req-c4b2b520-704c-47cd-b5ca-dcc8bba46475 tempest-DeleteServersTestJSON-502292925 tempest-DeleteServersTestJSON-502292925-project] 10.222.0.43 "GET /compute/v2.1/servers/8b3f01d1-ac00-4bfb-8ae3-be75720b8ad1" status: 200 len: 1345 microversion: 2.1 time: 0.092315 Jun 22 10:16:57.150524 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 87/181] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:16:57 2022] GET /compute/v2.1/servers/8b3f01d1-ac00-4bfb-8ae3-be75720b8ad1 => generated 1345 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:16:57.695011 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-6049712a-91d3-4a0a-82ff-e1610312380d tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Calling method '>' {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:16:57.696613 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.compute.api [None req-6049712a-91d3-4a0a-82ff-e1610312380d tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] [instance: 9f07e4bb-f4e9-428e-8feb-db50b3ff2109] Fetching instance by UUID {{(pid=117874) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:16:57.703925 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-6049712a-91d3-4a0a-82ff-e1610312380d tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:16:57.704366 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-6049712a-91d3-4a0a-82ff-e1610312380d tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:16:57.705446 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-6049712a-91d3-4a0a-82ff-e1610312380d tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:16:57.706714 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-6049712a-91d3-4a0a-82ff-e1610312380d tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:16:57.865884 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.policy [None req-6049712a-91d3-4a0a-82ff-e1610312380d tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d7292401816437fba46d073c4746e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3277b9cbc4b4a8bbacee8440cea1ed2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117874) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:16:57.875758 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [None req-6049712a-91d3-4a0a-82ff-e1610312380d tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] 10.222.0.43 "GET /compute/v2.1/servers/9f07e4bb-f4e9-428e-8feb-db50b3ff2109" status: 200 len: 1521 microversion: 2.1 time: 0.187535 Jun 22 10:16:57.876377 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 95/182] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:16:57 2022] GET /compute/v2.1/servers/9f07e4bb-f4e9-428e-8feb-db50b3ff2109 => generated 1521 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:16:58.166741 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-42226d93-db5b-4841-8fb0-686058bc1953 tempest-DeleteServersTestJSON-502292925 tempest-DeleteServersTestJSON-502292925-project] Calling method '>' {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:16:58.167473 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.compute.api [None req-42226d93-db5b-4841-8fb0-686058bc1953 tempest-DeleteServersTestJSON-502292925 tempest-DeleteServersTestJSON-502292925-project] [instance: 8b3f01d1-ac00-4bfb-8ae3-be75720b8ad1] Fetching instance by UUID {{(pid=117873) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:16:58.173613 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-42226d93-db5b-4841-8fb0-686058bc1953 tempest-DeleteServersTestJSON-502292925 tempest-DeleteServersTestJSON-502292925-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:16:58.173943 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-42226d93-db5b-4841-8fb0-686058bc1953 tempest-DeleteServersTestJSON-502292925 tempest-DeleteServersTestJSON-502292925-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:16:58.174693 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-42226d93-db5b-4841-8fb0-686058bc1953 tempest-DeleteServersTestJSON-502292925 tempest-DeleteServersTestJSON-502292925-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:16:58.175627 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-42226d93-db5b-4841-8fb0-686058bc1953 tempest-DeleteServersTestJSON-502292925 tempest-DeleteServersTestJSON-502292925-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:16:58.189158 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.wsgi [None req-42226d93-db5b-4841-8fb0-686058bc1953 tempest-DeleteServersTestJSON-502292925 tempest-DeleteServersTestJSON-502292925-project] HTTP exception thrown: Instance 8b3f01d1-ac00-4bfb-8ae3-be75720b8ad1 could not be found. Jun 22 10:16:58.194457 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-42226d93-db5b-4841-8fb0-686058bc1953 tempest-DeleteServersTestJSON-502292925 tempest-DeleteServersTestJSON-502292925-project] Request method failure captured: Jun 22 10:16:58.194457 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: request: GET /compute/v2.1/servers/8b3f01d1-ac00-4bfb-8ae3-be75720b8ad1 HTTP/1.1 Jun 22 10:16:58.194457 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: Accept: application/json Jun 22 10:16:58.194457 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: Accept-Encoding: identity Jun 22 10:16:58.194457 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: Connection: close Jun 22 10:16:58.194457 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: Content-Length: 0 Jun 22 10:16:58.194457 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: Content-Type: application/json Jun 22 10:16:58.194457 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: Host: 10.222.0.43 Jun 22 10:16:58.194457 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: Openstack-System-Scope: None Jun 22 10:16:58.194457 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: User-Agent: python-urllib3/1.26.9 Jun 22 10:16:58.194457 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-Auth-Token: gAAAAABisuvZxUmWWDyV4xe8MS3_EEJcm4nDjqQZWZvTR547LPTjqoA6kuny8tdTqaBh0slR3C1AaP22JxJJMYd2ff06wJkWycxmXKuSmg8zJInkyFZ4vnmEO-trEpbVFoyqajniyNE0YaOebUeg8loF-fG9f-sYWCV5rQXUcvYRR8gKNhEoJWk Jun 22 10:16:58.194457 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-Domain-Id: None Jun 22 10:16:58.194457 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-Domain-Name: None Jun 22 10:16:58.194457 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-Identity-Status: Confirmed Jun 22 10:16:58.194457 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-Is-Admin-Project: True Jun 22 10:16:58.194457 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-Project-Domain-Id: default Jun 22 10:16:58.194457 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-Project-Domain-Name: Default Jun 22 10:16:58.194457 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-Project-Id: d4765b82e21647a9b391a98f446a0e17 Jun 22 10:16:58.194457 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-Project-Name: tempest-DeleteServersTestJSON-502292925 Jun 22 10:16:58.194457 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-Role: reader,member Jun 22 10:16:58.194457 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-Roles: reader,member Jun 22 10:16:58.195723 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/d4765b82e21647a9b391a98f446a0e17"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/d4765b82e21647a9b391a98f446a0e17"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_d4765b82e21647a9b391a98f446a0e17", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/d4765b82e21647a9b391a98f446a0e17"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}] Jun 22 10:16:58.195723 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-Tenant: tempest-DeleteServersTestJSON-502292925 Jun 22 10:16:58.195723 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-Tenant-Id: d4765b82e21647a9b391a98f446a0e17 Jun 22 10:16:58.195723 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-Tenant-Name: tempest-DeleteServersTestJSON-502292925 Jun 22 10:16:58.195723 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-User: tempest-DeleteServersTestJSON-502292925-project Jun 22 10:16:58.195723 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-User-Domain-Id: default Jun 22 10:16:58.195723 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-User-Domain-Name: Default Jun 22 10:16:58.195723 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-User-Id: 2b3af9bfaaaa4dcca0747f776115c826 Jun 22 10:16:58.195723 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-User-Name: tempest-DeleteServersTestJSON-502292925-project Jun 22 10:16:58.195723 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: method: > Jun 22 10:16:58.195723 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: exception: Instance 8b3f01d1-ac00-4bfb-8ae3-be75720b8ad1 could not be found. Jun 22 10:16:58.195723 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: action_args: {'id': '8b3f01d1-ac00-4bfb-8ae3-be75720b8ad1'} Jun 22 10:16:58.196394 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 10:16:58.196394 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:16:58.196394 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 22 10:16:58.196394 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 22 10:16:58.196394 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 22 10:16:58.196394 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 22 10:16:58.196394 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 22 10:16:58.196394 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 22 10:16:58.196394 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 22 10:16:58.196394 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 22 10:16:58.196394 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8b3f01d1-ac00-4bfb-8ae3-be75720b8ad1 could not be found. Jun 22 10:16:58.196394 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi Jun 22 10:16:58.196394 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 10:16:58.196394 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi Jun 22 10:16:58.196394 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:16:58.196394 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 10:16:58.196394 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 10:16:58.196394 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 10:16:58.196394 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 10:16:58.196394 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 10:16:58.197494 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 10:16:58.197494 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 22 10:16:58.197494 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 22 10:16:58.197494 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 22 10:16:58.197494 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 22 10:16:58.197494 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 22 10:16:58.197494 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 22 10:16:58.197494 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8b3f01d1-ac00-4bfb-8ae3-be75720b8ad1 could not be found. Jun 22 10:16:58.197494 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi Jun 22 10:16:58.197494 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 10:16:58.197494 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi Jun 22 10:16:58.197494 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:16:58.197494 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 10:16:58.197494 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 10:16:58.197494 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 10:16:58.197494 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 10:16:58.197494 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8b3f01d1-ac00-4bfb-8ae3-be75720b8ad1 could not be found. Jun 22 10:16:58.197494 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi Jun 22 10:16:58.198497 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-42226d93-db5b-4841-8fb0-686058bc1953 tempest-DeleteServersTestJSON-502292925 tempest-DeleteServersTestJSON-502292925-project] Returning 404 to user: Instance 8b3f01d1-ac00-4bfb-8ae3-be75720b8ad1 could not be found. {{(pid=117873) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 10:16:58.198497 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [None req-42226d93-db5b-4841-8fb0-686058bc1953 tempest-DeleteServersTestJSON-502292925 tempest-DeleteServersTestJSON-502292925-project] 10.222.0.43 "GET /compute/v2.1/servers/8b3f01d1-ac00-4bfb-8ae3-be75720b8ad1" status: 404 len: 111 microversion: 2.1 time: 0.033097 Jun 22 10:16:58.198497 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 88/183] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:16:58 2022] GET /compute/v2.1/servers/8b3f01d1-ac00-4bfb-8ae3-be75720b8ad1 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 22 10:16:58.303747 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-b0670392-792d-4ea6-800d-73b57abce0ad tempest-DeleteServersTestJSON-502292925 tempest-DeleteServersTestJSON-502292925-project] Calling method '>' {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:16:58.304707 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.compute.api [None req-b0670392-792d-4ea6-800d-73b57abce0ad tempest-DeleteServersTestJSON-502292925 tempest-DeleteServersTestJSON-502292925-project] [instance: 8b3f01d1-ac00-4bfb-8ae3-be75720b8ad1] Fetching instance by UUID {{(pid=117874) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:16:58.311687 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-b0670392-792d-4ea6-800d-73b57abce0ad tempest-DeleteServersTestJSON-502292925 tempest-DeleteServersTestJSON-502292925-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:16:58.312191 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-b0670392-792d-4ea6-800d-73b57abce0ad tempest-DeleteServersTestJSON-502292925 tempest-DeleteServersTestJSON-502292925-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:16:58.313012 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-b0670392-792d-4ea6-800d-73b57abce0ad tempest-DeleteServersTestJSON-502292925 tempest-DeleteServersTestJSON-502292925-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:16:58.313451 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-b0670392-792d-4ea6-800d-73b57abce0ad tempest-DeleteServersTestJSON-502292925 tempest-DeleteServersTestJSON-502292925-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:16:58.327282 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.wsgi [None req-b0670392-792d-4ea6-800d-73b57abce0ad tempest-DeleteServersTestJSON-502292925 tempest-DeleteServersTestJSON-502292925-project] HTTP exception thrown: Instance 8b3f01d1-ac00-4bfb-8ae3-be75720b8ad1 could not be found. Jun 22 10:16:58.332163 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-b0670392-792d-4ea6-800d-73b57abce0ad tempest-DeleteServersTestJSON-502292925 tempest-DeleteServersTestJSON-502292925-project] Request method failure captured: Jun 22 10:16:58.332163 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: request: GET /compute/v2.1/servers/8b3f01d1-ac00-4bfb-8ae3-be75720b8ad1/os-volume_attachments HTTP/1.1 Jun 22 10:16:58.332163 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: Accept: application/json Jun 22 10:16:58.332163 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: Accept-Encoding: identity Jun 22 10:16:58.332163 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: Connection: close Jun 22 10:16:58.332163 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: Content-Length: 0 Jun 22 10:16:58.332163 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: Content-Type: application/json Jun 22 10:16:58.332163 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: Host: 10.222.0.43 Jun 22 10:16:58.332163 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: Openstack-System-Scope: None Jun 22 10:16:58.332163 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: User-Agent: python-urllib3/1.26.9 Jun 22 10:16:58.332163 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-Auth-Token: gAAAAABisuvZxUmWWDyV4xe8MS3_EEJcm4nDjqQZWZvTR547LPTjqoA6kuny8tdTqaBh0slR3C1AaP22JxJJMYd2ff06wJkWycxmXKuSmg8zJInkyFZ4vnmEO-trEpbVFoyqajniyNE0YaOebUeg8loF-fG9f-sYWCV5rQXUcvYRR8gKNhEoJWk Jun 22 10:16:58.332163 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-Domain-Id: None Jun 22 10:16:58.332163 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-Domain-Name: None Jun 22 10:16:58.332163 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-Identity-Status: Confirmed Jun 22 10:16:58.332163 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-Is-Admin-Project: True Jun 22 10:16:58.332163 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-Project-Domain-Id: default Jun 22 10:16:58.332163 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-Project-Domain-Name: Default Jun 22 10:16:58.332163 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-Project-Id: d4765b82e21647a9b391a98f446a0e17 Jun 22 10:16:58.332163 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-Project-Name: tempest-DeleteServersTestJSON-502292925 Jun 22 10:16:58.332163 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-Role: reader,member Jun 22 10:16:58.332163 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-Roles: reader,member Jun 22 10:16:58.333998 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/d4765b82e21647a9b391a98f446a0e17"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/d4765b82e21647a9b391a98f446a0e17"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_d4765b82e21647a9b391a98f446a0e17", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/d4765b82e21647a9b391a98f446a0e17"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}] Jun 22 10:16:58.333998 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-Tenant: tempest-DeleteServersTestJSON-502292925 Jun 22 10:16:58.333998 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-Tenant-Id: d4765b82e21647a9b391a98f446a0e17 Jun 22 10:16:58.333998 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-Tenant-Name: tempest-DeleteServersTestJSON-502292925 Jun 22 10:16:58.333998 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-User: tempest-DeleteServersTestJSON-502292925-project Jun 22 10:16:58.333998 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-User-Domain-Id: default Jun 22 10:16:58.333998 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-User-Domain-Name: Default Jun 22 10:16:58.333998 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-User-Id: 2b3af9bfaaaa4dcca0747f776115c826 Jun 22 10:16:58.333998 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-User-Name: tempest-DeleteServersTestJSON-502292925-project Jun 22 10:16:58.333998 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: method: > Jun 22 10:16:58.333998 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: exception: Instance 8b3f01d1-ac00-4bfb-8ae3-be75720b8ad1 could not be found. Jun 22 10:16:58.333998 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: action_args: {'server_id': '8b3f01d1-ac00-4bfb-8ae3-be75720b8ad1'} Jun 22 10:16:58.334951 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 10:16:58.334951 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:16:58.334951 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 22 10:16:58.334951 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 22 10:16:58.334951 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 22 10:16:58.334951 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 22 10:16:58.334951 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 22 10:16:58.334951 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 22 10:16:58.334951 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 22 10:16:58.334951 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 22 10:16:58.334951 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8b3f01d1-ac00-4bfb-8ae3-be75720b8ad1 could not be found. Jun 22 10:16:58.334951 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi Jun 22 10:16:58.334951 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 10:16:58.334951 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi Jun 22 10:16:58.334951 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:16:58.334951 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 10:16:58.334951 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 10:16:58.334951 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 10:16:58.334951 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 10:16:58.334951 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 10:16:58.336224 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 10:16:58.336224 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jun 22 10:16:58.336224 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 22 10:16:58.336224 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jun 22 10:16:58.336224 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 22 10:16:58.336224 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Jun 22 10:16:58.336224 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Jun 22 10:16:58.336224 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 22 10:16:58.336224 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 22 10:16:58.336224 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8b3f01d1-ac00-4bfb-8ae3-be75720b8ad1 could not be found. Jun 22 10:16:58.336224 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi Jun 22 10:16:58.336224 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 10:16:58.336224 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi Jun 22 10:16:58.336224 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:16:58.336224 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 10:16:58.336224 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 10:16:58.336224 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 10:16:58.336224 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 10:16:58.336224 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8b3f01d1-ac00-4bfb-8ae3-be75720b8ad1 could not be found. Jun 22 10:16:58.336224 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi Jun 22 10:16:58.337593 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-b0670392-792d-4ea6-800d-73b57abce0ad tempest-DeleteServersTestJSON-502292925 tempest-DeleteServersTestJSON-502292925-project] Returning 404 to user: Instance 8b3f01d1-ac00-4bfb-8ae3-be75720b8ad1 could not be found. {{(pid=117874) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 10:16:58.337593 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [None req-b0670392-792d-4ea6-800d-73b57abce0ad tempest-DeleteServersTestJSON-502292925 tempest-DeleteServersTestJSON-502292925-project] 10.222.0.43 "GET /compute/v2.1/servers/8b3f01d1-ac00-4bfb-8ae3-be75720b8ad1/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.035382 Jun 22 10:16:58.337593 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 96/184] 10.222.0.43 () {58 vars in 1301 bytes} [Wed Jun 22 10:16:58 2022] GET /compute/v2.1/servers/8b3f01d1-ac00-4bfb-8ae3-be75720b8ad1/os-volume_attachments => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 22 10:16:58.893142 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-2e4782e0-deee-4e09-9dcf-5672be32ea2d tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Calling method '>' {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:16:58.893806 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.compute.api [None req-2e4782e0-deee-4e09-9dcf-5672be32ea2d tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] [instance: 9f07e4bb-f4e9-428e-8feb-db50b3ff2109] Fetching instance by UUID {{(pid=117873) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:16:58.900540 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-2e4782e0-deee-4e09-9dcf-5672be32ea2d tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:16:58.901013 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-2e4782e0-deee-4e09-9dcf-5672be32ea2d tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:16:58.901858 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-2e4782e0-deee-4e09-9dcf-5672be32ea2d tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:16:58.902295 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-2e4782e0-deee-4e09-9dcf-5672be32ea2d tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:16:59.059032 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.policy [None req-2e4782e0-deee-4e09-9dcf-5672be32ea2d tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d7292401816437fba46d073c4746e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3277b9cbc4b4a8bbacee8440cea1ed2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117873) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:16:59.066878 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [None req-2e4782e0-deee-4e09-9dcf-5672be32ea2d tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] 10.222.0.43 "GET /compute/v2.1/servers/9f07e4bb-f4e9-428e-8feb-db50b3ff2109" status: 200 len: 1521 microversion: 2.1 time: 0.178099 Jun 22 10:16:59.067530 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 89/185] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:16:58 2022] GET /compute/v2.1/servers/9f07e4bb-f4e9-428e-8feb-db50b3ff2109 => generated 1521 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:16:59.540928 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-9349963d-ba74-41be-b30e-3c61a45d0fb5 tempest-DeleteServersTestJSON-502292925 tempest-DeleteServersTestJSON-502292925-project] Calling method '>' {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:16:59.541411 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.compute.api [None req-9349963d-ba74-41be-b30e-3c61a45d0fb5 tempest-DeleteServersTestJSON-502292925 tempest-DeleteServersTestJSON-502292925-project] [instance: 8b3f01d1-ac00-4bfb-8ae3-be75720b8ad1] Fetching instance by UUID {{(pid=117874) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:16:59.548009 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-9349963d-ba74-41be-b30e-3c61a45d0fb5 tempest-DeleteServersTestJSON-502292925 tempest-DeleteServersTestJSON-502292925-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:16:59.548467 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-9349963d-ba74-41be-b30e-3c61a45d0fb5 tempest-DeleteServersTestJSON-502292925 tempest-DeleteServersTestJSON-502292925-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:16:59.549224 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-9349963d-ba74-41be-b30e-3c61a45d0fb5 tempest-DeleteServersTestJSON-502292925 tempest-DeleteServersTestJSON-502292925-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:16:59.549660 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-9349963d-ba74-41be-b30e-3c61a45d0fb5 tempest-DeleteServersTestJSON-502292925 tempest-DeleteServersTestJSON-502292925-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:16:59.564016 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.wsgi [None req-9349963d-ba74-41be-b30e-3c61a45d0fb5 tempest-DeleteServersTestJSON-502292925 tempest-DeleteServersTestJSON-502292925-project] HTTP exception thrown: Instance 8b3f01d1-ac00-4bfb-8ae3-be75720b8ad1 could not be found. Jun 22 10:16:59.567554 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-9349963d-ba74-41be-b30e-3c61a45d0fb5 tempest-DeleteServersTestJSON-502292925 tempest-DeleteServersTestJSON-502292925-project] Request method failure captured: Jun 22 10:16:59.567554 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: request: DELETE /compute/v2.1/servers/8b3f01d1-ac00-4bfb-8ae3-be75720b8ad1 HTTP/1.1 Jun 22 10:16:59.567554 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: Accept: application/json Jun 22 10:16:59.567554 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: Accept-Encoding: identity Jun 22 10:16:59.567554 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: Connection: close Jun 22 10:16:59.567554 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: Content-Length: 0 Jun 22 10:16:59.567554 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: Content-Type: application/json Jun 22 10:16:59.567554 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: Host: 10.222.0.43 Jun 22 10:16:59.567554 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: Openstack-System-Scope: None Jun 22 10:16:59.567554 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: User-Agent: python-urllib3/1.26.9 Jun 22 10:16:59.567554 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-Auth-Token: gAAAAABisuvZxUmWWDyV4xe8MS3_EEJcm4nDjqQZWZvTR547LPTjqoA6kuny8tdTqaBh0slR3C1AaP22JxJJMYd2ff06wJkWycxmXKuSmg8zJInkyFZ4vnmEO-trEpbVFoyqajniyNE0YaOebUeg8loF-fG9f-sYWCV5rQXUcvYRR8gKNhEoJWk Jun 22 10:16:59.567554 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-Domain-Id: None Jun 22 10:16:59.567554 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-Domain-Name: None Jun 22 10:16:59.567554 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-Identity-Status: Confirmed Jun 22 10:16:59.567554 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-Is-Admin-Project: True Jun 22 10:16:59.567554 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-Project-Domain-Id: default Jun 22 10:16:59.567554 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-Project-Domain-Name: Default Jun 22 10:16:59.567554 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-Project-Id: d4765b82e21647a9b391a98f446a0e17 Jun 22 10:16:59.567554 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-Project-Name: tempest-DeleteServersTestJSON-502292925 Jun 22 10:16:59.567554 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-Role: reader,member Jun 22 10:16:59.567554 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-Roles: reader,member Jun 22 10:16:59.569034 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/d4765b82e21647a9b391a98f446a0e17"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/d4765b82e21647a9b391a98f446a0e17"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_d4765b82e21647a9b391a98f446a0e17", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/d4765b82e21647a9b391a98f446a0e17"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}] Jun 22 10:16:59.569034 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-Tenant: tempest-DeleteServersTestJSON-502292925 Jun 22 10:16:59.569034 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-Tenant-Id: d4765b82e21647a9b391a98f446a0e17 Jun 22 10:16:59.569034 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-Tenant-Name: tempest-DeleteServersTestJSON-502292925 Jun 22 10:16:59.569034 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-User: tempest-DeleteServersTestJSON-502292925-project Jun 22 10:16:59.569034 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-User-Domain-Id: default Jun 22 10:16:59.569034 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-User-Domain-Name: Default Jun 22 10:16:59.569034 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-User-Id: 2b3af9bfaaaa4dcca0747f776115c826 Jun 22 10:16:59.569034 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-User-Name: tempest-DeleteServersTestJSON-502292925-project Jun 22 10:16:59.569034 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: method: > Jun 22 10:16:59.569034 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: exception: Instance 8b3f01d1-ac00-4bfb-8ae3-be75720b8ad1 could not be found. Jun 22 10:16:59.569034 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: action_args: {'id': '8b3f01d1-ac00-4bfb-8ae3-be75720b8ad1'} Jun 22 10:16:59.570203 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 10:16:59.570203 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:16:59.570203 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 22 10:16:59.570203 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 22 10:16:59.570203 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 22 10:16:59.570203 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 22 10:16:59.570203 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 22 10:16:59.570203 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 22 10:16:59.570203 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 22 10:16:59.570203 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 22 10:16:59.570203 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8b3f01d1-ac00-4bfb-8ae3-be75720b8ad1 could not be found. Jun 22 10:16:59.570203 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi Jun 22 10:16:59.570203 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 10:16:59.570203 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi Jun 22 10:16:59.570203 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:16:59.570203 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 10:16:59.570203 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 10:16:59.570203 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 10:16:59.570203 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 10:16:59.570203 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 10:16:59.571589 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 10:16:59.571589 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 22 10:16:59.571589 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 22 10:16:59.571589 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 22 10:16:59.571589 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 22 10:16:59.571589 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 22 10:16:59.571589 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 22 10:16:59.571589 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 22 10:16:59.571589 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 22 10:16:59.571589 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8b3f01d1-ac00-4bfb-8ae3-be75720b8ad1 could not be found. Jun 22 10:16:59.571589 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi Jun 22 10:16:59.571589 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 10:16:59.571589 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi Jun 22 10:16:59.571589 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:16:59.571589 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 10:16:59.571589 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 10:16:59.571589 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 10:16:59.571589 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 10:16:59.571589 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8b3f01d1-ac00-4bfb-8ae3-be75720b8ad1 could not be found. Jun 22 10:16:59.571589 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi Jun 22 10:16:59.573820 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-9349963d-ba74-41be-b30e-3c61a45d0fb5 tempest-DeleteServersTestJSON-502292925 tempest-DeleteServersTestJSON-502292925-project] Returning 404 to user: Instance 8b3f01d1-ac00-4bfb-8ae3-be75720b8ad1 could not be found. {{(pid=117874) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 10:16:59.573820 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [None req-9349963d-ba74-41be-b30e-3c61a45d0fb5 tempest-DeleteServersTestJSON-502292925 tempest-DeleteServersTestJSON-502292925-project] 10.222.0.43 "DELETE /compute/v2.1/servers/8b3f01d1-ac00-4bfb-8ae3-be75720b8ad1" status: 404 len: 111 microversion: 2.1 time: 0.031433 Jun 22 10:16:59.573820 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 97/186] 10.222.0.43 () {58 vars in 1238 bytes} [Wed Jun 22 10:16:59 2022] DELETE /compute/v2.1/servers/8b3f01d1-ac00-4bfb-8ae3-be75720b8ad1 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 22 10:16:59.579255 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-1d2c2650-9a98-4ee6-a83d-47cbd80de517 tempest-DeleteServersTestJSON-502292925 tempest-DeleteServersTestJSON-502292925-project] Calling method '>' {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:16:59.579865 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.compute.api [None req-1d2c2650-9a98-4ee6-a83d-47cbd80de517 tempest-DeleteServersTestJSON-502292925 tempest-DeleteServersTestJSON-502292925-project] [instance: 8b3f01d1-ac00-4bfb-8ae3-be75720b8ad1] Fetching instance by UUID {{(pid=117873) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:16:59.586004 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-1d2c2650-9a98-4ee6-a83d-47cbd80de517 tempest-DeleteServersTestJSON-502292925 tempest-DeleteServersTestJSON-502292925-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:16:59.586450 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-1d2c2650-9a98-4ee6-a83d-47cbd80de517 tempest-DeleteServersTestJSON-502292925 tempest-DeleteServersTestJSON-502292925-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:16:59.587203 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-1d2c2650-9a98-4ee6-a83d-47cbd80de517 tempest-DeleteServersTestJSON-502292925 tempest-DeleteServersTestJSON-502292925-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:16:59.587635 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-1d2c2650-9a98-4ee6-a83d-47cbd80de517 tempest-DeleteServersTestJSON-502292925 tempest-DeleteServersTestJSON-502292925-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:16:59.600932 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.wsgi [None req-1d2c2650-9a98-4ee6-a83d-47cbd80de517 tempest-DeleteServersTestJSON-502292925 tempest-DeleteServersTestJSON-502292925-project] HTTP exception thrown: Instance 8b3f01d1-ac00-4bfb-8ae3-be75720b8ad1 could not be found. Jun 22 10:16:59.602461 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-1d2c2650-9a98-4ee6-a83d-47cbd80de517 tempest-DeleteServersTestJSON-502292925 tempest-DeleteServersTestJSON-502292925-project] Request method failure captured: Jun 22 10:16:59.602461 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: request: GET /compute/v2.1/servers/8b3f01d1-ac00-4bfb-8ae3-be75720b8ad1 HTTP/1.1 Jun 22 10:16:59.602461 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: Accept: application/json Jun 22 10:16:59.602461 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: Accept-Encoding: identity Jun 22 10:16:59.602461 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: Connection: close Jun 22 10:16:59.602461 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: Content-Length: 0 Jun 22 10:16:59.602461 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: Content-Type: application/json Jun 22 10:16:59.602461 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: Host: 10.222.0.43 Jun 22 10:16:59.602461 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: Openstack-System-Scope: None Jun 22 10:16:59.602461 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: User-Agent: python-urllib3/1.26.9 Jun 22 10:16:59.602461 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-Auth-Token: gAAAAABisuvZxUmWWDyV4xe8MS3_EEJcm4nDjqQZWZvTR547LPTjqoA6kuny8tdTqaBh0slR3C1AaP22JxJJMYd2ff06wJkWycxmXKuSmg8zJInkyFZ4vnmEO-trEpbVFoyqajniyNE0YaOebUeg8loF-fG9f-sYWCV5rQXUcvYRR8gKNhEoJWk Jun 22 10:16:59.602461 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-Domain-Id: None Jun 22 10:16:59.602461 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-Domain-Name: None Jun 22 10:16:59.602461 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-Identity-Status: Confirmed Jun 22 10:16:59.602461 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-Is-Admin-Project: True Jun 22 10:16:59.602461 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-Project-Domain-Id: default Jun 22 10:16:59.602461 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-Project-Domain-Name: Default Jun 22 10:16:59.602461 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-Project-Id: d4765b82e21647a9b391a98f446a0e17 Jun 22 10:16:59.602461 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-Project-Name: tempest-DeleteServersTestJSON-502292925 Jun 22 10:16:59.602461 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-Role: reader,member Jun 22 10:16:59.602461 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-Roles: reader,member Jun 22 10:16:59.603870 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/d4765b82e21647a9b391a98f446a0e17"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/d4765b82e21647a9b391a98f446a0e17"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_d4765b82e21647a9b391a98f446a0e17", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/d4765b82e21647a9b391a98f446a0e17"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}] Jun 22 10:16:59.603870 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-Tenant: tempest-DeleteServersTestJSON-502292925 Jun 22 10:16:59.603870 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-Tenant-Id: d4765b82e21647a9b391a98f446a0e17 Jun 22 10:16:59.603870 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-Tenant-Name: tempest-DeleteServersTestJSON-502292925 Jun 22 10:16:59.603870 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-User: tempest-DeleteServersTestJSON-502292925-project Jun 22 10:16:59.603870 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-User-Domain-Id: default Jun 22 10:16:59.603870 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-User-Domain-Name: Default Jun 22 10:16:59.603870 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-User-Id: 2b3af9bfaaaa4dcca0747f776115c826 Jun 22 10:16:59.603870 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-User-Name: tempest-DeleteServersTestJSON-502292925-project Jun 22 10:16:59.603870 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: method: > Jun 22 10:16:59.603870 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: exception: Instance 8b3f01d1-ac00-4bfb-8ae3-be75720b8ad1 could not be found. Jun 22 10:16:59.603870 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: action_args: {'id': '8b3f01d1-ac00-4bfb-8ae3-be75720b8ad1'} Jun 22 10:16:59.604827 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 10:16:59.604827 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:16:59.604827 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 22 10:16:59.604827 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 22 10:16:59.604827 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 22 10:16:59.604827 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 22 10:16:59.604827 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 22 10:16:59.604827 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 22 10:16:59.604827 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 22 10:16:59.604827 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 22 10:16:59.604827 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8b3f01d1-ac00-4bfb-8ae3-be75720b8ad1 could not be found. Jun 22 10:16:59.604827 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi Jun 22 10:16:59.604827 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 10:16:59.604827 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi Jun 22 10:16:59.604827 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:16:59.604827 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 10:16:59.604827 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 10:16:59.604827 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 10:16:59.604827 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 10:16:59.604827 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 10:16:59.606943 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 10:16:59.606943 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 22 10:16:59.606943 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 22 10:16:59.606943 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 22 10:16:59.606943 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 22 10:16:59.606943 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 22 10:16:59.606943 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 22 10:16:59.606943 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8b3f01d1-ac00-4bfb-8ae3-be75720b8ad1 could not be found. Jun 22 10:16:59.606943 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi Jun 22 10:16:59.606943 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 10:16:59.606943 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi Jun 22 10:16:59.606943 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:16:59.606943 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 10:16:59.606943 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 10:16:59.606943 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 10:16:59.606943 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 10:16:59.606943 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8b3f01d1-ac00-4bfb-8ae3-be75720b8ad1 could not be found. Jun 22 10:16:59.606943 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi Jun 22 10:16:59.608866 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-1d2c2650-9a98-4ee6-a83d-47cbd80de517 tempest-DeleteServersTestJSON-502292925 tempest-DeleteServersTestJSON-502292925-project] Returning 404 to user: Instance 8b3f01d1-ac00-4bfb-8ae3-be75720b8ad1 could not be found. {{(pid=117873) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 10:16:59.608866 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [None req-1d2c2650-9a98-4ee6-a83d-47cbd80de517 tempest-DeleteServersTestJSON-502292925 tempest-DeleteServersTestJSON-502292925-project] 10.222.0.43 "GET /compute/v2.1/servers/8b3f01d1-ac00-4bfb-8ae3-be75720b8ad1" status: 404 len: 111 microversion: 2.1 time: 0.028660 Jun 22 10:16:59.608866 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 90/187] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:16:59 2022] GET /compute/v2.1/servers/8b3f01d1-ac00-4bfb-8ae3-be75720b8ad1 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 22 10:17:00.084938 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-8ab4c4b1-db89-4566-a8a0-9b58e82354f5 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Calling method '>' {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:17:00.085671 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.compute.api [None req-8ab4c4b1-db89-4566-a8a0-9b58e82354f5 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] [instance: 9f07e4bb-f4e9-428e-8feb-db50b3ff2109] Fetching instance by UUID {{(pid=117874) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:17:00.093755 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-8ab4c4b1-db89-4566-a8a0-9b58e82354f5 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:17:00.094203 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-8ab4c4b1-db89-4566-a8a0-9b58e82354f5 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:17:00.094974 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-8ab4c4b1-db89-4566-a8a0-9b58e82354f5 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:17:00.095478 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-8ab4c4b1-db89-4566-a8a0-9b58e82354f5 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:17:00.354736 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.policy [None req-8ab4c4b1-db89-4566-a8a0-9b58e82354f5 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d7292401816437fba46d073c4746e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3277b9cbc4b4a8bbacee8440cea1ed2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117874) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:17:00.362213 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [None req-8ab4c4b1-db89-4566-a8a0-9b58e82354f5 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] 10.222.0.43 "GET /compute/v2.1/servers/9f07e4bb-f4e9-428e-8feb-db50b3ff2109" status: 200 len: 1521 microversion: 2.1 time: 0.282094 Jun 22 10:17:00.363533 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 98/188] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:17:00 2022] GET /compute/v2.1/servers/9f07e4bb-f4e9-428e-8feb-db50b3ff2109 => generated 1521 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:17:01.136080 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-05841d55-062f-4ea7-89c7-f023b742a80c tempest-VolumesNegativeTest-2052720250 tempest-VolumesNegativeTest-2052720250-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-624799674", "imageRef": "22d2c064-5bf7-438e-bbb7-47259e4bdab5", "flavorRef": "452"}} {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:17:01.185339 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.network.neutron [None req-05841d55-062f-4ea7-89c7-f023b742a80c tempest-VolumesNegativeTest-2052720250 tempest-VolumesNegativeTest-2052720250-project] validate_networks() for None {{(pid=117873) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 22 10:17:01.380310 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-cec1ebf6-d35d-43a4-a465-7af9c9e46104 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Calling method '>' {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:17:01.380846 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.compute.api [None req-cec1ebf6-d35d-43a4-a465-7af9c9e46104 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] [instance: 9f07e4bb-f4e9-428e-8feb-db50b3ff2109] Fetching instance by UUID {{(pid=117874) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:17:01.387435 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-cec1ebf6-d35d-43a4-a465-7af9c9e46104 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:17:01.387885 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-cec1ebf6-d35d-43a4-a465-7af9c9e46104 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:17:01.388628 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-cec1ebf6-d35d-43a4-a465-7af9c9e46104 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:17:01.389055 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-cec1ebf6-d35d-43a4-a465-7af9c9e46104 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:17:01.658447 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.virt.hardware [None req-05841d55-062f-4ea7-89c7-f023b742a80c tempest-VolumesNegativeTest-2052720250 tempest-VolumesNegativeTest-2052720250-project] Flavor limits 0:0:0 {{(pid=117873) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 22 10:17:01.659261 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.virt.hardware [None req-05841d55-062f-4ea7-89c7-f023b742a80c tempest-VolumesNegativeTest-2052720250 tempest-VolumesNegativeTest-2052720250-project] Image limits 0:0:0 {{(pid=117873) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 22 10:17:01.661180 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.virt.hardware [None req-05841d55-062f-4ea7-89c7-f023b742a80c tempest-VolumesNegativeTest-2052720250 tempest-VolumesNegativeTest-2052720250-project] Flavor pref 0:0:0 {{(pid=117873) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 22 10:17:01.661629 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.virt.hardware [None req-05841d55-062f-4ea7-89c7-f023b742a80c tempest-VolumesNegativeTest-2052720250 tempest-VolumesNegativeTest-2052720250-project] Image pref 0:0:0 {{(pid=117873) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 22 10:17:01.662501 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.virt.hardware [None req-05841d55-062f-4ea7-89c7-f023b742a80c tempest-VolumesNegativeTest-2052720250 tempest-VolumesNegativeTest-2052720250-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117873) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 22 10:17:01.674824 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.policy [None req-cec1ebf6-d35d-43a4-a465-7af9c9e46104 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d7292401816437fba46d073c4746e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3277b9cbc4b4a8bbacee8440cea1ed2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117874) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:17:01.680252 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-05841d55-062f-4ea7-89c7-f023b742a80c tempest-VolumesNegativeTest-2052720250 tempest-VolumesNegativeTest-2052720250-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:17:01.680693 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-05841d55-062f-4ea7-89c7-f023b742a80c tempest-VolumesNegativeTest-2052720250 tempest-VolumesNegativeTest-2052720250-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:17:01.683756 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-05841d55-062f-4ea7-89c7-f023b742a80c tempest-VolumesNegativeTest-2052720250 tempest-VolumesNegativeTest-2052720250-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:17:01.685063 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-05841d55-062f-4ea7-89c7-f023b742a80c tempest-VolumesNegativeTest-2052720250 tempest-VolumesNegativeTest-2052720250-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:17:01.689649 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [None req-cec1ebf6-d35d-43a4-a465-7af9c9e46104 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] 10.222.0.43 "GET /compute/v2.1/servers/9f07e4bb-f4e9-428e-8feb-db50b3ff2109" status: 200 len: 1521 microversion: 2.1 time: 0.313765 Jun 22 10:17:01.699411 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 99/189] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:17:01 2022] GET /compute/v2.1/servers/9f07e4bb-f4e9-428e-8feb-db50b3ff2109 => generated 1521 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:17:01.713334 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.quota [None req-05841d55-062f-4ea7-89c7-f023b742a80c tempest-VolumesNegativeTest-2052720250 tempest-VolumesNegativeTest-2052720250-project] Getting quotas for project b97e48bc75b74b49aec21b8a8b2810d5. Resources: {'instances', 'cores', 'ram'} {{(pid=117873) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 22 10:17:01.717570 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.quota [None req-05841d55-062f-4ea7-89c7-f023b742a80c tempest-VolumesNegativeTest-2052720250 tempest-VolumesNegativeTest-2052720250-project] Getting quotas for user 7b4ef2f1a6dd45ccaea982213e051ee8 and project b97e48bc75b74b49aec21b8a8b2810d5. Resources: {'instances', 'cores', 'ram'} {{(pid=117873) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 22 10:17:01.731049 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.compute.api [None req-05841d55-062f-4ea7-89c7-f023b742a80c tempest-VolumesNegativeTest-2052720250 tempest-VolumesNegativeTest-2052720250-project] Going to run 1 instances... {{(pid=117873) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 22 10:17:01.733306 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.compute.api [None req-05841d55-062f-4ea7-89c7-f023b742a80c tempest-VolumesNegativeTest-2052720250 tempest-VolumesNegativeTest-2052720250-project] [instance: 06859498-5e65-4775-99f7-828d79365634] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='22d2c064-5bf7-438e-bbb7-47259e4bdab5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117873) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 22 10:17:01.787021 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [None req-05841d55-062f-4ea7-89c7-f023b742a80c tempest-VolumesNegativeTest-2052720250 tempest-VolumesNegativeTest-2052720250-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.654622 Jun 22 10:17:01.788098 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 91/190] 10.222.0.43 () {60 vars in 1146 bytes} [Wed Jun 22 10:17:01 2022] POST /compute/v2.1/servers => generated 380 bytes in 656 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 22 10:17:01.799347 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-79821156-b89a-46e0-a066-50613c952200 tempest-VolumesNegativeTest-2052720250 tempest-VolumesNegativeTest-2052720250-project] Calling method '>' {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:17:01.800090 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.compute.api [None req-79821156-b89a-46e0-a066-50613c952200 tempest-VolumesNegativeTest-2052720250 tempest-VolumesNegativeTest-2052720250-project] [instance: 06859498-5e65-4775-99f7-828d79365634] Fetching instance by UUID {{(pid=117874) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:17:01.898952 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.policy [None req-79821156-b89a-46e0-a066-50613c952200 tempest-VolumesNegativeTest-2052720250 tempest-VolumesNegativeTest-2052720250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b4ef2f1a6dd45ccaea982213e051ee8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b97e48bc75b74b49aec21b8a8b2810d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117874) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:17:01.915440 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [None req-79821156-b89a-46e0-a066-50613c952200 tempest-VolumesNegativeTest-2052720250 tempest-VolumesNegativeTest-2052720250-project] 10.222.0.43 "GET /compute/v2.1/servers/06859498-5e65-4775-99f7-828d79365634" status: 200 len: 1214 microversion: 2.1 time: 0.119881 Jun 22 10:17:01.917810 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 100/191] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:17:01 2022] GET /compute/v2.1/servers/06859498-5e65-4775-99f7-828d79365634 => generated 1214 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 10:17:02.708015 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-6ca02762-9d0d-4c93-b8df-ed492062cc29 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Calling method '>' {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:17:02.708624 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.compute.api [None req-6ca02762-9d0d-4c93-b8df-ed492062cc29 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] [instance: 9f07e4bb-f4e9-428e-8feb-db50b3ff2109] Fetching instance by UUID {{(pid=117873) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:17:02.715768 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-6ca02762-9d0d-4c93-b8df-ed492062cc29 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:17:02.716221 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-6ca02762-9d0d-4c93-b8df-ed492062cc29 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:17:02.716999 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-6ca02762-9d0d-4c93-b8df-ed492062cc29 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:17:02.717893 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-6ca02762-9d0d-4c93-b8df-ed492062cc29 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:17:02.933876 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-7b677183-39bd-4114-8dd4-fd35083d35bd tempest-VolumesNegativeTest-2052720250 tempest-VolumesNegativeTest-2052720250-project] Calling method '>' {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:17:02.934502 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.compute.api [None req-7b677183-39bd-4114-8dd4-fd35083d35bd tempest-VolumesNegativeTest-2052720250 tempest-VolumesNegativeTest-2052720250-project] [instance: 06859498-5e65-4775-99f7-828d79365634] Fetching instance by UUID {{(pid=117874) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:17:02.941444 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-7b677183-39bd-4114-8dd4-fd35083d35bd tempest-VolumesNegativeTest-2052720250 tempest-VolumesNegativeTest-2052720250-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:17:02.942196 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-7b677183-39bd-4114-8dd4-fd35083d35bd tempest-VolumesNegativeTest-2052720250 tempest-VolumesNegativeTest-2052720250-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:17:02.943033 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-7b677183-39bd-4114-8dd4-fd35083d35bd tempest-VolumesNegativeTest-2052720250 tempest-VolumesNegativeTest-2052720250-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:17:02.943597 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-7b677183-39bd-4114-8dd4-fd35083d35bd tempest-VolumesNegativeTest-2052720250 tempest-VolumesNegativeTest-2052720250-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:17:02.949512 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG dbcounter [-] [117874] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:17:02.973261 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.policy [None req-6ca02762-9d0d-4c93-b8df-ed492062cc29 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d7292401816437fba46d073c4746e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3277b9cbc4b4a8bbacee8440cea1ed2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117873) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:17:02.983431 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [None req-6ca02762-9d0d-4c93-b8df-ed492062cc29 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] 10.222.0.43 "GET /compute/v2.1/servers/9f07e4bb-f4e9-428e-8feb-db50b3ff2109" status: 200 len: 1521 microversion: 2.1 time: 0.279962 Jun 22 10:17:02.985382 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 92/192] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:17:02 2022] GET /compute/v2.1/servers/9f07e4bb-f4e9-428e-8feb-db50b3ff2109 => generated 1521 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:17:03.022906 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.policy [None req-7b677183-39bd-4114-8dd4-fd35083d35bd tempest-VolumesNegativeTest-2052720250 tempest-VolumesNegativeTest-2052720250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b4ef2f1a6dd45ccaea982213e051ee8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b97e48bc75b74b49aec21b8a8b2810d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117874) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:17:03.033050 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [None req-7b677183-39bd-4114-8dd4-fd35083d35bd tempest-VolumesNegativeTest-2052720250 tempest-VolumesNegativeTest-2052720250-project] 10.222.0.43 "GET /compute/v2.1/servers/06859498-5e65-4775-99f7-828d79365634" status: 200 len: 1274 microversion: 2.1 time: 0.103685 Jun 22 10:17:03.035473 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 101/193] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:17:02 2022] GET /compute/v2.1/servers/06859498-5e65-4775-99f7-828d79365634 => generated 1274 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 10:17:04.000401 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-4cffcaa9-5135-47e8-852f-c3891f4965b5 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Calling method '>' {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:17:04.001121 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.compute.api [None req-4cffcaa9-5135-47e8-852f-c3891f4965b5 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] [instance: 9f07e4bb-f4e9-428e-8feb-db50b3ff2109] Fetching instance by UUID {{(pid=117873) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:17:04.008140 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-4cffcaa9-5135-47e8-852f-c3891f4965b5 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:17:04.008895 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-4cffcaa9-5135-47e8-852f-c3891f4965b5 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:17:04.009915 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-4cffcaa9-5135-47e8-852f-c3891f4965b5 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:17:04.010581 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-4cffcaa9-5135-47e8-852f-c3891f4965b5 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:17:04.052837 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-4ee98c10-7a72-4e85-93dd-97588efabb30 tempest-VolumesNegativeTest-2052720250 tempest-VolumesNegativeTest-2052720250-project] Calling method '>' {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:17:04.053742 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.compute.api [None req-4ee98c10-7a72-4e85-93dd-97588efabb30 tempest-VolumesNegativeTest-2052720250 tempest-VolumesNegativeTest-2052720250-project] [instance: 06859498-5e65-4775-99f7-828d79365634] Fetching instance by UUID {{(pid=117874) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:17:04.061886 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-4ee98c10-7a72-4e85-93dd-97588efabb30 tempest-VolumesNegativeTest-2052720250 tempest-VolumesNegativeTest-2052720250-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:17:04.062363 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-4ee98c10-7a72-4e85-93dd-97588efabb30 tempest-VolumesNegativeTest-2052720250 tempest-VolumesNegativeTest-2052720250-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:17:04.063238 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-4ee98c10-7a72-4e85-93dd-97588efabb30 tempest-VolumesNegativeTest-2052720250 tempest-VolumesNegativeTest-2052720250-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:17:04.063895 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-4ee98c10-7a72-4e85-93dd-97588efabb30 tempest-VolumesNegativeTest-2052720250 tempest-VolumesNegativeTest-2052720250-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:17:04.176886 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.policy [None req-4ee98c10-7a72-4e85-93dd-97588efabb30 tempest-VolumesNegativeTest-2052720250 tempest-VolumesNegativeTest-2052720250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b4ef2f1a6dd45ccaea982213e051ee8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b97e48bc75b74b49aec21b8a8b2810d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117874) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:17:04.186895 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [None req-4ee98c10-7a72-4e85-93dd-97588efabb30 tempest-VolumesNegativeTest-2052720250 tempest-VolumesNegativeTest-2052720250-project] 10.222.0.43 "GET /compute/v2.1/servers/06859498-5e65-4775-99f7-828d79365634" status: 200 len: 1272 microversion: 2.1 time: 0.138831 Jun 22 10:17:04.188261 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 102/194] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:17:04 2022] GET /compute/v2.1/servers/06859498-5e65-4775-99f7-828d79365634 => generated 1272 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:17:04.263012 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.policy [None req-4cffcaa9-5135-47e8-852f-c3891f4965b5 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d7292401816437fba46d073c4746e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3277b9cbc4b4a8bbacee8440cea1ed2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117873) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:17:04.273592 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [None req-4cffcaa9-5135-47e8-852f-c3891f4965b5 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] 10.222.0.43 "GET /compute/v2.1/servers/9f07e4bb-f4e9-428e-8feb-db50b3ff2109" status: 200 len: 1521 microversion: 2.1 time: 0.277048 Jun 22 10:17:04.306663 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 93/195] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:17:03 2022] GET /compute/v2.1/servers/9f07e4bb-f4e9-428e-8feb-db50b3ff2109 => generated 1521 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:17:05.073650 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [req-f33de9d4-b191-4a65-b0b3-06af4298d088 req-e94fae17-6ee6-448b-9b13-9774c6335496 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "06859498-5e65-4775-99f7-828d79365634", "tag": "528fafa3-02ad-4846-bebb-f55c3ad3c12f"}]} {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:17:05.103653 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [req-f33de9d4-b191-4a65-b0b3-06af4298d088 req-e94fae17-6ee6-448b-9b13-9774c6335496 service nova] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:17:05.104880 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [req-f33de9d4-b191-4a65-b0b3-06af4298d088 req-e94fae17-6ee6-448b-9b13-9774c6335496 service nova] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:17:05.134322 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.compute.server_external_events [req-f33de9d4-b191-4a65-b0b3-06af4298d088 req-e94fae17-6ee6-448b-9b13-9774c6335496 service nova] Creating event network-changed:528fafa3-02ad-4846-bebb-f55c3ad3c12f for instance 06859498-5e65-4775-99f7-828d79365634 on hv-cinder-84713 Jun 22 10:17:05.147564 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [req-f33de9d4-b191-4a65-b0b3-06af4298d088 req-e94fae17-6ee6-448b-9b13-9774c6335496 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081596 Jun 22 10:17:05.149062 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 103/196] 10.222.0.43 () {64 vars in 1317 bytes} [Wed Jun 22 10:17:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 22 10:17:05.211658 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-ca0210ec-7c80-4ab5-bafd-77b4355d7aa8 tempest-VolumesNegativeTest-2052720250 tempest-VolumesNegativeTest-2052720250-project] Calling method '>' {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:17:05.213317 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.compute.api [None req-ca0210ec-7c80-4ab5-bafd-77b4355d7aa8 tempest-VolumesNegativeTest-2052720250 tempest-VolumesNegativeTest-2052720250-project] [instance: 06859498-5e65-4775-99f7-828d79365634] Fetching instance by UUID {{(pid=117874) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:17:05.224784 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-ca0210ec-7c80-4ab5-bafd-77b4355d7aa8 tempest-VolumesNegativeTest-2052720250 tempest-VolumesNegativeTest-2052720250-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:17:05.225377 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-ca0210ec-7c80-4ab5-bafd-77b4355d7aa8 tempest-VolumesNegativeTest-2052720250 tempest-VolumesNegativeTest-2052720250-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:17:05.226826 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-ca0210ec-7c80-4ab5-bafd-77b4355d7aa8 tempest-VolumesNegativeTest-2052720250 tempest-VolumesNegativeTest-2052720250-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:17:05.227707 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-ca0210ec-7c80-4ab5-bafd-77b4355d7aa8 tempest-VolumesNegativeTest-2052720250 tempest-VolumesNegativeTest-2052720250-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:17:05.257208 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-193a5c3d-1013-467c-9475-3b133facf1d8 tempest-VolumesGetTestJSON-1136549117 tempest-VolumesGetTestJSON-1136549117-project] Action: 'create', calling method: .version_select at 0x7f36bef1e1f0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-663197234", "metadata": {"Type": "work"}}} {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:17:05.665607 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.policy [None req-ca0210ec-7c80-4ab5-bafd-77b4355d7aa8 tempest-VolumesNegativeTest-2052720250 tempest-VolumesNegativeTest-2052720250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b4ef2f1a6dd45ccaea982213e051ee8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b97e48bc75b74b49aec21b8a8b2810d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117874) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:17:05.673342 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [None req-ca0210ec-7c80-4ab5-bafd-77b4355d7aa8 tempest-VolumesNegativeTest-2052720250 tempest-VolumesNegativeTest-2052720250-project] 10.222.0.43 "GET /compute/v2.1/servers/06859498-5e65-4775-99f7-828d79365634" status: 200 len: 1314 microversion: 2.1 time: 0.467217 Jun 22 10:17:05.683702 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 104/197] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:17:05 2022] GET /compute/v2.1/servers/06859498-5e65-4775-99f7-828d79365634 => generated 1314 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 10:17:05.688000 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [None req-193a5c3d-1013-467c-9475-3b133facf1d8 tempest-VolumesGetTestJSON-1136549117 tempest-VolumesGetTestJSON-1136549117-project] 10.222.0.43 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 0.611999 Jun 22 10:17:05.688629 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 94/198] 10.222.0.43 () {60 vars in 1155 bytes} [Wed Jun 22 10:17:05 2022] POST /compute/v2.1/os-volumes => generated 352 bytes in 614 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jun 22 10:17:05.689185 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-eb039804-5225-4bb8-9bed-de4a0573beb7 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Calling method '>' {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:17:05.689829 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.compute.api [None req-eb039804-5225-4bb8-9bed-de4a0573beb7 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] [instance: 9f07e4bb-f4e9-428e-8feb-db50b3ff2109] Fetching instance by UUID {{(pid=117874) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:17:05.696727 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-eb039804-5225-4bb8-9bed-de4a0573beb7 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:17:05.697182 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-eb039804-5225-4bb8-9bed-de4a0573beb7 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:17:05.697985 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-eb039804-5225-4bb8-9bed-de4a0573beb7 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:17:05.698425 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-eb039804-5225-4bb8-9bed-de4a0573beb7 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:17:05.700252 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-8e5f1e03-cb3b-4229-bf40-b821b4cee1c2 tempest-VolumesGetTestJSON-1136549117 tempest-VolumesGetTestJSON-1136549117-project] Calling method '.version_select at 0x7f36bf018160>' {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:17:05.751749 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [None req-8e5f1e03-cb3b-4229-bf40-b821b4cee1c2 tempest-VolumesGetTestJSON-1136549117 tempest-VolumesGetTestJSON-1136549117-project] 10.222.0.43 "GET /compute/v2.1/os-volumes/cf47cdcb-6776-47f0-a08e-312d6ec054e6" status: 200 len: 352 microversion: 2.1 time: 0.055213 Jun 22 10:17:05.752331 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 95/199] 10.222.0.43 () {58 vars in 1244 bytes} [Wed Jun 22 10:17:05 2022] GET /compute/v2.1/os-volumes/cf47cdcb-6776-47f0-a08e-312d6ec054e6 => generated 352 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 22 10:17:05.835668 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.policy [None req-eb039804-5225-4bb8-9bed-de4a0573beb7 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d7292401816437fba46d073c4746e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3277b9cbc4b4a8bbacee8440cea1ed2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117874) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:17:05.843324 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [None req-eb039804-5225-4bb8-9bed-de4a0573beb7 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] 10.222.0.43 "GET /compute/v2.1/servers/9f07e4bb-f4e9-428e-8feb-db50b3ff2109" status: 200 len: 1521 microversion: 2.1 time: 0.158005 Jun 22 10:17:05.843898 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 105/200] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:17:05 2022] GET /compute/v2.1/servers/9f07e4bb-f4e9-428e-8feb-db50b3ff2109 => generated 1521 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:17:06.691659 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-9a3b9297-0b2b-49d0-8d33-cdc15843f566 tempest-VolumesNegativeTest-2052720250 tempest-VolumesNegativeTest-2052720250-project] Calling method '>' {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:17:06.692357 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.compute.api [None req-9a3b9297-0b2b-49d0-8d33-cdc15843f566 tempest-VolumesNegativeTest-2052720250 tempest-VolumesNegativeTest-2052720250-project] [instance: 06859498-5e65-4775-99f7-828d79365634] Fetching instance by UUID {{(pid=117873) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:17:06.699028 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-9a3b9297-0b2b-49d0-8d33-cdc15843f566 tempest-VolumesNegativeTest-2052720250 tempest-VolumesNegativeTest-2052720250-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:17:06.699467 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-9a3b9297-0b2b-49d0-8d33-cdc15843f566 tempest-VolumesNegativeTest-2052720250 tempest-VolumesNegativeTest-2052720250-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:17:06.700217 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-9a3b9297-0b2b-49d0-8d33-cdc15843f566 tempest-VolumesNegativeTest-2052720250 tempest-VolumesNegativeTest-2052720250-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:17:06.700645 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-9a3b9297-0b2b-49d0-8d33-cdc15843f566 tempest-VolumesNegativeTest-2052720250 tempest-VolumesNegativeTest-2052720250-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:17:06.764984 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-43d342c7-f783-44e6-abd4-5bd8f42a5898 tempest-VolumesGetTestJSON-1136549117 tempest-VolumesGetTestJSON-1136549117-project] Calling method '.version_select at 0x7f36be0031f0>' {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:17:06.812138 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [None req-43d342c7-f783-44e6-abd4-5bd8f42a5898 tempest-VolumesGetTestJSON-1136549117 tempest-VolumesGetTestJSON-1136549117-project] 10.222.0.43 "GET /compute/v2.1/os-volumes/cf47cdcb-6776-47f0-a08e-312d6ec054e6" status: 200 len: 352 microversion: 2.1 time: 0.050992 Jun 22 10:17:06.812845 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 106/201] 10.222.0.43 () {58 vars in 1244 bytes} [Wed Jun 22 10:17:06 2022] GET /compute/v2.1/os-volumes/cf47cdcb-6776-47f0-a08e-312d6ec054e6 => generated 352 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 22 10:17:06.832926 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.policy [None req-9a3b9297-0b2b-49d0-8d33-cdc15843f566 tempest-VolumesNegativeTest-2052720250 tempest-VolumesNegativeTest-2052720250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b4ef2f1a6dd45ccaea982213e051ee8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b97e48bc75b74b49aec21b8a8b2810d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117873) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:17:06.840195 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [None req-9a3b9297-0b2b-49d0-8d33-cdc15843f566 tempest-VolumesNegativeTest-2052720250 tempest-VolumesNegativeTest-2052720250-project] 10.222.0.43 "GET /compute/v2.1/servers/06859498-5e65-4775-99f7-828d79365634" status: 200 len: 1314 microversion: 2.1 time: 0.153256 Jun 22 10:17:06.840751 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 96/202] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:17:06 2022] GET /compute/v2.1/servers/06859498-5e65-4775-99f7-828d79365634 => generated 1314 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:17:06.864479 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-325f8b2a-0845-4d7e-9023-28b7ce03f32d tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Calling method '>' {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:17:06.865082 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.compute.api [None req-325f8b2a-0845-4d7e-9023-28b7ce03f32d tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] [instance: 9f07e4bb-f4e9-428e-8feb-db50b3ff2109] Fetching instance by UUID {{(pid=117874) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:17:06.871061 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-325f8b2a-0845-4d7e-9023-28b7ce03f32d tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:17:06.871501 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-325f8b2a-0845-4d7e-9023-28b7ce03f32d tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:17:06.872247 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-325f8b2a-0845-4d7e-9023-28b7ce03f32d tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:17:06.872675 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-325f8b2a-0845-4d7e-9023-28b7ce03f32d tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:17:07.009008 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.policy [None req-325f8b2a-0845-4d7e-9023-28b7ce03f32d tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d7292401816437fba46d073c4746e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3277b9cbc4b4a8bbacee8440cea1ed2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117874) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:17:07.016422 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [None req-325f8b2a-0845-4d7e-9023-28b7ce03f32d tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] 10.222.0.43 "GET /compute/v2.1/servers/9f07e4bb-f4e9-428e-8feb-db50b3ff2109" status: 200 len: 1521 microversion: 2.1 time: 0.156338 Jun 22 10:17:07.016984 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 107/203] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:17:06 2022] GET /compute/v2.1/servers/9f07e4bb-f4e9-428e-8feb-db50b3ff2109 => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:17:07.824599 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-71135f78-72cc-463f-9e4c-f490db2e94f0 tempest-VolumesGetTestJSON-1136549117 tempest-VolumesGetTestJSON-1136549117-project] Calling method '.version_select at 0x7f36beeefc10>' {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:17:07.856615 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-a1e132cf-e140-4c4e-b85f-30655681d1d5 tempest-VolumesNegativeTest-2052720250 tempest-VolumesNegativeTest-2052720250-project] Calling method '>' {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:17:07.857228 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.compute.api [None req-a1e132cf-e140-4c4e-b85f-30655681d1d5 tempest-VolumesNegativeTest-2052720250 tempest-VolumesNegativeTest-2052720250-project] [instance: 06859498-5e65-4775-99f7-828d79365634] Fetching instance by UUID {{(pid=117874) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:17:07.863905 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-a1e132cf-e140-4c4e-b85f-30655681d1d5 tempest-VolumesNegativeTest-2052720250 tempest-VolumesNegativeTest-2052720250-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:17:07.864348 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-a1e132cf-e140-4c4e-b85f-30655681d1d5 tempest-VolumesNegativeTest-2052720250 tempest-VolumesNegativeTest-2052720250-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:17:07.865106 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-a1e132cf-e140-4c4e-b85f-30655681d1d5 tempest-VolumesNegativeTest-2052720250 tempest-VolumesNegativeTest-2052720250-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:17:07.865542 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-a1e132cf-e140-4c4e-b85f-30655681d1d5 tempest-VolumesNegativeTest-2052720250 tempest-VolumesNegativeTest-2052720250-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:17:07.872991 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [None req-71135f78-72cc-463f-9e4c-f490db2e94f0 tempest-VolumesGetTestJSON-1136549117 tempest-VolumesGetTestJSON-1136549117-project] 10.222.0.43 "GET /compute/v2.1/os-volumes/cf47cdcb-6776-47f0-a08e-312d6ec054e6" status: 200 len: 352 microversion: 2.1 time: 0.052239 Jun 22 10:17:07.873587 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 97/204] 10.222.0.43 () {58 vars in 1244 bytes} [Wed Jun 22 10:17:07 2022] GET /compute/v2.1/os-volumes/cf47cdcb-6776-47f0-a08e-312d6ec054e6 => generated 352 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 10:17:07.995364 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.policy [None req-a1e132cf-e140-4c4e-b85f-30655681d1d5 tempest-VolumesNegativeTest-2052720250 tempest-VolumesNegativeTest-2052720250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b4ef2f1a6dd45ccaea982213e051ee8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b97e48bc75b74b49aec21b8a8b2810d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117874) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:17:08.003296 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [None req-a1e132cf-e140-4c4e-b85f-30655681d1d5 tempest-VolumesNegativeTest-2052720250 tempest-VolumesNegativeTest-2052720250-project] 10.222.0.43 "GET /compute/v2.1/servers/06859498-5e65-4775-99f7-828d79365634" status: 200 len: 1314 microversion: 2.1 time: 0.150882 Jun 22 10:17:08.003848 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 108/205] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:17:07 2022] GET /compute/v2.1/servers/06859498-5e65-4775-99f7-828d79365634 => generated 1314 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 10:17:08.033373 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-824374cc-9d60-470c-8ca6-22badcfdf7a0 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Calling method '>' {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:17:08.034031 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.compute.api [None req-824374cc-9d60-470c-8ca6-22badcfdf7a0 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] [instance: 9f07e4bb-f4e9-428e-8feb-db50b3ff2109] Fetching instance by UUID {{(pid=117873) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:17:08.040719 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-824374cc-9d60-470c-8ca6-22badcfdf7a0 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:17:08.041160 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-824374cc-9d60-470c-8ca6-22badcfdf7a0 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:17:08.041939 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-824374cc-9d60-470c-8ca6-22badcfdf7a0 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:17:08.042365 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-824374cc-9d60-470c-8ca6-22badcfdf7a0 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:17:08.170227 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.policy [None req-824374cc-9d60-470c-8ca6-22badcfdf7a0 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d7292401816437fba46d073c4746e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3277b9cbc4b4a8bbacee8440cea1ed2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117873) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:17:08.178025 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [None req-824374cc-9d60-470c-8ca6-22badcfdf7a0 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] 10.222.0.43 "GET /compute/v2.1/servers/9f07e4bb-f4e9-428e-8feb-db50b3ff2109" status: 200 len: 1521 microversion: 2.1 time: 0.148393 Jun 22 10:17:08.178595 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 98/206] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:17:08 2022] GET /compute/v2.1/servers/9f07e4bb-f4e9-428e-8feb-db50b3ff2109 => generated 1521 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:17:08.888198 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-4da6d2ec-c071-4045-8a64-b5afeeca05e2 tempest-VolumesGetTestJSON-1136549117 tempest-VolumesGetTestJSON-1136549117-project] Calling method '.version_select at 0x7f36bde275e0>' {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:17:08.935548 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [None req-4da6d2ec-c071-4045-8a64-b5afeeca05e2 tempest-VolumesGetTestJSON-1136549117 tempest-VolumesGetTestJSON-1136549117-project] 10.222.0.43 "GET /compute/v2.1/os-volumes/cf47cdcb-6776-47f0-a08e-312d6ec054e6" status: 200 len: 353 microversion: 2.1 time: 0.053018 Jun 22 10:17:08.936117 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 109/207] 10.222.0.43 () {58 vars in 1244 bytes} [Wed Jun 22 10:17:08 2022] GET /compute/v2.1/os-volumes/cf47cdcb-6776-47f0-a08e-312d6ec054e6 => generated 353 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 10:17:08.946981 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-27ace8cd-9d4d-4122-971b-22289e533af0 tempest-VolumesGetTestJSON-1136549117 tempest-VolumesGetTestJSON-1136549117-project] Calling method '.version_select at 0x7f36c0bab040>' {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:17:08.994490 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [None req-27ace8cd-9d4d-4122-971b-22289e533af0 tempest-VolumesGetTestJSON-1136549117 tempest-VolumesGetTestJSON-1136549117-project] 10.222.0.43 "GET /compute/v2.1/os-volumes/cf47cdcb-6776-47f0-a08e-312d6ec054e6" status: 200 len: 353 microversion: 2.1 time: 0.051102 Jun 22 10:17:08.995065 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 99/208] 10.222.0.43 () {58 vars in 1244 bytes} [Wed Jun 22 10:17:08 2022] GET /compute/v2.1/os-volumes/cf47cdcb-6776-47f0-a08e-312d6ec054e6 => generated 353 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 10:17:09.011142 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-54cc303e-a53c-45bb-9d50-80c2ad2a6c5d tempest-VolumesGetTestJSON-1136549117 tempest-VolumesGetTestJSON-1136549117-project] Calling method '.version_select at 0x7f36bdf06280>' {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:17:09.019686 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-632bda12-2dab-4496-8f51-3e1421c1e031 tempest-VolumesNegativeTest-2052720250 tempest-VolumesNegativeTest-2052720250-project] Calling method '>' {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:17:09.020400 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.compute.api [None req-632bda12-2dab-4496-8f51-3e1421c1e031 tempest-VolumesNegativeTest-2052720250 tempest-VolumesNegativeTest-2052720250-project] [instance: 06859498-5e65-4775-99f7-828d79365634] Fetching instance by UUID {{(pid=117873) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:17:09.026732 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-632bda12-2dab-4496-8f51-3e1421c1e031 tempest-VolumesNegativeTest-2052720250 tempest-VolumesNegativeTest-2052720250-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:17:09.027181 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-632bda12-2dab-4496-8f51-3e1421c1e031 tempest-VolumesNegativeTest-2052720250 tempest-VolumesNegativeTest-2052720250-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:17:09.027942 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-632bda12-2dab-4496-8f51-3e1421c1e031 tempest-VolumesNegativeTest-2052720250 tempest-VolumesNegativeTest-2052720250-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:17:09.028374 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-632bda12-2dab-4496-8f51-3e1421c1e031 tempest-VolumesNegativeTest-2052720250 tempest-VolumesNegativeTest-2052720250-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:17:09.073439 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [None req-54cc303e-a53c-45bb-9d50-80c2ad2a6c5d tempest-VolumesGetTestJSON-1136549117 tempest-VolumesGetTestJSON-1136549117-project] 10.222.0.43 "DELETE /compute/v2.1/os-volumes/cf47cdcb-6776-47f0-a08e-312d6ec054e6" status: 202 len: 0 microversion: 2.1 time: 0.065985 Jun 22 10:17:09.074049 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 110/209] 10.222.0.43 () {58 vars in 1247 bytes} [Wed Jun 22 10:17:09 2022] DELETE /compute/v2.1/os-volumes/cf47cdcb-6776-47f0-a08e-312d6ec054e6 => generated 0 bytes in 67 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 22 10:17:09.081398 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-f8d83f28-0a2d-4b06-b5b4-21f2cf1be2b1 tempest-VolumesGetTestJSON-1136549117 tempest-VolumesGetTestJSON-1136549117-project] Calling method '.version_select at 0x7f36bdf58280>' {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:17:09.139457 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [None req-f8d83f28-0a2d-4b06-b5b4-21f2cf1be2b1 tempest-VolumesGetTestJSON-1136549117 tempest-VolumesGetTestJSON-1136549117-project] 10.222.0.43 "GET /compute/v2.1/os-volumes/cf47cdcb-6776-47f0-a08e-312d6ec054e6" status: 200 len: 352 microversion: 2.1 time: 0.061327 Jun 22 10:17:09.140223 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 111/210] 10.222.0.43 () {58 vars in 1244 bytes} [Wed Jun 22 10:17:09 2022] GET /compute/v2.1/os-volumes/cf47cdcb-6776-47f0-a08e-312d6ec054e6 => generated 352 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 22 10:17:09.162585 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.policy [None req-632bda12-2dab-4496-8f51-3e1421c1e031 tempest-VolumesNegativeTest-2052720250 tempest-VolumesNegativeTest-2052720250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b4ef2f1a6dd45ccaea982213e051ee8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b97e48bc75b74b49aec21b8a8b2810d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117873) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:17:09.170766 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [None req-632bda12-2dab-4496-8f51-3e1421c1e031 tempest-VolumesNegativeTest-2052720250 tempest-VolumesNegativeTest-2052720250-project] 10.222.0.43 "GET /compute/v2.1/servers/06859498-5e65-4775-99f7-828d79365634" status: 200 len: 1314 microversion: 2.1 time: 0.154926 Jun 22 10:17:09.171264 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 100/211] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:17:09 2022] GET /compute/v2.1/servers/06859498-5e65-4775-99f7-828d79365634 => generated 1314 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 10:17:09.195396 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-03b9f381-362b-4d9d-b594-5f165d253f65 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Calling method '>' {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:17:09.196002 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.compute.api [None req-03b9f381-362b-4d9d-b594-5f165d253f65 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] [instance: 9f07e4bb-f4e9-428e-8feb-db50b3ff2109] Fetching instance by UUID {{(pid=117874) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:17:09.202245 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-03b9f381-362b-4d9d-b594-5f165d253f65 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:17:09.202691 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-03b9f381-362b-4d9d-b594-5f165d253f65 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:17:09.203447 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-03b9f381-362b-4d9d-b594-5f165d253f65 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:17:09.203879 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-03b9f381-362b-4d9d-b594-5f165d253f65 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:17:09.338319 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.policy [None req-03b9f381-362b-4d9d-b594-5f165d253f65 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d7292401816437fba46d073c4746e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3277b9cbc4b4a8bbacee8440cea1ed2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117874) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:17:09.345918 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [None req-03b9f381-362b-4d9d-b594-5f165d253f65 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] 10.222.0.43 "GET /compute/v2.1/servers/9f07e4bb-f4e9-428e-8feb-db50b3ff2109" status: 200 len: 1521 microversion: 2.1 time: 0.155056 Jun 22 10:17:09.346490 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 112/212] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:17:09 2022] GET /compute/v2.1/servers/9f07e4bb-f4e9-428e-8feb-db50b3ff2109 => generated 1521 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:17:10.152504 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-9768c463-ecba-4a61-b44a-79b7f3f7c504 tempest-VolumesGetTestJSON-1136549117 tempest-VolumesGetTestJSON-1136549117-project] Calling method '.version_select at 0x7f36beeefe50>' {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:17:10.188011 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-87975d6b-a2c9-4866-bfa1-5e7b984f73d6 tempest-VolumesNegativeTest-2052720250 tempest-VolumesNegativeTest-2052720250-project] Calling method '>' {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:17:10.188655 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.compute.api [None req-87975d6b-a2c9-4866-bfa1-5e7b984f73d6 tempest-VolumesNegativeTest-2052720250 tempest-VolumesNegativeTest-2052720250-project] [instance: 06859498-5e65-4775-99f7-828d79365634] Fetching instance by UUID {{(pid=117874) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:17:10.195479 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-87975d6b-a2c9-4866-bfa1-5e7b984f73d6 tempest-VolumesNegativeTest-2052720250 tempest-VolumesNegativeTest-2052720250-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:17:10.195926 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-87975d6b-a2c9-4866-bfa1-5e7b984f73d6 tempest-VolumesNegativeTest-2052720250 tempest-VolumesNegativeTest-2052720250-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:17:10.197060 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-87975d6b-a2c9-4866-bfa1-5e7b984f73d6 tempest-VolumesNegativeTest-2052720250 tempest-VolumesNegativeTest-2052720250-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:17:10.197530 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-87975d6b-a2c9-4866-bfa1-5e7b984f73d6 tempest-VolumesNegativeTest-2052720250 tempest-VolumesNegativeTest-2052720250-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:17:10.198945 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [None req-9768c463-ecba-4a61-b44a-79b7f3f7c504 tempest-VolumesGetTestJSON-1136549117 tempest-VolumesGetTestJSON-1136549117-project] 10.222.0.43 "GET /compute/v2.1/os-volumes/cf47cdcb-6776-47f0-a08e-312d6ec054e6" status: 200 len: 352 microversion: 2.1 time: 0.050146 Jun 22 10:17:10.199509 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 101/213] 10.222.0.43 () {58 vars in 1244 bytes} [Wed Jun 22 10:17:10 2022] GET /compute/v2.1/os-volumes/cf47cdcb-6776-47f0-a08e-312d6ec054e6 => generated 352 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 10:17:10.334681 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.policy [None req-87975d6b-a2c9-4866-bfa1-5e7b984f73d6 tempest-VolumesNegativeTest-2052720250 tempest-VolumesNegativeTest-2052720250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b4ef2f1a6dd45ccaea982213e051ee8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b97e48bc75b74b49aec21b8a8b2810d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117874) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:17:10.342012 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [None req-87975d6b-a2c9-4866-bfa1-5e7b984f73d6 tempest-VolumesNegativeTest-2052720250 tempest-VolumesNegativeTest-2052720250-project] 10.222.0.43 "GET /compute/v2.1/servers/06859498-5e65-4775-99f7-828d79365634" status: 200 len: 1314 microversion: 2.1 time: 0.157790 Jun 22 10:17:10.342571 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 113/214] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:17:10 2022] GET /compute/v2.1/servers/06859498-5e65-4775-99f7-828d79365634 => generated 1314 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 10:17:10.363312 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-6bf2c062-9c52-457c-88d9-f6edf4600cf4 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Calling method '>' {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:17:10.363979 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.compute.api [None req-6bf2c062-9c52-457c-88d9-f6edf4600cf4 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] [instance: 9f07e4bb-f4e9-428e-8feb-db50b3ff2109] Fetching instance by UUID {{(pid=117873) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:17:10.370024 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-6bf2c062-9c52-457c-88d9-f6edf4600cf4 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:17:10.370461 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-6bf2c062-9c52-457c-88d9-f6edf4600cf4 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:17:10.371209 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-6bf2c062-9c52-457c-88d9-f6edf4600cf4 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:17:10.371638 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-6bf2c062-9c52-457c-88d9-f6edf4600cf4 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:17:10.504143 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.policy [None req-6bf2c062-9c52-457c-88d9-f6edf4600cf4 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d7292401816437fba46d073c4746e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3277b9cbc4b4a8bbacee8440cea1ed2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117873) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:17:10.511649 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [None req-6bf2c062-9c52-457c-88d9-f6edf4600cf4 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] 10.222.0.43 "GET /compute/v2.1/servers/9f07e4bb-f4e9-428e-8feb-db50b3ff2109" status: 200 len: 1521 microversion: 2.1 time: 0.152407 Jun 22 10:17:10.512208 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 102/215] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:17:10 2022] GET /compute/v2.1/servers/9f07e4bb-f4e9-428e-8feb-db50b3ff2109 => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:17:11.211100 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-cf4b73ab-17cd-433f-b737-2295a00ec3d3 tempest-VolumesGetTestJSON-1136549117 tempest-VolumesGetTestJSON-1136549117-project] Calling method '.version_select at 0x7f36bdea1820>' {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:17:11.256596 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [None req-cf4b73ab-17cd-433f-b737-2295a00ec3d3 tempest-VolumesGetTestJSON-1136549117 tempest-VolumesGetTestJSON-1136549117-project] 10.222.0.43 "GET /compute/v2.1/os-volumes/cf47cdcb-6776-47f0-a08e-312d6ec054e6" status: 200 len: 352 microversion: 2.1 time: 0.049337 Jun 22 10:17:11.257154 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 114/216] 10.222.0.43 () {58 vars in 1244 bytes} [Wed Jun 22 10:17:11 2022] GET /compute/v2.1/os-volumes/cf47cdcb-6776-47f0-a08e-312d6ec054e6 => generated 352 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 10:17:11.359585 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-a2f44b3b-3ae2-48ab-b3ca-7fa70e2f59eb tempest-VolumesNegativeTest-2052720250 tempest-VolumesNegativeTest-2052720250-project] Calling method '>' {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:17:11.360133 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.compute.api [None req-a2f44b3b-3ae2-48ab-b3ca-7fa70e2f59eb tempest-VolumesNegativeTest-2052720250 tempest-VolumesNegativeTest-2052720250-project] [instance: 06859498-5e65-4775-99f7-828d79365634] Fetching instance by UUID {{(pid=117873) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:17:11.366580 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-a2f44b3b-3ae2-48ab-b3ca-7fa70e2f59eb tempest-VolumesNegativeTest-2052720250 tempest-VolumesNegativeTest-2052720250-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:17:11.367014 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-a2f44b3b-3ae2-48ab-b3ca-7fa70e2f59eb tempest-VolumesNegativeTest-2052720250 tempest-VolumesNegativeTest-2052720250-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:17:11.367756 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-a2f44b3b-3ae2-48ab-b3ca-7fa70e2f59eb tempest-VolumesNegativeTest-2052720250 tempest-VolumesNegativeTest-2052720250-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:17:11.368181 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-a2f44b3b-3ae2-48ab-b3ca-7fa70e2f59eb tempest-VolumesNegativeTest-2052720250 tempest-VolumesNegativeTest-2052720250-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:17:11.496861 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.policy [None req-a2f44b3b-3ae2-48ab-b3ca-7fa70e2f59eb tempest-VolumesNegativeTest-2052720250 tempest-VolumesNegativeTest-2052720250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b4ef2f1a6dd45ccaea982213e051ee8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b97e48bc75b74b49aec21b8a8b2810d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117873) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:17:11.504776 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [None req-a2f44b3b-3ae2-48ab-b3ca-7fa70e2f59eb tempest-VolumesNegativeTest-2052720250 tempest-VolumesNegativeTest-2052720250-project] 10.222.0.43 "GET /compute/v2.1/servers/06859498-5e65-4775-99f7-828d79365634" status: 200 len: 1314 microversion: 2.1 time: 0.149053 Jun 22 10:17:11.505348 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 103/217] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:17:11 2022] GET /compute/v2.1/servers/06859498-5e65-4775-99f7-828d79365634 => generated 1314 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:17:11.527877 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-2c09acfd-9436-49aa-83cc-24038e43e045 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Calling method '>' {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:17:11.528487 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.compute.api [None req-2c09acfd-9436-49aa-83cc-24038e43e045 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] [instance: 9f07e4bb-f4e9-428e-8feb-db50b3ff2109] Fetching instance by UUID {{(pid=117874) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:17:11.535694 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-2c09acfd-9436-49aa-83cc-24038e43e045 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:17:11.536141 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-2c09acfd-9436-49aa-83cc-24038e43e045 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:17:11.536896 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-2c09acfd-9436-49aa-83cc-24038e43e045 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:17:11.537331 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-2c09acfd-9436-49aa-83cc-24038e43e045 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:17:11.664137 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.policy [None req-2c09acfd-9436-49aa-83cc-24038e43e045 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d7292401816437fba46d073c4746e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3277b9cbc4b4a8bbacee8440cea1ed2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117874) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:17:11.671525 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [None req-2c09acfd-9436-49aa-83cc-24038e43e045 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] 10.222.0.43 "GET /compute/v2.1/servers/9f07e4bb-f4e9-428e-8feb-db50b3ff2109" status: 200 len: 1521 microversion: 2.1 time: 0.147555 Jun 22 10:17:11.672084 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 115/218] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:17:11 2022] GET /compute/v2.1/servers/9f07e4bb-f4e9-428e-8feb-db50b3ff2109 => generated 1521 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:17:12.269735 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-6f7c9738-50ef-4447-b4c2-a3814a06e2ae tempest-VolumesGetTestJSON-1136549117 tempest-VolumesGetTestJSON-1136549117-project] Calling method '.version_select at 0x7f36bef1e1f0>' {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:17:12.277299 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG dbcounter [-] [117873] Writing DB stats nova_cell0:SELECT=2 {{(pid=117873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:17:12.278118 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG dbcounter [-] [117873] Writing DB stats nova_cell0:SELECT=6 {{(pid=117873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:17:12.324711 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [None req-6f7c9738-50ef-4447-b4c2-a3814a06e2ae tempest-VolumesGetTestJSON-1136549117 tempest-VolumesGetTestJSON-1136549117-project] 10.222.0.43 "GET /compute/v2.1/os-volumes/cf47cdcb-6776-47f0-a08e-312d6ec054e6" status: 200 len: 352 microversion: 2.1 time: 0.060020 Jun 22 10:17:12.325371 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 104/219] 10.222.0.43 () {58 vars in 1244 bytes} [Wed Jun 22 10:17:12 2022] GET /compute/v2.1/os-volumes/cf47cdcb-6776-47f0-a08e-312d6ec054e6 => generated 352 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 10:17:12.521519 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-14724f2e-b4d2-4840-9e83-0c5972318ff0 tempest-VolumesNegativeTest-2052720250 tempest-VolumesNegativeTest-2052720250-project] Calling method '>' {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:17:12.522276 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.compute.api [None req-14724f2e-b4d2-4840-9e83-0c5972318ff0 tempest-VolumesNegativeTest-2052720250 tempest-VolumesNegativeTest-2052720250-project] [instance: 06859498-5e65-4775-99f7-828d79365634] Fetching instance by UUID {{(pid=117874) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:17:12.525407 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG dbcounter [-] [117874] Writing DB stats nova_cell0:SELECT=2 {{(pid=117874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:17:12.530493 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-14724f2e-b4d2-4840-9e83-0c5972318ff0 tempest-VolumesNegativeTest-2052720250 tempest-VolumesNegativeTest-2052720250-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:17:12.530941 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-14724f2e-b4d2-4840-9e83-0c5972318ff0 tempest-VolumesNegativeTest-2052720250 tempest-VolumesNegativeTest-2052720250-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:17:12.531716 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-14724f2e-b4d2-4840-9e83-0c5972318ff0 tempest-VolumesNegativeTest-2052720250 tempest-VolumesNegativeTest-2052720250-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:17:12.532151 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-14724f2e-b4d2-4840-9e83-0c5972318ff0 tempest-VolumesNegativeTest-2052720250 tempest-VolumesNegativeTest-2052720250-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:17:12.663650 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.policy [None req-14724f2e-b4d2-4840-9e83-0c5972318ff0 tempest-VolumesNegativeTest-2052720250 tempest-VolumesNegativeTest-2052720250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b4ef2f1a6dd45ccaea982213e051ee8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b97e48bc75b74b49aec21b8a8b2810d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117874) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:17:12.671164 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [None req-14724f2e-b4d2-4840-9e83-0c5972318ff0 tempest-VolumesNegativeTest-2052720250 tempest-VolumesNegativeTest-2052720250-project] 10.222.0.43 "GET /compute/v2.1/servers/06859498-5e65-4775-99f7-828d79365634" status: 200 len: 1314 microversion: 2.1 time: 0.153525 Jun 22 10:17:12.671737 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 116/220] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:17:12 2022] GET /compute/v2.1/servers/06859498-5e65-4775-99f7-828d79365634 => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:17:12.688127 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-03b26f22-040e-4cc9-80b7-00bdd994d4bb tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Calling method '>' {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:17:12.688720 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.compute.api [None req-03b26f22-040e-4cc9-80b7-00bdd994d4bb tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] [instance: 9f07e4bb-f4e9-428e-8feb-db50b3ff2109] Fetching instance by UUID {{(pid=117873) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:17:12.694910 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-03b26f22-040e-4cc9-80b7-00bdd994d4bb tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:17:12.695343 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-03b26f22-040e-4cc9-80b7-00bdd994d4bb tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:17:12.696097 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-03b26f22-040e-4cc9-80b7-00bdd994d4bb tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:17:12.696548 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-03b26f22-040e-4cc9-80b7-00bdd994d4bb tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:17:12.832712 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.policy [None req-03b26f22-040e-4cc9-80b7-00bdd994d4bb tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d7292401816437fba46d073c4746e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3277b9cbc4b4a8bbacee8440cea1ed2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117873) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:17:12.842295 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [None req-03b26f22-040e-4cc9-80b7-00bdd994d4bb tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] 10.222.0.43 "GET /compute/v2.1/servers/9f07e4bb-f4e9-428e-8feb-db50b3ff2109" status: 200 len: 1521 microversion: 2.1 time: 0.156030 Jun 22 10:17:12.842295 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 105/221] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:17:12 2022] GET /compute/v2.1/servers/9f07e4bb-f4e9-428e-8feb-db50b3ff2109 => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:17:13.337938 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-d6ec0dc3-11f4-440c-b731-b79931548185 tempest-VolumesGetTestJSON-1136549117 tempest-VolumesGetTestJSON-1136549117-project] Calling method '.version_select at 0x7f36bde38550>' {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:17:13.365939 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.wsgi [None req-d6ec0dc3-11f4-440c-b731-b79931548185 tempest-VolumesGetTestJSON-1136549117 tempest-VolumesGetTestJSON-1136549117-project] HTTP exception thrown: Volume cf47cdcb-6776-47f0-a08e-312d6ec054e6 could not be found. Jun 22 10:17:13.367992 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-d6ec0dc3-11f4-440c-b731-b79931548185 tempest-VolumesGetTestJSON-1136549117 tempest-VolumesGetTestJSON-1136549117-project] Request method failure captured: Jun 22 10:17:13.367992 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: request: GET /compute/v2.1/os-volumes/cf47cdcb-6776-47f0-a08e-312d6ec054e6 HTTP/1.1 Jun 22 10:17:13.367992 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: Accept: application/json Jun 22 10:17:13.367992 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: Accept-Encoding: identity Jun 22 10:17:13.367992 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: Connection: close Jun 22 10:17:13.367992 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: Content-Length: 0 Jun 22 10:17:13.367992 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: Content-Type: application/json Jun 22 10:17:13.367992 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: Host: 10.222.0.43 Jun 22 10:17:13.367992 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: Openstack-System-Scope: None Jun 22 10:17:13.367992 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: User-Agent: python-urllib3/1.26.9 Jun 22 10:17:13.367992 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-Auth-Token: gAAAAABisuwgHt15B3cqCTSkqUynCOssb45w5rB5r00wOnRLUdeqrefmJu3k1iR8pq5MFMR_MszdaAsPMJ-jPF515to6EmiRMgcpcOzQQTrEa0gjn--5U5wcIz71sHvu73KLwGuwqW7Pre3-Y3QSvn56vA-WQN0CVrPvcOW76zEelmdyx4zhIKU Jun 22 10:17:13.367992 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-Domain-Id: None Jun 22 10:17:13.367992 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-Domain-Name: None Jun 22 10:17:13.367992 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-Identity-Status: Confirmed Jun 22 10:17:13.367992 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-Is-Admin-Project: True Jun 22 10:17:13.367992 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-Project-Domain-Id: default Jun 22 10:17:13.367992 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-Project-Domain-Name: Default Jun 22 10:17:13.367992 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-Project-Id: 0d651176f9b74f8d9ac26d0004d73e08 Jun 22 10:17:13.367992 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-Project-Name: tempest-VolumesGetTestJSON-1136549117 Jun 22 10:17:13.367992 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-Role: reader,member Jun 22 10:17:13.367992 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-Roles: reader,member Jun 22 10:17:13.369296 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/0d651176f9b74f8d9ac26d0004d73e08"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/0d651176f9b74f8d9ac26d0004d73e08"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_0d651176f9b74f8d9ac26d0004d73e08", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/0d651176f9b74f8d9ac26d0004d73e08"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}] Jun 22 10:17:13.369296 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-Tenant: tempest-VolumesGetTestJSON-1136549117 Jun 22 10:17:13.369296 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-Tenant-Id: 0d651176f9b74f8d9ac26d0004d73e08 Jun 22 10:17:13.369296 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-Tenant-Name: tempest-VolumesGetTestJSON-1136549117 Jun 22 10:17:13.369296 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-User: tempest-VolumesGetTestJSON-1136549117-project Jun 22 10:17:13.369296 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-User-Domain-Id: default Jun 22 10:17:13.369296 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-User-Domain-Name: Default Jun 22 10:17:13.369296 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-User-Id: 9950cfb0f136480cacdf53f93d988bd8 Jun 22 10:17:13.369296 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-User-Name: tempest-VolumesGetTestJSON-1136549117-project Jun 22 10:17:13.369296 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: method: Jun 22 10:17:13.369296 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: exception: Volume cf47cdcb-6776-47f0-a08e-312d6ec054e6 could not be found. Jun 22 10:17:13.369296 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: action_args: {'id': 'cf47cdcb-6776-47f0-a08e-312d6ec054e6'} Jun 22 10:17:13.369296 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 10:17:13.370221 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:17:13.370221 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 22 10:17:13.370221 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 22 10:17:13.370221 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 22 10:17:13.370221 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 22 10:17:13.370221 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 22 10:17:13.370221 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 22 10:17:13.370221 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 22 10:17:13.370221 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 22 10:17:13.370221 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 22 10:17:13.370221 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 22 10:17:13.370221 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 22 10:17:13.370221 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 22 10:17:13.370221 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 22 10:17:13.370221 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 22 10:17:13.370221 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume cf47cdcb-6776-47f0-a08e-312d6ec054e6 could not be found. (HTTP 404) (Request-ID: req-7527d253-ef89-47b4-8091-d67daeb16b4f) Jun 22 10:17:13.370221 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi Jun 22 10:17:13.370221 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 10:17:13.370221 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi Jun 22 10:17:13.371297 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:17:13.371297 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 22 10:17:13.371297 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 22 10:17:13.371297 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 22 10:17:13.371297 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 22 10:17:13.371297 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 22 10:17:13.371297 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 22 10:17:13.371297 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 22 10:17:13.371297 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 22 10:17:13.371297 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 22 10:17:13.371297 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 22 10:17:13.371297 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 22 10:17:13.371297 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 22 10:17:13.371297 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 22 10:17:13.371297 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 22 10:17:13.371297 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 22 10:17:13.371297 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 22 10:17:13.371297 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 22 10:17:13.371297 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 22 10:17:13.372443 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 22 10:17:13.372443 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 22 10:17:13.372443 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 22 10:17:13.372443 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 22 10:17:13.372443 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume cf47cdcb-6776-47f0-a08e-312d6ec054e6 could not be found. Jun 22 10:17:13.372443 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi Jun 22 10:17:13.372443 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 10:17:13.372443 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi Jun 22 10:17:13.372443 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:17:13.372443 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 10:17:13.372443 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 10:17:13.372443 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 10:17:13.372443 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 10:17:13.372443 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 22 10:17:13.372443 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 22 10:17:13.372443 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 10:17:13.372443 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 10:17:13.372443 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 22 10:17:13.372443 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 22 10:17:13.373442 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume cf47cdcb-6776-47f0-a08e-312d6ec054e6 could not be found. Jun 22 10:17:13.373442 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi Jun 22 10:17:13.373442 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 10:17:13.373442 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi Jun 22 10:17:13.373442 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:17:13.373442 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 10:17:13.373442 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 10:17:13.373442 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 10:17:13.373442 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 10:17:13.373442 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume cf47cdcb-6776-47f0-a08e-312d6ec054e6 could not be found. Jun 22 10:17:13.373442 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi Jun 22 10:17:13.373442 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-d6ec0dc3-11f4-440c-b731-b79931548185 tempest-VolumesGetTestJSON-1136549117 tempest-VolumesGetTestJSON-1136549117-project] Returning 404 to user: Volume cf47cdcb-6776-47f0-a08e-312d6ec054e6 could not be found. {{(pid=117874) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 10:17:13.373442 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [None req-d6ec0dc3-11f4-440c-b731-b79931548185 tempest-VolumesGetTestJSON-1136549117 tempest-VolumesGetTestJSON-1136549117-project] 10.222.0.43 "GET /compute/v2.1/os-volumes/cf47cdcb-6776-47f0-a08e-312d6ec054e6" status: 404 len: 109 microversion: 2.1 time: 0.035704 Jun 22 10:17:13.373442 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 117/222] 10.222.0.43 () {58 vars in 1244 bytes} [Wed Jun 22 10:17:13 2022] GET /compute/v2.1/os-volumes/cf47cdcb-6776-47f0-a08e-312d6ec054e6 => generated 109 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 22 10:17:13.688195 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-9f3c62f4-d7e6-4719-ba47-c45ffc21d3d4 tempest-VolumesNegativeTest-2052720250 tempest-VolumesNegativeTest-2052720250-project] Calling method '>' {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:17:13.688792 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.compute.api [None req-9f3c62f4-d7e6-4719-ba47-c45ffc21d3d4 tempest-VolumesNegativeTest-2052720250 tempest-VolumesNegativeTest-2052720250-project] [instance: 06859498-5e65-4775-99f7-828d79365634] Fetching instance by UUID {{(pid=117873) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:17:13.695746 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-9f3c62f4-d7e6-4719-ba47-c45ffc21d3d4 tempest-VolumesNegativeTest-2052720250 tempest-VolumesNegativeTest-2052720250-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:17:13.696188 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-9f3c62f4-d7e6-4719-ba47-c45ffc21d3d4 tempest-VolumesNegativeTest-2052720250 tempest-VolumesNegativeTest-2052720250-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:17:13.696940 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-9f3c62f4-d7e6-4719-ba47-c45ffc21d3d4 tempest-VolumesNegativeTest-2052720250 tempest-VolumesNegativeTest-2052720250-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:17:13.697371 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-9f3c62f4-d7e6-4719-ba47-c45ffc21d3d4 tempest-VolumesNegativeTest-2052720250 tempest-VolumesNegativeTest-2052720250-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:17:13.859255 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-05c92348-9c08-4463-981d-0e970e39ee09 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Calling method '>' {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:17:13.861923 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.compute.api [None req-05c92348-9c08-4463-981d-0e970e39ee09 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] [instance: 9f07e4bb-f4e9-428e-8feb-db50b3ff2109] Fetching instance by UUID {{(pid=117874) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:17:13.866947 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG dbcounter [-] [117874] Writing DB stats nova_api:SELECT=64 {{(pid=117874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:17:13.873232 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-05c92348-9c08-4463-981d-0e970e39ee09 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:17:13.873680 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-05c92348-9c08-4463-981d-0e970e39ee09 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:17:13.874484 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-05c92348-9c08-4463-981d-0e970e39ee09 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:17:13.874948 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-05c92348-9c08-4463-981d-0e970e39ee09 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:17:13.889262 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.policy [None req-9f3c62f4-d7e6-4719-ba47-c45ffc21d3d4 tempest-VolumesNegativeTest-2052720250 tempest-VolumesNegativeTest-2052720250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b4ef2f1a6dd45ccaea982213e051ee8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b97e48bc75b74b49aec21b8a8b2810d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117873) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:17:13.899664 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [None req-9f3c62f4-d7e6-4719-ba47-c45ffc21d3d4 tempest-VolumesNegativeTest-2052720250 tempest-VolumesNegativeTest-2052720250-project] 10.222.0.43 "GET /compute/v2.1/servers/06859498-5e65-4775-99f7-828d79365634" status: 200 len: 1314 microversion: 2.1 time: 0.215203 Jun 22 10:17:13.900418 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 106/223] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:17:13 2022] GET /compute/v2.1/servers/06859498-5e65-4775-99f7-828d79365634 => generated 1314 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:17:14.054641 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.policy [None req-05c92348-9c08-4463-981d-0e970e39ee09 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d7292401816437fba46d073c4746e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3277b9cbc4b4a8bbacee8440cea1ed2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117874) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:17:14.063237 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [None req-05c92348-9c08-4463-981d-0e970e39ee09 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] 10.222.0.43 "GET /compute/v2.1/servers/9f07e4bb-f4e9-428e-8feb-db50b3ff2109" status: 200 len: 1521 microversion: 2.1 time: 0.209412 Jun 22 10:17:14.063812 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 118/224] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:17:13 2022] GET /compute/v2.1/servers/9f07e4bb-f4e9-428e-8feb-db50b3ff2109 => generated 1521 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:17:14.916696 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-5aa71e80-1a9b-4a5b-981b-05b8b045cf3b tempest-VolumesNegativeTest-2052720250 tempest-VolumesNegativeTest-2052720250-project] Calling method '>' {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:17:14.918702 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.compute.api [None req-5aa71e80-1a9b-4a5b-981b-05b8b045cf3b tempest-VolumesNegativeTest-2052720250 tempest-VolumesNegativeTest-2052720250-project] [instance: 06859498-5e65-4775-99f7-828d79365634] Fetching instance by UUID {{(pid=117873) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:17:14.927663 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-5aa71e80-1a9b-4a5b-981b-05b8b045cf3b tempest-VolumesNegativeTest-2052720250 tempest-VolumesNegativeTest-2052720250-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:17:14.928143 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-5aa71e80-1a9b-4a5b-981b-05b8b045cf3b tempest-VolumesNegativeTest-2052720250 tempest-VolumesNegativeTest-2052720250-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:17:14.929067 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-5aa71e80-1a9b-4a5b-981b-05b8b045cf3b tempest-VolumesNegativeTest-2052720250 tempest-VolumesNegativeTest-2052720250-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:17:14.929651 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-5aa71e80-1a9b-4a5b-981b-05b8b045cf3b tempest-VolumesNegativeTest-2052720250 tempest-VolumesNegativeTest-2052720250-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:17:15.072698 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.policy [None req-5aa71e80-1a9b-4a5b-981b-05b8b045cf3b tempest-VolumesNegativeTest-2052720250 tempest-VolumesNegativeTest-2052720250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b4ef2f1a6dd45ccaea982213e051ee8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b97e48bc75b74b49aec21b8a8b2810d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117873) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:17:15.080221 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-8658b9e3-a0f2-4299-a575-bf58fe1da2dc tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Calling method '>' {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:17:15.080707 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [None req-5aa71e80-1a9b-4a5b-981b-05b8b045cf3b tempest-VolumesNegativeTest-2052720250 tempest-VolumesNegativeTest-2052720250-project] 10.222.0.43 "GET /compute/v2.1/servers/06859498-5e65-4775-99f7-828d79365634" status: 200 len: 1314 microversion: 2.1 time: 0.167752 Jun 22 10:17:15.081988 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 107/225] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:17:14 2022] GET /compute/v2.1/servers/06859498-5e65-4775-99f7-828d79365634 => generated 1314 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:17:15.082243 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.compute.api [None req-8658b9e3-a0f2-4299-a575-bf58fe1da2dc tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] [instance: 9f07e4bb-f4e9-428e-8feb-db50b3ff2109] Fetching instance by UUID {{(pid=117874) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:17:15.092846 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-8658b9e3-a0f2-4299-a575-bf58fe1da2dc tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:17:15.093296 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-8658b9e3-a0f2-4299-a575-bf58fe1da2dc tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:17:15.094371 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-8658b9e3-a0f2-4299-a575-bf58fe1da2dc tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:17:15.094961 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-8658b9e3-a0f2-4299-a575-bf58fe1da2dc tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:17:15.226461 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.policy [None req-8658b9e3-a0f2-4299-a575-bf58fe1da2dc tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d7292401816437fba46d073c4746e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3277b9cbc4b4a8bbacee8440cea1ed2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117874) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:17:15.234318 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [None req-8658b9e3-a0f2-4299-a575-bf58fe1da2dc tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] 10.222.0.43 "GET /compute/v2.1/servers/9f07e4bb-f4e9-428e-8feb-db50b3ff2109" status: 200 len: 1521 microversion: 2.1 time: 0.157934 Jun 22 10:17:15.235107 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 119/226] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:17:15 2022] GET /compute/v2.1/servers/9f07e4bb-f4e9-428e-8feb-db50b3ff2109 => generated 1521 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:17:16.098626 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-29dc10eb-8fe6-4590-9196-945a5641b9bf tempest-VolumesNegativeTest-2052720250 tempest-VolumesNegativeTest-2052720250-project] Calling method '>' {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:17:16.099153 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.compute.api [None req-29dc10eb-8fe6-4590-9196-945a5641b9bf tempest-VolumesNegativeTest-2052720250 tempest-VolumesNegativeTest-2052720250-project] [instance: 06859498-5e65-4775-99f7-828d79365634] Fetching instance by UUID {{(pid=117873) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:17:16.105362 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-29dc10eb-8fe6-4590-9196-945a5641b9bf tempest-VolumesNegativeTest-2052720250 tempest-VolumesNegativeTest-2052720250-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:17:16.105834 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-29dc10eb-8fe6-4590-9196-945a5641b9bf tempest-VolumesNegativeTest-2052720250 tempest-VolumesNegativeTest-2052720250-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:17:16.106577 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-29dc10eb-8fe6-4590-9196-945a5641b9bf tempest-VolumesNegativeTest-2052720250 tempest-VolumesNegativeTest-2052720250-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:17:16.107000 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-29dc10eb-8fe6-4590-9196-945a5641b9bf tempest-VolumesNegativeTest-2052720250 tempest-VolumesNegativeTest-2052720250-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:17:16.236809 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.policy [None req-29dc10eb-8fe6-4590-9196-945a5641b9bf tempest-VolumesNegativeTest-2052720250 tempest-VolumesNegativeTest-2052720250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b4ef2f1a6dd45ccaea982213e051ee8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b97e48bc75b74b49aec21b8a8b2810d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117873) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:17:16.244211 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [None req-29dc10eb-8fe6-4590-9196-945a5641b9bf tempest-VolumesNegativeTest-2052720250 tempest-VolumesNegativeTest-2052720250-project] 10.222.0.43 "GET /compute/v2.1/servers/06859498-5e65-4775-99f7-828d79365634" status: 200 len: 1314 microversion: 2.1 time: 0.150186 Jun 22 10:17:16.244774 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 108/227] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:17:16 2022] GET /compute/v2.1/servers/06859498-5e65-4775-99f7-828d79365634 => generated 1314 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:17:16.251790 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-ffcf311e-1deb-4c28-a815-c1df12ccabc8 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Calling method '>' {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:17:16.252394 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.compute.api [None req-ffcf311e-1deb-4c28-a815-c1df12ccabc8 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] [instance: 9f07e4bb-f4e9-428e-8feb-db50b3ff2109] Fetching instance by UUID {{(pid=117874) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:17:16.259275 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-ffcf311e-1deb-4c28-a815-c1df12ccabc8 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:17:16.259726 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-ffcf311e-1deb-4c28-a815-c1df12ccabc8 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:17:16.260514 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-ffcf311e-1deb-4c28-a815-c1df12ccabc8 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:17:16.260985 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-ffcf311e-1deb-4c28-a815-c1df12ccabc8 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:17:16.394523 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.policy [None req-ffcf311e-1deb-4c28-a815-c1df12ccabc8 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d7292401816437fba46d073c4746e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3277b9cbc4b4a8bbacee8440cea1ed2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117874) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:17:16.401595 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [None req-ffcf311e-1deb-4c28-a815-c1df12ccabc8 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] 10.222.0.43 "GET /compute/v2.1/servers/9f07e4bb-f4e9-428e-8feb-db50b3ff2109" status: 200 len: 1521 microversion: 2.1 time: 0.153682 Jun 22 10:17:16.402185 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 120/228] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:17:16 2022] GET /compute/v2.1/servers/9f07e4bb-f4e9-428e-8feb-db50b3ff2109 => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:17:16.897215 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [req-a215d5e2-8a5c-41b7-9342-19a14a913b04 req-30a13f01-efaa-4145-a625-f46071eb2fd1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "06859498-5e65-4775-99f7-828d79365634", "name": "network-vif-plugged", "status": "completed", "tag": "528fafa3-02ad-4846-bebb-f55c3ad3c12f"}]} {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:17:16.906583 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [req-a215d5e2-8a5c-41b7-9342-19a14a913b04 req-30a13f01-efaa-4145-a625-f46071eb2fd1 service nova] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:17:16.906996 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [req-a215d5e2-8a5c-41b7-9342-19a14a913b04 req-30a13f01-efaa-4145-a625-f46071eb2fd1 service nova] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:17:16.924251 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.compute.server_external_events [req-a215d5e2-8a5c-41b7-9342-19a14a913b04 req-30a13f01-efaa-4145-a625-f46071eb2fd1 service nova] Creating event network-vif-plugged:528fafa3-02ad-4846-bebb-f55c3ad3c12f for instance 06859498-5e65-4775-99f7-828d79365634 on hv-cinder-84713 Jun 22 10:17:16.932444 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [req-a215d5e2-8a5c-41b7-9342-19a14a913b04 req-30a13f01-efaa-4145-a625-f46071eb2fd1 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039157 Jun 22 10:17:16.933484 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 109/229] 10.222.0.43 () {64 vars in 1317 bytes} [Wed Jun 22 10:17:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 10:17:17.260272 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-4cdedd97-6a27-45a6-ad53-88496cb22f88 tempest-VolumesNegativeTest-2052720250 tempest-VolumesNegativeTest-2052720250-project] Calling method '>' {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:17:17.260878 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.compute.api [None req-4cdedd97-6a27-45a6-ad53-88496cb22f88 tempest-VolumesNegativeTest-2052720250 tempest-VolumesNegativeTest-2052720250-project] [instance: 06859498-5e65-4775-99f7-828d79365634] Fetching instance by UUID {{(pid=117874) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:17:17.267286 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-4cdedd97-6a27-45a6-ad53-88496cb22f88 tempest-VolumesNegativeTest-2052720250 tempest-VolumesNegativeTest-2052720250-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:17:17.267725 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-4cdedd97-6a27-45a6-ad53-88496cb22f88 tempest-VolumesNegativeTest-2052720250 tempest-VolumesNegativeTest-2052720250-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:17:17.269111 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-4cdedd97-6a27-45a6-ad53-88496cb22f88 tempest-VolumesNegativeTest-2052720250 tempest-VolumesNegativeTest-2052720250-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:17:17.269856 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-4cdedd97-6a27-45a6-ad53-88496cb22f88 tempest-VolumesNegativeTest-2052720250 tempest-VolumesNegativeTest-2052720250-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:17:17.403400 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.policy [None req-4cdedd97-6a27-45a6-ad53-88496cb22f88 tempest-VolumesNegativeTest-2052720250 tempest-VolumesNegativeTest-2052720250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b4ef2f1a6dd45ccaea982213e051ee8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b97e48bc75b74b49aec21b8a8b2810d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117874) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:17:17.411129 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [None req-4cdedd97-6a27-45a6-ad53-88496cb22f88 tempest-VolumesNegativeTest-2052720250 tempest-VolumesNegativeTest-2052720250-project] 10.222.0.43 "GET /compute/v2.1/servers/06859498-5e65-4775-99f7-828d79365634" status: 200 len: 1314 microversion: 2.1 time: 0.154727 Jun 22 10:17:17.411695 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 121/230] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:17:17 2022] GET /compute/v2.1/servers/06859498-5e65-4775-99f7-828d79365634 => generated 1314 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 10:17:17.418201 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-78ec216a-9f6d-42fd-b28c-9d459ab4488f tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Calling method '>' {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:17:17.418975 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.compute.api [None req-78ec216a-9f6d-42fd-b28c-9d459ab4488f tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] [instance: 9f07e4bb-f4e9-428e-8feb-db50b3ff2109] Fetching instance by UUID {{(pid=117873) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:17:17.425221 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-78ec216a-9f6d-42fd-b28c-9d459ab4488f tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:17:17.425870 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-78ec216a-9f6d-42fd-b28c-9d459ab4488f tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:17:17.426636 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-78ec216a-9f6d-42fd-b28c-9d459ab4488f tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:17:17.427071 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-78ec216a-9f6d-42fd-b28c-9d459ab4488f tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:17:17.559904 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.policy [None req-78ec216a-9f6d-42fd-b28c-9d459ab4488f tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d7292401816437fba46d073c4746e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3277b9cbc4b4a8bbacee8440cea1ed2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117873) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:17:17.562175 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG dbcounter [-] [117873] Writing DB stats nova_cell1:SELECT=100 {{(pid=117873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:17:17.569308 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [None req-78ec216a-9f6d-42fd-b28c-9d459ab4488f tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] 10.222.0.43 "GET /compute/v2.1/servers/9f07e4bb-f4e9-428e-8feb-db50b3ff2109" status: 200 len: 1521 microversion: 2.1 time: 0.155258 Jun 22 10:17:17.569897 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 110/231] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:17:17 2022] GET /compute/v2.1/servers/9f07e4bb-f4e9-428e-8feb-db50b3ff2109 => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:17:18.427689 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-29d32350-648e-4e45-a78b-916cb2878893 tempest-VolumesNegativeTest-2052720250 tempest-VolumesNegativeTest-2052720250-project] Calling method '>' {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:17:18.428281 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.compute.api [None req-29d32350-648e-4e45-a78b-916cb2878893 tempest-VolumesNegativeTest-2052720250 tempest-VolumesNegativeTest-2052720250-project] [instance: 06859498-5e65-4775-99f7-828d79365634] Fetching instance by UUID {{(pid=117874) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:17:18.435249 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-29d32350-648e-4e45-a78b-916cb2878893 tempest-VolumesNegativeTest-2052720250 tempest-VolumesNegativeTest-2052720250-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:17:18.436035 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-29d32350-648e-4e45-a78b-916cb2878893 tempest-VolumesNegativeTest-2052720250 tempest-VolumesNegativeTest-2052720250-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:17:18.436960 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-29d32350-648e-4e45-a78b-916cb2878893 tempest-VolumesNegativeTest-2052720250 tempest-VolumesNegativeTest-2052720250-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:17:18.437430 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-29d32350-648e-4e45-a78b-916cb2878893 tempest-VolumesNegativeTest-2052720250 tempest-VolumesNegativeTest-2052720250-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:17:18.570664 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.policy [None req-29d32350-648e-4e45-a78b-916cb2878893 tempest-VolumesNegativeTest-2052720250 tempest-VolumesNegativeTest-2052720250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b4ef2f1a6dd45ccaea982213e051ee8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b97e48bc75b74b49aec21b8a8b2810d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117874) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:17:18.578137 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [None req-29d32350-648e-4e45-a78b-916cb2878893 tempest-VolumesNegativeTest-2052720250 tempest-VolumesNegativeTest-2052720250-project] 10.222.0.43 "GET /compute/v2.1/servers/06859498-5e65-4775-99f7-828d79365634" status: 200 len: 1314 microversion: 2.1 time: 0.154303 Jun 22 10:17:18.578700 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 122/232] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:17:18 2022] GET /compute/v2.1/servers/06859498-5e65-4775-99f7-828d79365634 => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:17:18.586379 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-cd9cb562-e461-4379-9afe-2454ae7f9904 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Calling method '>' {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:17:18.586978 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.compute.api [None req-cd9cb562-e461-4379-9afe-2454ae7f9904 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] [instance: 9f07e4bb-f4e9-428e-8feb-db50b3ff2109] Fetching instance by UUID {{(pid=117873) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:17:18.592846 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-cd9cb562-e461-4379-9afe-2454ae7f9904 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:17:18.593281 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-cd9cb562-e461-4379-9afe-2454ae7f9904 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:17:18.594050 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-cd9cb562-e461-4379-9afe-2454ae7f9904 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:17:18.594476 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-cd9cb562-e461-4379-9afe-2454ae7f9904 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:17:18.720652 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.policy [None req-cd9cb562-e461-4379-9afe-2454ae7f9904 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d7292401816437fba46d073c4746e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3277b9cbc4b4a8bbacee8440cea1ed2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117873) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:17:18.728514 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [None req-cd9cb562-e461-4379-9afe-2454ae7f9904 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] 10.222.0.43 "GET /compute/v2.1/servers/9f07e4bb-f4e9-428e-8feb-db50b3ff2109" status: 200 len: 1521 microversion: 2.1 time: 0.145976 Jun 22 10:17:18.729333 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 111/233] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:17:18 2022] GET /compute/v2.1/servers/9f07e4bb-f4e9-428e-8feb-db50b3ff2109 => generated 1521 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:17:19.595303 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-13b7a18b-2700-405f-9954-5f2b406df4d6 tempest-VolumesNegativeTest-2052720250 tempest-VolumesNegativeTest-2052720250-project] Calling method '>' {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:17:19.595900 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.compute.api [None req-13b7a18b-2700-405f-9954-5f2b406df4d6 tempest-VolumesNegativeTest-2052720250 tempest-VolumesNegativeTest-2052720250-project] [instance: 06859498-5e65-4775-99f7-828d79365634] Fetching instance by UUID {{(pid=117874) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:17:19.603388 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-13b7a18b-2700-405f-9954-5f2b406df4d6 tempest-VolumesNegativeTest-2052720250 tempest-VolumesNegativeTest-2052720250-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:17:19.603844 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-13b7a18b-2700-405f-9954-5f2b406df4d6 tempest-VolumesNegativeTest-2052720250 tempest-VolumesNegativeTest-2052720250-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:17:19.604922 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-13b7a18b-2700-405f-9954-5f2b406df4d6 tempest-VolumesNegativeTest-2052720250 tempest-VolumesNegativeTest-2052720250-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:17:19.605360 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-13b7a18b-2700-405f-9954-5f2b406df4d6 tempest-VolumesNegativeTest-2052720250 tempest-VolumesNegativeTest-2052720250-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:17:19.738004 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.policy [None req-13b7a18b-2700-405f-9954-5f2b406df4d6 tempest-VolumesNegativeTest-2052720250 tempest-VolumesNegativeTest-2052720250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b4ef2f1a6dd45ccaea982213e051ee8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b97e48bc75b74b49aec21b8a8b2810d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117874) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:17:19.745513 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [None req-13b7a18b-2700-405f-9954-5f2b406df4d6 tempest-VolumesNegativeTest-2052720250 tempest-VolumesNegativeTest-2052720250-project] 10.222.0.43 "GET /compute/v2.1/servers/06859498-5e65-4775-99f7-828d79365634" status: 200 len: 1314 microversion: 2.1 time: 0.153996 Jun 22 10:17:19.745739 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-9867f34d-eb6a-4652-8c5f-e8a4c791c252 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Calling method '>' {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:17:19.746264 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 123/234] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:17:19 2022] GET /compute/v2.1/servers/06859498-5e65-4775-99f7-828d79365634 => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:17:19.746426 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.compute.api [None req-9867f34d-eb6a-4652-8c5f-e8a4c791c252 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] [instance: 9f07e4bb-f4e9-428e-8feb-db50b3ff2109] Fetching instance by UUID {{(pid=117873) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:17:19.752395 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-9867f34d-eb6a-4652-8c5f-e8a4c791c252 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:17:19.752895 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-9867f34d-eb6a-4652-8c5f-e8a4c791c252 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:17:19.753967 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-9867f34d-eb6a-4652-8c5f-e8a4c791c252 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:17:19.754401 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-9867f34d-eb6a-4652-8c5f-e8a4c791c252 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:17:19.884001 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.policy [None req-9867f34d-eb6a-4652-8c5f-e8a4c791c252 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d7292401816437fba46d073c4746e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3277b9cbc4b4a8bbacee8440cea1ed2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117873) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:17:19.891611 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [None req-9867f34d-eb6a-4652-8c5f-e8a4c791c252 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] 10.222.0.43 "GET /compute/v2.1/servers/9f07e4bb-f4e9-428e-8feb-db50b3ff2109" status: 200 len: 1521 microversion: 2.1 time: 0.149641 Jun 22 10:17:19.892183 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 112/235] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:17:19 2022] GET /compute/v2.1/servers/9f07e4bb-f4e9-428e-8feb-db50b3ff2109 => generated 1521 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 10:17:20.762238 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-e4bb3cde-422f-4d16-b3b6-9f6ce96bb47a tempest-VolumesNegativeTest-2052720250 tempest-VolumesNegativeTest-2052720250-project] Calling method '>' {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:17:20.762777 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.compute.api [None req-e4bb3cde-422f-4d16-b3b6-9f6ce96bb47a tempest-VolumesNegativeTest-2052720250 tempest-VolumesNegativeTest-2052720250-project] [instance: 06859498-5e65-4775-99f7-828d79365634] Fetching instance by UUID {{(pid=117874) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:17:20.770377 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-e4bb3cde-422f-4d16-b3b6-9f6ce96bb47a tempest-VolumesNegativeTest-2052720250 tempest-VolumesNegativeTest-2052720250-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:17:20.770824 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-e4bb3cde-422f-4d16-b3b6-9f6ce96bb47a tempest-VolumesNegativeTest-2052720250 tempest-VolumesNegativeTest-2052720250-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:17:20.771576 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-e4bb3cde-422f-4d16-b3b6-9f6ce96bb47a tempest-VolumesNegativeTest-2052720250 tempest-VolumesNegativeTest-2052720250-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:17:20.772011 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-e4bb3cde-422f-4d16-b3b6-9f6ce96bb47a tempest-VolumesNegativeTest-2052720250 tempest-VolumesNegativeTest-2052720250-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:17:20.792550 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG dbcounter [-] [117874] Writing DB stats nova_cell1:SELECT=100 {{(pid=117874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:17:20.908897 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-839b4000-4464-4bd2-9dee-c6d15e4f05f4 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Calling method '>' {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:17:20.910263 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.compute.api [None req-839b4000-4464-4bd2-9dee-c6d15e4f05f4 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] [instance: 9f07e4bb-f4e9-428e-8feb-db50b3ff2109] Fetching instance by UUID {{(pid=117873) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:17:20.916624 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-839b4000-4464-4bd2-9dee-c6d15e4f05f4 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:17:20.917224 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-839b4000-4464-4bd2-9dee-c6d15e4f05f4 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:17:20.918039 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-839b4000-4464-4bd2-9dee-c6d15e4f05f4 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:17:20.918467 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-839b4000-4464-4bd2-9dee-c6d15e4f05f4 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:17:21.127953 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.policy [None req-e4bb3cde-422f-4d16-b3b6-9f6ce96bb47a tempest-VolumesNegativeTest-2052720250 tempest-VolumesNegativeTest-2052720250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b4ef2f1a6dd45ccaea982213e051ee8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b97e48bc75b74b49aec21b8a8b2810d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117874) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:17:21.132686 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.policy [None req-839b4000-4464-4bd2-9dee-c6d15e4f05f4 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d7292401816437fba46d073c4746e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3277b9cbc4b4a8bbacee8440cea1ed2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117873) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:17:21.135438 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [None req-e4bb3cde-422f-4d16-b3b6-9f6ce96bb47a tempest-VolumesNegativeTest-2052720250 tempest-VolumesNegativeTest-2052720250-project] 10.222.0.43 "GET /compute/v2.1/servers/06859498-5e65-4775-99f7-828d79365634" status: 200 len: 1314 microversion: 2.1 time: 0.377050 Jun 22 10:17:21.136015 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 124/236] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:17:20 2022] GET /compute/v2.1/servers/06859498-5e65-4775-99f7-828d79365634 => generated 1314 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:17:21.143326 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [None req-839b4000-4464-4bd2-9dee-c6d15e4f05f4 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] 10.222.0.43 "GET /compute/v2.1/servers/9f07e4bb-f4e9-428e-8feb-db50b3ff2109" status: 200 len: 1521 microversion: 2.1 time: 0.238625 Jun 22 10:17:21.143902 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 113/237] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:17:20 2022] GET /compute/v2.1/servers/9f07e4bb-f4e9-428e-8feb-db50b3ff2109 => generated 1521 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 10:17:22.152303 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-5ac33885-6155-465a-afe7-2b96bf76579e tempest-VolumesNegativeTest-2052720250 tempest-VolumesNegativeTest-2052720250-project] Calling method '>' {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:17:22.154227 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.compute.api [None req-5ac33885-6155-465a-afe7-2b96bf76579e tempest-VolumesNegativeTest-2052720250 tempest-VolumesNegativeTest-2052720250-project] [instance: 06859498-5e65-4775-99f7-828d79365634] Fetching instance by UUID {{(pid=117874) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:17:22.159779 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-5ac33885-6155-465a-afe7-2b96bf76579e tempest-VolumesNegativeTest-2052720250 tempest-VolumesNegativeTest-2052720250-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:17:22.160204 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-04c26199-a06d-4006-9da9-d239700a2326 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Calling method '>' {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:17:22.160610 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-5ac33885-6155-465a-afe7-2b96bf76579e tempest-VolumesNegativeTest-2052720250 tempest-VolumesNegativeTest-2052720250-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:17:22.160947 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.compute.api [None req-04c26199-a06d-4006-9da9-d239700a2326 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] [instance: 9f07e4bb-f4e9-428e-8feb-db50b3ff2109] Fetching instance by UUID {{(pid=117873) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:17:22.161058 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-5ac33885-6155-465a-afe7-2b96bf76579e tempest-VolumesNegativeTest-2052720250 tempest-VolumesNegativeTest-2052720250-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:17:22.161400 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-5ac33885-6155-465a-afe7-2b96bf76579e tempest-VolumesNegativeTest-2052720250 tempest-VolumesNegativeTest-2052720250-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:17:22.162868 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG dbcounter [-] [117873] Writing DB stats nova_api:SELECT=70,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=117873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:17:22.168248 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-04c26199-a06d-4006-9da9-d239700a2326 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:17:22.168683 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-04c26199-a06d-4006-9da9-d239700a2326 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:17:22.169438 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-04c26199-a06d-4006-9da9-d239700a2326 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:17:22.169976 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-04c26199-a06d-4006-9da9-d239700a2326 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:17:22.356789 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.policy [None req-5ac33885-6155-465a-afe7-2b96bf76579e tempest-VolumesNegativeTest-2052720250 tempest-VolumesNegativeTest-2052720250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b4ef2f1a6dd45ccaea982213e051ee8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b97e48bc75b74b49aec21b8a8b2810d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117874) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:17:22.363175 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.policy [None req-04c26199-a06d-4006-9da9-d239700a2326 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d7292401816437fba46d073c4746e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3277b9cbc4b4a8bbacee8440cea1ed2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117873) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:17:22.364851 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [None req-5ac33885-6155-465a-afe7-2b96bf76579e tempest-VolumesNegativeTest-2052720250 tempest-VolumesNegativeTest-2052720250-project] 10.222.0.43 "GET /compute/v2.1/servers/06859498-5e65-4775-99f7-828d79365634" status: 200 len: 1463 microversion: 2.1 time: 0.216391 Jun 22 10:17:22.365421 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 125/238] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:17:22 2022] GET /compute/v2.1/servers/06859498-5e65-4775-99f7-828d79365634 => generated 1463 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:17:22.370628 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [None req-04c26199-a06d-4006-9da9-d239700a2326 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] 10.222.0.43 "GET /compute/v2.1/servers/9f07e4bb-f4e9-428e-8feb-db50b3ff2109" status: 200 len: 1521 microversion: 2.1 time: 0.215303 Jun 22 10:17:22.371186 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 114/239] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:17:22 2022] GET /compute/v2.1/servers/9f07e4bb-f4e9-428e-8feb-db50b3ff2109 => generated 1521 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 10:17:22.404844 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-69486e59-3872-4f76-b0d9-846a25fb48e3 tempest-VolumesNegativeTest-2052720250 tempest-VolumesNegativeTest-2052720250-project] Calling method '>' {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:17:22.405331 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.compute.api [None req-69486e59-3872-4f76-b0d9-846a25fb48e3 tempest-VolumesNegativeTest-2052720250 tempest-VolumesNegativeTest-2052720250-project] [instance: 06859498-5e65-4775-99f7-828d79365634] Fetching instance by UUID {{(pid=117874) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:17:22.411499 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-69486e59-3872-4f76-b0d9-846a25fb48e3 tempest-VolumesNegativeTest-2052720250 tempest-VolumesNegativeTest-2052720250-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:17:22.411942 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-69486e59-3872-4f76-b0d9-846a25fb48e3 tempest-VolumesNegativeTest-2052720250 tempest-VolumesNegativeTest-2052720250-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:17:22.412685 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-69486e59-3872-4f76-b0d9-846a25fb48e3 tempest-VolumesNegativeTest-2052720250 tempest-VolumesNegativeTest-2052720250-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:17:22.413113 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-69486e59-3872-4f76-b0d9-846a25fb48e3 tempest-VolumesNegativeTest-2052720250 tempest-VolumesNegativeTest-2052720250-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:17:22.437130 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.compute.api [None req-69486e59-3872-4f76-b0d9-846a25fb48e3 tempest-VolumesNegativeTest-2052720250 tempest-VolumesNegativeTest-2052720250-project] [instance: 06859498-5e65-4775-99f7-828d79365634] Going to try to terminate instance {{(pid=117874) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 22 10:17:22.516653 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [None req-69486e59-3872-4f76-b0d9-846a25fb48e3 tempest-VolumesNegativeTest-2052720250 tempest-VolumesNegativeTest-2052720250-project] 10.222.0.43 "DELETE /compute/v2.1/servers/06859498-5e65-4775-99f7-828d79365634" status: 204 len: 0 microversion: 2.1 time: 0.115265 Jun 22 10:17:22.517226 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 126/240] 10.222.0.43 () {58 vars in 1238 bytes} [Wed Jun 22 10:17:22 2022] DELETE /compute/v2.1/servers/06859498-5e65-4775-99f7-828d79365634 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 22 10:17:22.525960 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-70ba233e-2c25-49dc-a263-27803b3298bb tempest-VolumesNegativeTest-2052720250 tempest-VolumesNegativeTest-2052720250-project] Calling method '>' {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:17:22.526683 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.compute.api [None req-70ba233e-2c25-49dc-a263-27803b3298bb tempest-VolumesNegativeTest-2052720250 tempest-VolumesNegativeTest-2052720250-project] [instance: 06859498-5e65-4775-99f7-828d79365634] Fetching instance by UUID {{(pid=117873) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:17:22.532846 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-70ba233e-2c25-49dc-a263-27803b3298bb tempest-VolumesNegativeTest-2052720250 tempest-VolumesNegativeTest-2052720250-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:17:22.533280 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-70ba233e-2c25-49dc-a263-27803b3298bb tempest-VolumesNegativeTest-2052720250 tempest-VolumesNegativeTest-2052720250-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:17:22.534278 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-70ba233e-2c25-49dc-a263-27803b3298bb tempest-VolumesNegativeTest-2052720250 tempest-VolumesNegativeTest-2052720250-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:17:22.534764 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-70ba233e-2c25-49dc-a263-27803b3298bb tempest-VolumesNegativeTest-2052720250 tempest-VolumesNegativeTest-2052720250-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:17:22.664617 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.policy [None req-70ba233e-2c25-49dc-a263-27803b3298bb tempest-VolumesNegativeTest-2052720250 tempest-VolumesNegativeTest-2052720250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b4ef2f1a6dd45ccaea982213e051ee8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b97e48bc75b74b49aec21b8a8b2810d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117873) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:17:22.672031 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [None req-70ba233e-2c25-49dc-a263-27803b3298bb tempest-VolumesNegativeTest-2052720250 tempest-VolumesNegativeTest-2052720250-project] 10.222.0.43 "GET /compute/v2.1/servers/06859498-5e65-4775-99f7-828d79365634" status: 200 len: 1469 microversion: 2.1 time: 0.149995 Jun 22 10:17:22.672601 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 115/241] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:17:22 2022] GET /compute/v2.1/servers/06859498-5e65-4775-99f7-828d79365634 => generated 1469 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:17:23.388187 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-f6f6b742-082f-4a6d-8781-b8752adeb709 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Calling method '>' {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:17:23.388828 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.compute.api [None req-f6f6b742-082f-4a6d-8781-b8752adeb709 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] [instance: 9f07e4bb-f4e9-428e-8feb-db50b3ff2109] Fetching instance by UUID {{(pid=117874) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:17:23.396711 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-f6f6b742-082f-4a6d-8781-b8752adeb709 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:17:23.397158 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-f6f6b742-082f-4a6d-8781-b8752adeb709 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:17:23.397951 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-f6f6b742-082f-4a6d-8781-b8752adeb709 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:17:23.398383 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-f6f6b742-082f-4a6d-8781-b8752adeb709 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:17:23.528840 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.policy [None req-f6f6b742-082f-4a6d-8781-b8752adeb709 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d7292401816437fba46d073c4746e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3277b9cbc4b4a8bbacee8440cea1ed2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117874) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:17:23.537403 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [None req-f6f6b742-082f-4a6d-8781-b8752adeb709 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] 10.222.0.43 "GET /compute/v2.1/servers/9f07e4bb-f4e9-428e-8feb-db50b3ff2109" status: 200 len: 1521 microversion: 2.1 time: 0.153464 Jun 22 10:17:23.538011 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 127/242] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:17:23 2022] GET /compute/v2.1/servers/9f07e4bb-f4e9-428e-8feb-db50b3ff2109 => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:17:23.688144 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-69e0ca55-f584-41be-9994-3f9f6fffd292 tempest-VolumesNegativeTest-2052720250 tempest-VolumesNegativeTest-2052720250-project] Calling method '>' {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:17:23.688737 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.compute.api [None req-69e0ca55-f584-41be-9994-3f9f6fffd292 tempest-VolumesNegativeTest-2052720250 tempest-VolumesNegativeTest-2052720250-project] [instance: 06859498-5e65-4775-99f7-828d79365634] Fetching instance by UUID {{(pid=117873) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:17:23.694878 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-69e0ca55-f584-41be-9994-3f9f6fffd292 tempest-VolumesNegativeTest-2052720250 tempest-VolumesNegativeTest-2052720250-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:17:23.695314 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-69e0ca55-f584-41be-9994-3f9f6fffd292 tempest-VolumesNegativeTest-2052720250 tempest-VolumesNegativeTest-2052720250-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:17:23.696051 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-69e0ca55-f584-41be-9994-3f9f6fffd292 tempest-VolumesNegativeTest-2052720250 tempest-VolumesNegativeTest-2052720250-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:17:23.696471 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-69e0ca55-f584-41be-9994-3f9f6fffd292 tempest-VolumesNegativeTest-2052720250 tempest-VolumesNegativeTest-2052720250-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:17:23.821476 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.policy [None req-69e0ca55-f584-41be-9994-3f9f6fffd292 tempest-VolumesNegativeTest-2052720250 tempest-VolumesNegativeTest-2052720250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b4ef2f1a6dd45ccaea982213e051ee8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b97e48bc75b74b49aec21b8a8b2810d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117873) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:17:23.828974 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [None req-69e0ca55-f584-41be-9994-3f9f6fffd292 tempest-VolumesNegativeTest-2052720250 tempest-VolumesNegativeTest-2052720250-project] 10.222.0.43 "GET /compute/v2.1/servers/06859498-5e65-4775-99f7-828d79365634" status: 200 len: 1469 microversion: 2.1 time: 0.144578 Jun 22 10:17:23.829530 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 116/243] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:17:23 2022] GET /compute/v2.1/servers/06859498-5e65-4775-99f7-828d79365634 => generated 1469 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:17:24.554796 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-7e476097-33ff-41c4-9f6f-1c790de4fd11 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Calling method '>' {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:17:24.555403 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.compute.api [None req-7e476097-33ff-41c4-9f6f-1c790de4fd11 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] [instance: 9f07e4bb-f4e9-428e-8feb-db50b3ff2109] Fetching instance by UUID {{(pid=117874) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:17:24.561899 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-7e476097-33ff-41c4-9f6f-1c790de4fd11 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:17:24.562343 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-7e476097-33ff-41c4-9f6f-1c790de4fd11 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:17:24.563096 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-7e476097-33ff-41c4-9f6f-1c790de4fd11 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:17:24.563527 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-7e476097-33ff-41c4-9f6f-1c790de4fd11 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:17:24.692858 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.policy [None req-7e476097-33ff-41c4-9f6f-1c790de4fd11 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d7292401816437fba46d073c4746e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3277b9cbc4b4a8bbacee8440cea1ed2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117874) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:17:24.700810 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [None req-7e476097-33ff-41c4-9f6f-1c790de4fd11 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] 10.222.0.43 "GET /compute/v2.1/servers/9f07e4bb-f4e9-428e-8feb-db50b3ff2109" status: 200 len: 1521 microversion: 2.1 time: 0.149877 Jun 22 10:17:24.701383 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 128/244] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:17:24 2022] GET /compute/v2.1/servers/9f07e4bb-f4e9-428e-8feb-db50b3ff2109 => generated 1521 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:17:24.847958 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-14d022ad-8e81-4287-9152-4530b537a928 tempest-VolumesNegativeTest-2052720250 tempest-VolumesNegativeTest-2052720250-project] Calling method '>' {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:17:24.848670 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.compute.api [None req-14d022ad-8e81-4287-9152-4530b537a928 tempest-VolumesNegativeTest-2052720250 tempest-VolumesNegativeTest-2052720250-project] [instance: 06859498-5e65-4775-99f7-828d79365634] Fetching instance by UUID {{(pid=117873) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:17:24.855010 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-14d022ad-8e81-4287-9152-4530b537a928 tempest-VolumesNegativeTest-2052720250 tempest-VolumesNegativeTest-2052720250-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:17:24.855451 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-14d022ad-8e81-4287-9152-4530b537a928 tempest-VolumesNegativeTest-2052720250 tempest-VolumesNegativeTest-2052720250-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:17:24.856266 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-14d022ad-8e81-4287-9152-4530b537a928 tempest-VolumesNegativeTest-2052720250 tempest-VolumesNegativeTest-2052720250-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:17:24.856725 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-14d022ad-8e81-4287-9152-4530b537a928 tempest-VolumesNegativeTest-2052720250 tempest-VolumesNegativeTest-2052720250-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:17:24.999426 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.policy [None req-14d022ad-8e81-4287-9152-4530b537a928 tempest-VolumesNegativeTest-2052720250 tempest-VolumesNegativeTest-2052720250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b4ef2f1a6dd45ccaea982213e051ee8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b97e48bc75b74b49aec21b8a8b2810d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117873) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:17:25.009335 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [None req-14d022ad-8e81-4287-9152-4530b537a928 tempest-VolumesNegativeTest-2052720250 tempest-VolumesNegativeTest-2052720250-project] 10.222.0.43 "GET /compute/v2.1/servers/06859498-5e65-4775-99f7-828d79365634" status: 200 len: 1469 microversion: 2.1 time: 0.166505 Jun 22 10:17:25.010396 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 117/245] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:17:24 2022] GET /compute/v2.1/servers/06859498-5e65-4775-99f7-828d79365634 => generated 1469 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:17:25.717381 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-1377fddb-19c7-4546-af34-699d1469f8c8 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Calling method '>' {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:17:25.718008 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.compute.api [None req-1377fddb-19c7-4546-af34-699d1469f8c8 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] [instance: 9f07e4bb-f4e9-428e-8feb-db50b3ff2109] Fetching instance by UUID {{(pid=117874) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:17:25.724414 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-1377fddb-19c7-4546-af34-699d1469f8c8 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:17:25.724852 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-1377fddb-19c7-4546-af34-699d1469f8c8 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:17:25.725598 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-1377fddb-19c7-4546-af34-699d1469f8c8 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:17:25.726051 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-1377fddb-19c7-4546-af34-699d1469f8c8 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:17:25.854682 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.policy [None req-1377fddb-19c7-4546-af34-699d1469f8c8 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d7292401816437fba46d073c4746e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3277b9cbc4b4a8bbacee8440cea1ed2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117874) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:17:25.862996 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [None req-1377fddb-19c7-4546-af34-699d1469f8c8 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] 10.222.0.43 "GET /compute/v2.1/servers/9f07e4bb-f4e9-428e-8feb-db50b3ff2109" status: 200 len: 1521 microversion: 2.1 time: 0.148581 Jun 22 10:17:25.863559 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 129/246] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:17:25 2022] GET /compute/v2.1/servers/9f07e4bb-f4e9-428e-8feb-db50b3ff2109 => generated 1521 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:17:26.027489 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-5122b6fd-0396-4abb-b88a-ebfe6a980ac3 tempest-VolumesNegativeTest-2052720250 tempest-VolumesNegativeTest-2052720250-project] Calling method '>' {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:17:26.028099 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.compute.api [None req-5122b6fd-0396-4abb-b88a-ebfe6a980ac3 tempest-VolumesNegativeTest-2052720250 tempest-VolumesNegativeTest-2052720250-project] [instance: 06859498-5e65-4775-99f7-828d79365634] Fetching instance by UUID {{(pid=117873) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:17:26.034183 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-5122b6fd-0396-4abb-b88a-ebfe6a980ac3 tempest-VolumesNegativeTest-2052720250 tempest-VolumesNegativeTest-2052720250-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:17:26.034673 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-5122b6fd-0396-4abb-b88a-ebfe6a980ac3 tempest-VolumesNegativeTest-2052720250 tempest-VolumesNegativeTest-2052720250-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:17:26.035449 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-5122b6fd-0396-4abb-b88a-ebfe6a980ac3 tempest-VolumesNegativeTest-2052720250 tempest-VolumesNegativeTest-2052720250-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:17:26.035884 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-5122b6fd-0396-4abb-b88a-ebfe6a980ac3 tempest-VolumesNegativeTest-2052720250 tempest-VolumesNegativeTest-2052720250-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:17:26.168324 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.policy [None req-5122b6fd-0396-4abb-b88a-ebfe6a980ac3 tempest-VolumesNegativeTest-2052720250 tempest-VolumesNegativeTest-2052720250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b4ef2f1a6dd45ccaea982213e051ee8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b97e48bc75b74b49aec21b8a8b2810d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117873) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:17:26.176428 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [None req-5122b6fd-0396-4abb-b88a-ebfe6a980ac3 tempest-VolumesNegativeTest-2052720250 tempest-VolumesNegativeTest-2052720250-project] 10.222.0.43 "GET /compute/v2.1/servers/06859498-5e65-4775-99f7-828d79365634" status: 200 len: 1469 microversion: 2.1 time: 0.152834 Jun 22 10:17:26.176983 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 118/247] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:17:26 2022] GET /compute/v2.1/servers/06859498-5e65-4775-99f7-828d79365634 => generated 1469 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:17:26.881114 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-a85f942f-ebd8-4927-937a-5f083c57ac27 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Calling method '>' {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:17:26.881735 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.compute.api [None req-a85f942f-ebd8-4927-937a-5f083c57ac27 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] [instance: 9f07e4bb-f4e9-428e-8feb-db50b3ff2109] Fetching instance by UUID {{(pid=117874) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:17:26.888194 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-a85f942f-ebd8-4927-937a-5f083c57ac27 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:17:26.888664 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-a85f942f-ebd8-4927-937a-5f083c57ac27 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:17:26.889414 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-a85f942f-ebd8-4927-937a-5f083c57ac27 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:17:26.889884 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-a85f942f-ebd8-4927-937a-5f083c57ac27 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:17:27.039839 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.policy [None req-a85f942f-ebd8-4927-937a-5f083c57ac27 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d7292401816437fba46d073c4746e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3277b9cbc4b4a8bbacee8440cea1ed2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117874) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:17:27.049998 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [None req-a85f942f-ebd8-4927-937a-5f083c57ac27 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] 10.222.0.43 "GET /compute/v2.1/servers/9f07e4bb-f4e9-428e-8feb-db50b3ff2109" status: 200 len: 1521 microversion: 2.1 time: 0.173841 Jun 22 10:17:27.050592 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 130/248] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:17:26 2022] GET /compute/v2.1/servers/9f07e4bb-f4e9-428e-8feb-db50b3ff2109 => generated 1521 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:17:27.193430 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-9763bb13-1ef7-4a71-a3e5-7345bc24ced0 tempest-VolumesNegativeTest-2052720250 tempest-VolumesNegativeTest-2052720250-project] Calling method '>' {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:17:27.193996 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.compute.api [None req-9763bb13-1ef7-4a71-a3e5-7345bc24ced0 tempest-VolumesNegativeTest-2052720250 tempest-VolumesNegativeTest-2052720250-project] [instance: 06859498-5e65-4775-99f7-828d79365634] Fetching instance by UUID {{(pid=117873) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:17:27.200044 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-9763bb13-1ef7-4a71-a3e5-7345bc24ced0 tempest-VolumesNegativeTest-2052720250 tempest-VolumesNegativeTest-2052720250-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:17:27.200487 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-9763bb13-1ef7-4a71-a3e5-7345bc24ced0 tempest-VolumesNegativeTest-2052720250 tempest-VolumesNegativeTest-2052720250-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:17:27.201286 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-9763bb13-1ef7-4a71-a3e5-7345bc24ced0 tempest-VolumesNegativeTest-2052720250 tempest-VolumesNegativeTest-2052720250-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:17:27.201719 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-9763bb13-1ef7-4a71-a3e5-7345bc24ced0 tempest-VolumesNegativeTest-2052720250 tempest-VolumesNegativeTest-2052720250-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:17:27.337206 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.policy [None req-9763bb13-1ef7-4a71-a3e5-7345bc24ced0 tempest-VolumesNegativeTest-2052720250 tempest-VolumesNegativeTest-2052720250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b4ef2f1a6dd45ccaea982213e051ee8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b97e48bc75b74b49aec21b8a8b2810d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117873) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:17:27.345160 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [None req-9763bb13-1ef7-4a71-a3e5-7345bc24ced0 tempest-VolumesNegativeTest-2052720250 tempest-VolumesNegativeTest-2052720250-project] 10.222.0.43 "GET /compute/v2.1/servers/06859498-5e65-4775-99f7-828d79365634" status: 200 len: 1469 microversion: 2.1 time: 0.156726 Jun 22 10:17:27.345742 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 119/249] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:17:27 2022] GET /compute/v2.1/servers/06859498-5e65-4775-99f7-828d79365634 => generated 1469 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:17:28.068777 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-efd74341-c8a8-497a-8285-a19f263197a9 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Calling method '>' {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:17:28.069389 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.compute.api [None req-efd74341-c8a8-497a-8285-a19f263197a9 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] [instance: 9f07e4bb-f4e9-428e-8feb-db50b3ff2109] Fetching instance by UUID {{(pid=117874) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:17:28.076005 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-efd74341-c8a8-497a-8285-a19f263197a9 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:17:28.076454 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-efd74341-c8a8-497a-8285-a19f263197a9 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:17:28.077209 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-efd74341-c8a8-497a-8285-a19f263197a9 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:17:28.077643 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-efd74341-c8a8-497a-8285-a19f263197a9 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:17:28.214860 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.policy [None req-efd74341-c8a8-497a-8285-a19f263197a9 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d7292401816437fba46d073c4746e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3277b9cbc4b4a8bbacee8440cea1ed2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117874) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:17:28.224432 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [None req-efd74341-c8a8-497a-8285-a19f263197a9 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] 10.222.0.43 "GET /compute/v2.1/servers/9f07e4bb-f4e9-428e-8feb-db50b3ff2109" status: 200 len: 1521 microversion: 2.1 time: 0.160996 Jun 22 10:17:28.225010 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 131/250] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:17:28 2022] GET /compute/v2.1/servers/9f07e4bb-f4e9-428e-8feb-db50b3ff2109 => generated 1521 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:17:28.362360 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-3e6e4fb8-36c6-440b-9bcc-066e8bcc3d2f tempest-VolumesNegativeTest-2052720250 tempest-VolumesNegativeTest-2052720250-project] Calling method '>' {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:17:28.362974 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.compute.api [None req-3e6e4fb8-36c6-440b-9bcc-066e8bcc3d2f tempest-VolumesNegativeTest-2052720250 tempest-VolumesNegativeTest-2052720250-project] [instance: 06859498-5e65-4775-99f7-828d79365634] Fetching instance by UUID {{(pid=117873) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:17:28.369184 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-3e6e4fb8-36c6-440b-9bcc-066e8bcc3d2f tempest-VolumesNegativeTest-2052720250 tempest-VolumesNegativeTest-2052720250-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:17:28.369629 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-3e6e4fb8-36c6-440b-9bcc-066e8bcc3d2f tempest-VolumesNegativeTest-2052720250 tempest-VolumesNegativeTest-2052720250-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:17:28.370435 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-3e6e4fb8-36c6-440b-9bcc-066e8bcc3d2f tempest-VolumesNegativeTest-2052720250 tempest-VolumesNegativeTest-2052720250-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:17:28.370870 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-3e6e4fb8-36c6-440b-9bcc-066e8bcc3d2f tempest-VolumesNegativeTest-2052720250 tempest-VolumesNegativeTest-2052720250-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:17:28.519522 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.policy [None req-3e6e4fb8-36c6-440b-9bcc-066e8bcc3d2f tempest-VolumesNegativeTest-2052720250 tempest-VolumesNegativeTest-2052720250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b4ef2f1a6dd45ccaea982213e051ee8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b97e48bc75b74b49aec21b8a8b2810d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117873) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:17:28.527253 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [None req-3e6e4fb8-36c6-440b-9bcc-066e8bcc3d2f tempest-VolumesNegativeTest-2052720250 tempest-VolumesNegativeTest-2052720250-project] 10.222.0.43 "GET /compute/v2.1/servers/06859498-5e65-4775-99f7-828d79365634" status: 200 len: 1469 microversion: 2.1 time: 0.168742 Jun 22 10:17:28.527822 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 120/251] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:17:28 2022] GET /compute/v2.1/servers/06859498-5e65-4775-99f7-828d79365634 => generated 1469 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:17:28.884711 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [req-eccdba9d-97e2-4819-9f76-140de20c9aa1 req-2e860eaf-48bd-4617-8ed1-044651643fd1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "06859498-5e65-4775-99f7-828d79365634", "name": "network-vif-deleted", "tag": "528fafa3-02ad-4846-bebb-f55c3ad3c12f"}]} {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:17:28.895058 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [req-eccdba9d-97e2-4819-9f76-140de20c9aa1 req-2e860eaf-48bd-4617-8ed1-044651643fd1 service nova] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:17:28.895500 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [req-eccdba9d-97e2-4819-9f76-140de20c9aa1 req-2e860eaf-48bd-4617-8ed1-044651643fd1 service nova] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:17:28.909369 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.compute.server_external_events [req-eccdba9d-97e2-4819-9f76-140de20c9aa1 req-2e860eaf-48bd-4617-8ed1-044651643fd1 service nova] Creating event network-vif-deleted:528fafa3-02ad-4846-bebb-f55c3ad3c12f for instance 06859498-5e65-4775-99f7-828d79365634 on hv-cinder-84713 Jun 22 10:17:28.914818 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [req-eccdba9d-97e2-4819-9f76-140de20c9aa1 req-2e860eaf-48bd-4617-8ed1-044651643fd1 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033671 Jun 22 10:17:28.915438 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 132/252] 10.222.0.43 () {64 vars in 1317 bytes} [Wed Jun 22 10:17:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 10:17:29.242631 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-54d9eee1-e5a3-4ab0-81e8-39daa11781b9 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Calling method '>' {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:17:29.243298 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.compute.api [None req-54d9eee1-e5a3-4ab0-81e8-39daa11781b9 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] [instance: 9f07e4bb-f4e9-428e-8feb-db50b3ff2109] Fetching instance by UUID {{(pid=117873) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:17:29.254125 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-54d9eee1-e5a3-4ab0-81e8-39daa11781b9 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:17:29.254809 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-54d9eee1-e5a3-4ab0-81e8-39daa11781b9 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:17:29.256172 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-54d9eee1-e5a3-4ab0-81e8-39daa11781b9 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:17:29.257069 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-54d9eee1-e5a3-4ab0-81e8-39daa11781b9 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:17:29.401130 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.policy [None req-54d9eee1-e5a3-4ab0-81e8-39daa11781b9 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d7292401816437fba46d073c4746e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3277b9cbc4b4a8bbacee8440cea1ed2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117873) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:17:29.409331 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [None req-54d9eee1-e5a3-4ab0-81e8-39daa11781b9 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] 10.222.0.43 "GET /compute/v2.1/servers/9f07e4bb-f4e9-428e-8feb-db50b3ff2109" status: 200 len: 1521 microversion: 2.1 time: 0.169971 Jun 22 10:17:29.409973 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 121/253] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:17:29 2022] GET /compute/v2.1/servers/9f07e4bb-f4e9-428e-8feb-db50b3ff2109 => generated 1521 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:17:29.545406 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-fdeca778-a67e-47f8-9717-c24c735164ad tempest-VolumesNegativeTest-2052720250 tempest-VolumesNegativeTest-2052720250-project] Calling method '>' {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:17:29.546135 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.compute.api [None req-fdeca778-a67e-47f8-9717-c24c735164ad tempest-VolumesNegativeTest-2052720250 tempest-VolumesNegativeTest-2052720250-project] [instance: 06859498-5e65-4775-99f7-828d79365634] Fetching instance by UUID {{(pid=117874) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:17:29.552393 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-fdeca778-a67e-47f8-9717-c24c735164ad tempest-VolumesNegativeTest-2052720250 tempest-VolumesNegativeTest-2052720250-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:17:29.552847 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-fdeca778-a67e-47f8-9717-c24c735164ad tempest-VolumesNegativeTest-2052720250 tempest-VolumesNegativeTest-2052720250-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:17:29.553609 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-fdeca778-a67e-47f8-9717-c24c735164ad tempest-VolumesNegativeTest-2052720250 tempest-VolumesNegativeTest-2052720250-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:17:29.554067 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-fdeca778-a67e-47f8-9717-c24c735164ad tempest-VolumesNegativeTest-2052720250 tempest-VolumesNegativeTest-2052720250-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:17:29.587486 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-fdeca778-a67e-47f8-9717-c24c735164ad tempest-VolumesNegativeTest-2052720250 tempest-VolumesNegativeTest-2052720250-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:17:29.587979 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-fdeca778-a67e-47f8-9717-c24c735164ad tempest-VolumesNegativeTest-2052720250 tempest-VolumesNegativeTest-2052720250-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:17:29.588374 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.objects.instance [None req-fdeca778-a67e-47f8-9717-c24c735164ad tempest-VolumesNegativeTest-2052720250 tempest-VolumesNegativeTest-2052720250-project] Lazy-loading 'fault' on Instance uuid 06859498-5e65-4775-99f7-828d79365634 {{(pid=117874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 22 10:17:29.634637 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.policy [None req-fdeca778-a67e-47f8-9717-c24c735164ad tempest-VolumesNegativeTest-2052720250 tempest-VolumesNegativeTest-2052720250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b4ef2f1a6dd45ccaea982213e051ee8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b97e48bc75b74b49aec21b8a8b2810d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117874) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:17:29.642320 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [None req-fdeca778-a67e-47f8-9717-c24c735164ad tempest-VolumesNegativeTest-2052720250 tempest-VolumesNegativeTest-2052720250-project] 10.222.0.43 "GET /compute/v2.1/servers/06859498-5e65-4775-99f7-828d79365634" status: 200 len: 1304 microversion: 2.1 time: 0.101662 Jun 22 10:17:29.643398 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 133/254] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:17:29 2022] GET /compute/v2.1/servers/06859498-5e65-4775-99f7-828d79365634 => generated 1304 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:17:30.426259 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-cc5cc131-9a81-463c-ba8b-a783da278df0 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Calling method '>' {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:17:30.426976 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.compute.api [None req-cc5cc131-9a81-463c-ba8b-a783da278df0 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] [instance: 9f07e4bb-f4e9-428e-8feb-db50b3ff2109] Fetching instance by UUID {{(pid=117873) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:17:30.433225 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-cc5cc131-9a81-463c-ba8b-a783da278df0 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:17:30.433681 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-cc5cc131-9a81-463c-ba8b-a783da278df0 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:17:30.434533 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-cc5cc131-9a81-463c-ba8b-a783da278df0 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:17:30.434972 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-cc5cc131-9a81-463c-ba8b-a783da278df0 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:17:30.582381 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.policy [None req-cc5cc131-9a81-463c-ba8b-a783da278df0 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d7292401816437fba46d073c4746e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3277b9cbc4b4a8bbacee8440cea1ed2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117873) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:17:30.589992 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [None req-cc5cc131-9a81-463c-ba8b-a783da278df0 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] 10.222.0.43 "GET /compute/v2.1/servers/9f07e4bb-f4e9-428e-8feb-db50b3ff2109" status: 200 len: 1521 microversion: 2.1 time: 0.167917 Jun 22 10:17:30.590931 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 122/255] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:17:30 2022] GET /compute/v2.1/servers/9f07e4bb-f4e9-428e-8feb-db50b3ff2109 => generated 1521 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:17:30.659953 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-927d6e59-bfbe-408a-b5f0-b177d0021b4f tempest-VolumesNegativeTest-2052720250 tempest-VolumesNegativeTest-2052720250-project] Calling method '>' {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:17:30.660554 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.compute.api [None req-927d6e59-bfbe-408a-b5f0-b177d0021b4f tempest-VolumesNegativeTest-2052720250 tempest-VolumesNegativeTest-2052720250-project] [instance: 06859498-5e65-4775-99f7-828d79365634] Fetching instance by UUID {{(pid=117874) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:17:30.667934 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-927d6e59-bfbe-408a-b5f0-b177d0021b4f tempest-VolumesNegativeTest-2052720250 tempest-VolumesNegativeTest-2052720250-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:17:30.668486 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-927d6e59-bfbe-408a-b5f0-b177d0021b4f tempest-VolumesNegativeTest-2052720250 tempest-VolumesNegativeTest-2052720250-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:17:30.669299 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-927d6e59-bfbe-408a-b5f0-b177d0021b4f tempest-VolumesNegativeTest-2052720250 tempest-VolumesNegativeTest-2052720250-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:17:30.669779 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-927d6e59-bfbe-408a-b5f0-b177d0021b4f tempest-VolumesNegativeTest-2052720250 tempest-VolumesNegativeTest-2052720250-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:17:30.702210 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-927d6e59-bfbe-408a-b5f0-b177d0021b4f tempest-VolumesNegativeTest-2052720250 tempest-VolumesNegativeTest-2052720250-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:17:30.702662 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-927d6e59-bfbe-408a-b5f0-b177d0021b4f tempest-VolumesNegativeTest-2052720250 tempest-VolumesNegativeTest-2052720250-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:17:30.703106 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.objects.instance [None req-927d6e59-bfbe-408a-b5f0-b177d0021b4f tempest-VolumesNegativeTest-2052720250 tempest-VolumesNegativeTest-2052720250-project] Lazy-loading 'fault' on Instance uuid 06859498-5e65-4775-99f7-828d79365634 {{(pid=117874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 22 10:17:30.747655 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.policy [None req-927d6e59-bfbe-408a-b5f0-b177d0021b4f tempest-VolumesNegativeTest-2052720250 tempest-VolumesNegativeTest-2052720250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b4ef2f1a6dd45ccaea982213e051ee8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b97e48bc75b74b49aec21b8a8b2810d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117874) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:17:30.755746 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [None req-927d6e59-bfbe-408a-b5f0-b177d0021b4f tempest-VolumesNegativeTest-2052720250 tempest-VolumesNegativeTest-2052720250-project] 10.222.0.43 "GET /compute/v2.1/servers/06859498-5e65-4775-99f7-828d79365634" status: 200 len: 1304 microversion: 2.1 time: 0.100456 Jun 22 10:17:30.756342 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 134/256] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:17:30 2022] GET /compute/v2.1/servers/06859498-5e65-4775-99f7-828d79365634 => generated 1304 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:17:31.606810 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-3b0b0f49-bc3d-4680-a8ac-76490de5a88a tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Calling method '>' {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:17:31.607410 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.compute.api [None req-3b0b0f49-bc3d-4680-a8ac-76490de5a88a tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] [instance: 9f07e4bb-f4e9-428e-8feb-db50b3ff2109] Fetching instance by UUID {{(pid=117873) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:17:31.613946 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-3b0b0f49-bc3d-4680-a8ac-76490de5a88a tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:17:31.614401 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-3b0b0f49-bc3d-4680-a8ac-76490de5a88a tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:17:31.618174 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-3b0b0f49-bc3d-4680-a8ac-76490de5a88a tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:17:31.618174 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-3b0b0f49-bc3d-4680-a8ac-76490de5a88a tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:17:31.746951 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.policy [None req-3b0b0f49-bc3d-4680-a8ac-76490de5a88a tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d7292401816437fba46d073c4746e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3277b9cbc4b4a8bbacee8440cea1ed2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117873) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:17:31.755293 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [None req-3b0b0f49-bc3d-4680-a8ac-76490de5a88a tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] 10.222.0.43 "GET /compute/v2.1/servers/9f07e4bb-f4e9-428e-8feb-db50b3ff2109" status: 200 len: 1521 microversion: 2.1 time: 0.152673 Jun 22 10:17:31.755868 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 123/257] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:17:31 2022] GET /compute/v2.1/servers/9f07e4bb-f4e9-428e-8feb-db50b3ff2109 => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:17:31.773233 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-31f8eb9b-4534-409c-b2d8-1d1cae04e29c tempest-VolumesNegativeTest-2052720250 tempest-VolumesNegativeTest-2052720250-project] Calling method '>' {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:17:31.773966 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.compute.api [None req-31f8eb9b-4534-409c-b2d8-1d1cae04e29c tempest-VolumesNegativeTest-2052720250 tempest-VolumesNegativeTest-2052720250-project] [instance: 06859498-5e65-4775-99f7-828d79365634] Fetching instance by UUID {{(pid=117874) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:17:31.780518 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-31f8eb9b-4534-409c-b2d8-1d1cae04e29c tempest-VolumesNegativeTest-2052720250 tempest-VolumesNegativeTest-2052720250-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:17:31.780967 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-31f8eb9b-4534-409c-b2d8-1d1cae04e29c tempest-VolumesNegativeTest-2052720250 tempest-VolumesNegativeTest-2052720250-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:17:31.781750 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-31f8eb9b-4534-409c-b2d8-1d1cae04e29c tempest-VolumesNegativeTest-2052720250 tempest-VolumesNegativeTest-2052720250-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:17:31.782184 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-31f8eb9b-4534-409c-b2d8-1d1cae04e29c tempest-VolumesNegativeTest-2052720250 tempest-VolumesNegativeTest-2052720250-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:17:31.814461 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-31f8eb9b-4534-409c-b2d8-1d1cae04e29c tempest-VolumesNegativeTest-2052720250 tempest-VolumesNegativeTest-2052720250-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:17:31.815510 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-31f8eb9b-4534-409c-b2d8-1d1cae04e29c tempest-VolumesNegativeTest-2052720250 tempest-VolumesNegativeTest-2052720250-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:17:31.815963 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.objects.instance [None req-31f8eb9b-4534-409c-b2d8-1d1cae04e29c tempest-VolumesNegativeTest-2052720250 tempest-VolumesNegativeTest-2052720250-project] Lazy-loading 'fault' on Instance uuid 06859498-5e65-4775-99f7-828d79365634 {{(pid=117874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 22 10:17:31.859217 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.policy [None req-31f8eb9b-4534-409c-b2d8-1d1cae04e29c tempest-VolumesNegativeTest-2052720250 tempest-VolumesNegativeTest-2052720250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b4ef2f1a6dd45ccaea982213e051ee8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b97e48bc75b74b49aec21b8a8b2810d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117874) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:17:31.867334 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [None req-31f8eb9b-4534-409c-b2d8-1d1cae04e29c tempest-VolumesNegativeTest-2052720250 tempest-VolumesNegativeTest-2052720250-project] 10.222.0.43 "GET /compute/v2.1/servers/06859498-5e65-4775-99f7-828d79365634" status: 200 len: 1304 microversion: 2.1 time: 0.097856 Jun 22 10:17:31.867907 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 135/258] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:17:31 2022] GET /compute/v2.1/servers/06859498-5e65-4775-99f7-828d79365634 => generated 1304 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:17:32.772142 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-8d43aa24-163c-4dfa-9952-763dced923d9 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Calling method '>' {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:17:32.772886 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.compute.api [None req-8d43aa24-163c-4dfa-9952-763dced923d9 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] [instance: 9f07e4bb-f4e9-428e-8feb-db50b3ff2109] Fetching instance by UUID {{(pid=117873) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:17:32.779557 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-8d43aa24-163c-4dfa-9952-763dced923d9 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:17:32.780086 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-8d43aa24-163c-4dfa-9952-763dced923d9 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:17:32.780926 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-8d43aa24-163c-4dfa-9952-763dced923d9 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:17:32.781443 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-8d43aa24-163c-4dfa-9952-763dced923d9 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:17:32.885945 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-f2cab01e-f401-4fe3-b000-e5647d6bb6ab tempest-VolumesNegativeTest-2052720250 tempest-VolumesNegativeTest-2052720250-project] Calling method '>' {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:17:32.886560 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.compute.api [None req-f2cab01e-f401-4fe3-b000-e5647d6bb6ab tempest-VolumesNegativeTest-2052720250 tempest-VolumesNegativeTest-2052720250-project] [instance: 06859498-5e65-4775-99f7-828d79365634] Fetching instance by UUID {{(pid=117874) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:17:32.893934 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-f2cab01e-f401-4fe3-b000-e5647d6bb6ab tempest-VolumesNegativeTest-2052720250 tempest-VolumesNegativeTest-2052720250-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:17:32.894422 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-f2cab01e-f401-4fe3-b000-e5647d6bb6ab tempest-VolumesNegativeTest-2052720250 tempest-VolumesNegativeTest-2052720250-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:17:32.895200 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-f2cab01e-f401-4fe3-b000-e5647d6bb6ab tempest-VolumesNegativeTest-2052720250 tempest-VolumesNegativeTest-2052720250-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:17:32.895636 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-f2cab01e-f401-4fe3-b000-e5647d6bb6ab tempest-VolumesNegativeTest-2052720250 tempest-VolumesNegativeTest-2052720250-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:17:32.927806 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.policy [None req-8d43aa24-163c-4dfa-9952-763dced923d9 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d7292401816437fba46d073c4746e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3277b9cbc4b4a8bbacee8440cea1ed2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117873) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:17:32.933067 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-f2cab01e-f401-4fe3-b000-e5647d6bb6ab tempest-VolumesNegativeTest-2052720250 tempest-VolumesNegativeTest-2052720250-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:17:32.933527 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-f2cab01e-f401-4fe3-b000-e5647d6bb6ab tempest-VolumesNegativeTest-2052720250 tempest-VolumesNegativeTest-2052720250-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:17:32.933992 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.objects.instance [None req-f2cab01e-f401-4fe3-b000-e5647d6bb6ab tempest-VolumesNegativeTest-2052720250 tempest-VolumesNegativeTest-2052720250-project] Lazy-loading 'fault' on Instance uuid 06859498-5e65-4775-99f7-828d79365634 {{(pid=117874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 22 10:17:32.938188 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [None req-8d43aa24-163c-4dfa-9952-763dced923d9 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] 10.222.0.43 "GET /compute/v2.1/servers/9f07e4bb-f4e9-428e-8feb-db50b3ff2109" status: 200 len: 1521 microversion: 2.1 time: 0.170032 Jun 22 10:17:32.938985 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 124/259] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:17:32 2022] GET /compute/v2.1/servers/9f07e4bb-f4e9-428e-8feb-db50b3ff2109 => generated 1521 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:17:32.980416 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.policy [None req-f2cab01e-f401-4fe3-b000-e5647d6bb6ab tempest-VolumesNegativeTest-2052720250 tempest-VolumesNegativeTest-2052720250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b4ef2f1a6dd45ccaea982213e051ee8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b97e48bc75b74b49aec21b8a8b2810d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117874) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:17:32.989864 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [None req-f2cab01e-f401-4fe3-b000-e5647d6bb6ab tempest-VolumesNegativeTest-2052720250 tempest-VolumesNegativeTest-2052720250-project] 10.222.0.43 "GET /compute/v2.1/servers/06859498-5e65-4775-99f7-828d79365634" status: 200 len: 1304 microversion: 2.1 time: 0.108359 Jun 22 10:17:32.990438 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 136/260] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:17:32 2022] GET /compute/v2.1/servers/06859498-5e65-4775-99f7-828d79365634 => generated 1304 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 10:17:33.956502 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-8eb77d32-0d35-4ade-86ad-172cbba81219 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Calling method '>' {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:17:33.957133 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.compute.api [None req-8eb77d32-0d35-4ade-86ad-172cbba81219 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] [instance: 9f07e4bb-f4e9-428e-8feb-db50b3ff2109] Fetching instance by UUID {{(pid=117873) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:17:33.963183 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-8eb77d32-0d35-4ade-86ad-172cbba81219 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:17:33.963609 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-8eb77d32-0d35-4ade-86ad-172cbba81219 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:17:33.964358 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-8eb77d32-0d35-4ade-86ad-172cbba81219 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:17:33.964788 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-8eb77d32-0d35-4ade-86ad-172cbba81219 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:17:34.007599 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-04e45f0c-96ce-4136-b6d1-ce90abae48ce tempest-VolumesNegativeTest-2052720250 tempest-VolumesNegativeTest-2052720250-project] Calling method '>' {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:17:34.008302 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.compute.api [None req-04e45f0c-96ce-4136-b6d1-ce90abae48ce tempest-VolumesNegativeTest-2052720250 tempest-VolumesNegativeTest-2052720250-project] [instance: 06859498-5e65-4775-99f7-828d79365634] Fetching instance by UUID {{(pid=117874) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:17:34.014494 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-04e45f0c-96ce-4136-b6d1-ce90abae48ce tempest-VolumesNegativeTest-2052720250 tempest-VolumesNegativeTest-2052720250-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:17:34.015047 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-04e45f0c-96ce-4136-b6d1-ce90abae48ce tempest-VolumesNegativeTest-2052720250 tempest-VolumesNegativeTest-2052720250-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:17:34.015869 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-04e45f0c-96ce-4136-b6d1-ce90abae48ce tempest-VolumesNegativeTest-2052720250 tempest-VolumesNegativeTest-2052720250-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:17:34.016502 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-04e45f0c-96ce-4136-b6d1-ce90abae48ce tempest-VolumesNegativeTest-2052720250 tempest-VolumesNegativeTest-2052720250-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:17:34.030489 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.wsgi [None req-04e45f0c-96ce-4136-b6d1-ce90abae48ce tempest-VolumesNegativeTest-2052720250 tempest-VolumesNegativeTest-2052720250-project] HTTP exception thrown: Instance 06859498-5e65-4775-99f7-828d79365634 could not be found. Jun 22 10:17:34.032267 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-04e45f0c-96ce-4136-b6d1-ce90abae48ce tempest-VolumesNegativeTest-2052720250 tempest-VolumesNegativeTest-2052720250-project] Request method failure captured: Jun 22 10:17:34.032267 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: request: GET /compute/v2.1/servers/06859498-5e65-4775-99f7-828d79365634 HTTP/1.1 Jun 22 10:17:34.032267 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: Accept: application/json Jun 22 10:17:34.032267 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: Accept-Encoding: identity Jun 22 10:17:34.032267 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: Connection: close Jun 22 10:17:34.032267 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: Content-Length: 0 Jun 22 10:17:34.032267 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: Content-Type: application/json Jun 22 10:17:34.032267 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: Host: 10.222.0.43 Jun 22 10:17:34.032267 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: Openstack-System-Scope: None Jun 22 10:17:34.032267 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: User-Agent: python-urllib3/1.26.9 Jun 22 10:17:34.032267 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-Auth-Token: gAAAAABisuwbx2sqkg4paekgBA4wssjRAMK4GjfBZsd56rCyq9rlxIIyfUHYYiuqffFHGsge5O2yOdKbpoXNRRrGtR9N-cKZd05QoC4vAJut5vNj-k5NT5XABFhbM7otZhuFJcEbt2nZt34_7K7eaTnXkkDDawD2h40AfwOpvmgO_-UmalO4t-g Jun 22 10:17:34.032267 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-Domain-Id: None Jun 22 10:17:34.032267 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-Domain-Name: None Jun 22 10:17:34.032267 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-Identity-Status: Confirmed Jun 22 10:17:34.032267 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-Is-Admin-Project: True Jun 22 10:17:34.032267 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-Project-Domain-Id: default Jun 22 10:17:34.032267 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-Project-Domain-Name: Default Jun 22 10:17:34.032267 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-Project-Id: b97e48bc75b74b49aec21b8a8b2810d5 Jun 22 10:17:34.032267 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-Project-Name: tempest-VolumesNegativeTest-2052720250 Jun 22 10:17:34.032267 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-Role: reader,member Jun 22 10:17:34.032267 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-Roles: reader,member Jun 22 10:17:34.034084 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/b97e48bc75b74b49aec21b8a8b2810d5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/b97e48bc75b74b49aec21b8a8b2810d5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_b97e48bc75b74b49aec21b8a8b2810d5", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/b97e48bc75b74b49aec21b8a8b2810d5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}] Jun 22 10:17:34.034084 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-Tenant: tempest-VolumesNegativeTest-2052720250 Jun 22 10:17:34.034084 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-Tenant-Id: b97e48bc75b74b49aec21b8a8b2810d5 Jun 22 10:17:34.034084 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-Tenant-Name: tempest-VolumesNegativeTest-2052720250 Jun 22 10:17:34.034084 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-User: tempest-VolumesNegativeTest-2052720250-project Jun 22 10:17:34.034084 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-User-Domain-Id: default Jun 22 10:17:34.034084 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-User-Domain-Name: Default Jun 22 10:17:34.034084 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-User-Id: 7b4ef2f1a6dd45ccaea982213e051ee8 Jun 22 10:17:34.034084 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-User-Name: tempest-VolumesNegativeTest-2052720250-project Jun 22 10:17:34.034084 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: method: > Jun 22 10:17:34.034084 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: exception: Instance 06859498-5e65-4775-99f7-828d79365634 could not be found. Jun 22 10:17:34.034084 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: action_args: {'id': '06859498-5e65-4775-99f7-828d79365634'} Jun 22 10:17:34.034912 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 10:17:34.034912 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:17:34.034912 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 22 10:17:34.034912 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 22 10:17:34.034912 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 22 10:17:34.034912 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 22 10:17:34.034912 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 22 10:17:34.034912 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 22 10:17:34.034912 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 22 10:17:34.034912 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 22 10:17:34.034912 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 06859498-5e65-4775-99f7-828d79365634 could not be found. Jun 22 10:17:34.034912 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi Jun 22 10:17:34.034912 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 10:17:34.034912 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi Jun 22 10:17:34.034912 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:17:34.034912 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 10:17:34.034912 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 10:17:34.034912 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 10:17:34.034912 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 10:17:34.034912 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 10:17:34.036274 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 10:17:34.036274 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 22 10:17:34.036274 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 22 10:17:34.036274 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 22 10:17:34.036274 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 22 10:17:34.036274 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 22 10:17:34.036274 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 22 10:17:34.036274 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 06859498-5e65-4775-99f7-828d79365634 could not be found. Jun 22 10:17:34.036274 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi Jun 22 10:17:34.036274 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 10:17:34.036274 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi Jun 22 10:17:34.036274 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:17:34.036274 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 10:17:34.036274 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 10:17:34.036274 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 10:17:34.036274 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 10:17:34.036274 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 06859498-5e65-4775-99f7-828d79365634 could not be found. Jun 22 10:17:34.036274 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi Jun 22 10:17:34.038153 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-04e45f0c-96ce-4136-b6d1-ce90abae48ce tempest-VolumesNegativeTest-2052720250 tempest-VolumesNegativeTest-2052720250-project] Returning 404 to user: Instance 06859498-5e65-4775-99f7-828d79365634 could not be found. {{(pid=117874) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 10:17:34.039155 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [None req-04e45f0c-96ce-4136-b6d1-ce90abae48ce tempest-VolumesNegativeTest-2052720250 tempest-VolumesNegativeTest-2052720250-project] 10.222.0.43 "GET /compute/v2.1/servers/06859498-5e65-4775-99f7-828d79365634" status: 404 len: 111 microversion: 2.1 time: 0.035624 Jun 22 10:17:34.039857 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 137/261] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:17:34 2022] GET /compute/v2.1/servers/06859498-5e65-4775-99f7-828d79365634 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 22 10:17:34.103206 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.policy [None req-8eb77d32-0d35-4ade-86ad-172cbba81219 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d7292401816437fba46d073c4746e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3277b9cbc4b4a8bbacee8440cea1ed2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117873) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:17:34.116208 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [None req-8eb77d32-0d35-4ade-86ad-172cbba81219 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] 10.222.0.43 "GET /compute/v2.1/servers/9f07e4bb-f4e9-428e-8feb-db50b3ff2109" status: 200 len: 1501 microversion: 2.1 time: 0.164566 Jun 22 10:17:34.116827 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 125/262] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:17:33 2022] GET /compute/v2.1/servers/9f07e4bb-f4e9-428e-8feb-db50b3ff2109 => generated 1501 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:17:34.133398 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-80fa60bd-5580-4413-a699-dca5f2e8eb98 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Calling method '>' {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:17:34.134270 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.compute.api [None req-80fa60bd-5580-4413-a699-dca5f2e8eb98 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] [instance: a8d495ae-295a-4ffa-a2d9-5774249e687d] Fetching instance by UUID {{(pid=117874) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:17:34.141535 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-80fa60bd-5580-4413-a699-dca5f2e8eb98 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:17:34.142407 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-80fa60bd-5580-4413-a699-dca5f2e8eb98 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:17:34.143791 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-80fa60bd-5580-4413-a699-dca5f2e8eb98 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:17:34.144429 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-80fa60bd-5580-4413-a699-dca5f2e8eb98 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:17:34.294611 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.policy [None req-80fa60bd-5580-4413-a699-dca5f2e8eb98 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d7292401816437fba46d073c4746e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3277b9cbc4b4a8bbacee8440cea1ed2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117874) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:17:34.304217 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [None req-80fa60bd-5580-4413-a699-dca5f2e8eb98 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] 10.222.0.43 "GET /compute/v2.1/servers/a8d495ae-295a-4ffa-a2d9-5774249e687d" status: 200 len: 1517 microversion: 2.1 time: 0.175057 Jun 22 10:17:34.304797 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 138/263] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:17:34 2022] GET /compute/v2.1/servers/a8d495ae-295a-4ffa-a2d9-5774249e687d => generated 1517 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 10:17:35.743146 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-257e17cc-7b3f-48b3-9e11-a09543b02a69 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:17:35.745332 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.compute.api [None req-257e17cc-7b3f-48b3-9e11-a09543b02a69 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] [instance: a8d495ae-295a-4ffa-a2d9-5774249e687d] Fetching instance by UUID {{(pid=117873) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:17:35.751828 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-257e17cc-7b3f-48b3-9e11-a09543b02a69 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:17:35.752979 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-257e17cc-7b3f-48b3-9e11-a09543b02a69 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:17:35.753766 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-257e17cc-7b3f-48b3-9e11-a09543b02a69 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:17:35.754389 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-257e17cc-7b3f-48b3-9e11-a09543b02a69 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:17:35.785719 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.objects.instance [None req-257e17cc-7b3f-48b3-9e11-a09543b02a69 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lazy-loading 'flavor' on Instance uuid a8d495ae-295a-4ffa-a2d9-5774249e687d {{(pid=117873) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 22 10:17:35.849290 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG dbcounter [-] [117873] Writing DB stats nova_cell1:SELECT=100 {{(pid=117873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:17:35.918835 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [None req-257e17cc-7b3f-48b3-9e11-a09543b02a69 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] 10.222.0.43 "POST /compute/v2.1/servers/a8d495ae-295a-4ffa-a2d9-5774249e687d/action" status: 200 len: 32 microversion: 2.1 time: 0.181097 Jun 22 10:17:35.919879 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 126/264] 10.222.0.43 () {60 vars in 1277 bytes} [Wed Jun 22 10:17:35 2022] POST /compute/v2.1/servers/a8d495ae-295a-4ffa-a2d9-5774249e687d/action => generated 32 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jun 22 10:17:35.929725 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-1c2f46d6-07a4-4b03-ada0-073666adf811 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Calling method '>' {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:17:35.930389 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.compute.api [None req-1c2f46d6-07a4-4b03-ada0-073666adf811 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] [instance: a8d495ae-295a-4ffa-a2d9-5774249e687d] Fetching instance by UUID {{(pid=117874) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:17:35.938705 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-1c2f46d6-07a4-4b03-ada0-073666adf811 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:17:35.939127 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-1c2f46d6-07a4-4b03-ada0-073666adf811 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:17:35.941052 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-1c2f46d6-07a4-4b03-ada0-073666adf811 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:17:35.942292 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-1c2f46d6-07a4-4b03-ada0-073666adf811 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:17:35.971315 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG dbcounter [-] [117874] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:17:36.108053 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.policy [None req-1c2f46d6-07a4-4b03-ada0-073666adf811 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d7292401816437fba46d073c4746e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3277b9cbc4b4a8bbacee8440cea1ed2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117874) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:17:36.116906 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [None req-1c2f46d6-07a4-4b03-ada0-073666adf811 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] 10.222.0.43 "GET /compute/v2.1/servers/a8d495ae-295a-4ffa-a2d9-5774249e687d" status: 200 len: 1523 microversion: 2.1 time: 0.191193 Jun 22 10:17:36.117495 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 139/265] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:17:35 2022] GET /compute/v2.1/servers/a8d495ae-295a-4ffa-a2d9-5774249e687d => generated 1523 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:17:37.136045 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-2eb3e640-ef51-4c67-8cef-cb8c6b8ab915 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Calling method '>' {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:17:37.136738 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.compute.api [None req-2eb3e640-ef51-4c67-8cef-cb8c6b8ab915 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] [instance: a8d495ae-295a-4ffa-a2d9-5774249e687d] Fetching instance by UUID {{(pid=117873) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:17:37.143711 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-2eb3e640-ef51-4c67-8cef-cb8c6b8ab915 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:17:37.144366 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-2eb3e640-ef51-4c67-8cef-cb8c6b8ab915 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:17:37.145320 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-2eb3e640-ef51-4c67-8cef-cb8c6b8ab915 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:17:37.146040 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-2eb3e640-ef51-4c67-8cef-cb8c6b8ab915 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:17:37.289057 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.policy [None req-2eb3e640-ef51-4c67-8cef-cb8c6b8ab915 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d7292401816437fba46d073c4746e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3277b9cbc4b4a8bbacee8440cea1ed2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117873) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:17:37.297536 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [None req-2eb3e640-ef51-4c67-8cef-cb8c6b8ab915 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] 10.222.0.43 "GET /compute/v2.1/servers/a8d495ae-295a-4ffa-a2d9-5774249e687d" status: 200 len: 1523 microversion: 2.1 time: 0.165502 Jun 22 10:17:37.298358 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 127/266] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:17:37 2022] GET /compute/v2.1/servers/a8d495ae-295a-4ffa-a2d9-5774249e687d => generated 1523 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:17:38.315472 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-91201b61-95dc-43f3-b008-a20e24844de3 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Calling method '>' {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:17:38.316077 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.compute.api [None req-91201b61-95dc-43f3-b008-a20e24844de3 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] [instance: a8d495ae-295a-4ffa-a2d9-5774249e687d] Fetching instance by UUID {{(pid=117874) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:17:38.322278 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-91201b61-95dc-43f3-b008-a20e24844de3 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:17:38.322719 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-91201b61-95dc-43f3-b008-a20e24844de3 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:17:38.323469 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-91201b61-95dc-43f3-b008-a20e24844de3 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:17:38.323894 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-91201b61-95dc-43f3-b008-a20e24844de3 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:17:38.467597 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.policy [None req-91201b61-95dc-43f3-b008-a20e24844de3 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d7292401816437fba46d073c4746e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3277b9cbc4b4a8bbacee8440cea1ed2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117874) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:17:38.476605 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [None req-91201b61-95dc-43f3-b008-a20e24844de3 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] 10.222.0.43 "GET /compute/v2.1/servers/a8d495ae-295a-4ffa-a2d9-5774249e687d" status: 200 len: 1523 microversion: 2.1 time: 0.165194 Jun 22 10:17:38.477111 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 140/267] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:17:38 2022] GET /compute/v2.1/servers/a8d495ae-295a-4ffa-a2d9-5774249e687d => generated 1523 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:17:39.494010 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-fcd2f35b-737e-46ae-a98d-5da19689d00a tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Calling method '>' {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:17:39.494617 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.compute.api [None req-fcd2f35b-737e-46ae-a98d-5da19689d00a tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] [instance: a8d495ae-295a-4ffa-a2d9-5774249e687d] Fetching instance by UUID {{(pid=117873) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:17:39.503563 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-fcd2f35b-737e-46ae-a98d-5da19689d00a tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:17:39.504285 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-fcd2f35b-737e-46ae-a98d-5da19689d00a tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:17:39.505484 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-fcd2f35b-737e-46ae-a98d-5da19689d00a tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:17:39.506273 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-fcd2f35b-737e-46ae-a98d-5da19689d00a tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:17:39.658442 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.policy [None req-fcd2f35b-737e-46ae-a98d-5da19689d00a tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d7292401816437fba46d073c4746e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3277b9cbc4b4a8bbacee8440cea1ed2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117873) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:17:39.666774 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [None req-fcd2f35b-737e-46ae-a98d-5da19689d00a tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] 10.222.0.43 "GET /compute/v2.1/servers/a8d495ae-295a-4ffa-a2d9-5774249e687d" status: 200 len: 1523 microversion: 2.1 time: 0.176620 Jun 22 10:17:39.676512 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 128/268] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:17:39 2022] GET /compute/v2.1/servers/a8d495ae-295a-4ffa-a2d9-5774249e687d => generated 1523 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:17:40.687605 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-c0c4920c-49f6-4b10-b66a-d1b6f652fa93 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Calling method '>' {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:17:40.688231 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.compute.api [None req-c0c4920c-49f6-4b10-b66a-d1b6f652fa93 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] [instance: a8d495ae-295a-4ffa-a2d9-5774249e687d] Fetching instance by UUID {{(pid=117874) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:17:40.698995 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-c0c4920c-49f6-4b10-b66a-d1b6f652fa93 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:17:40.699712 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-c0c4920c-49f6-4b10-b66a-d1b6f652fa93 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:17:40.700490 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-c0c4920c-49f6-4b10-b66a-d1b6f652fa93 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:17:40.700928 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-c0c4920c-49f6-4b10-b66a-d1b6f652fa93 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:17:40.875811 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.policy [None req-c0c4920c-49f6-4b10-b66a-d1b6f652fa93 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d7292401816437fba46d073c4746e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3277b9cbc4b4a8bbacee8440cea1ed2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117874) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:17:40.886069 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [None req-c0c4920c-49f6-4b10-b66a-d1b6f652fa93 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] 10.222.0.43 "GET /compute/v2.1/servers/a8d495ae-295a-4ffa-a2d9-5774249e687d" status: 200 len: 1523 microversion: 2.1 time: 0.205224 Jun 22 10:17:40.886855 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 141/269] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:17:40 2022] GET /compute/v2.1/servers/a8d495ae-295a-4ffa-a2d9-5774249e687d => generated 1523 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:17:41.907770 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-d4be5efa-9b48-47a2-bf0a-a8cb73ab7da3 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Calling method '>' {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:17:41.908415 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.compute.api [None req-d4be5efa-9b48-47a2-bf0a-a8cb73ab7da3 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] [instance: a8d495ae-295a-4ffa-a2d9-5774249e687d] Fetching instance by UUID {{(pid=117873) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:17:41.914429 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-d4be5efa-9b48-47a2-bf0a-a8cb73ab7da3 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:17:41.914813 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-d4be5efa-9b48-47a2-bf0a-a8cb73ab7da3 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:17:41.915550 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-d4be5efa-9b48-47a2-bf0a-a8cb73ab7da3 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:17:41.916141 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-d4be5efa-9b48-47a2-bf0a-a8cb73ab7da3 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:17:42.059276 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.policy [None req-d4be5efa-9b48-47a2-bf0a-a8cb73ab7da3 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d7292401816437fba46d073c4746e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3277b9cbc4b4a8bbacee8440cea1ed2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117873) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:17:42.069874 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [None req-d4be5efa-9b48-47a2-bf0a-a8cb73ab7da3 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] 10.222.0.43 "GET /compute/v2.1/servers/a8d495ae-295a-4ffa-a2d9-5774249e687d" status: 200 len: 1523 microversion: 2.1 time: 0.163145 Jun 22 10:17:42.069874 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 129/270] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:17:41 2022] GET /compute/v2.1/servers/a8d495ae-295a-4ffa-a2d9-5774249e687d => generated 1523 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:17:42.209501 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-bb995b42-b790-4172-8233-0b5267ec39ee tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Calling method '>' {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:17:42.210145 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.compute.api [None req-bb995b42-b790-4172-8233-0b5267ec39ee tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] [instance: 5828c9dc-3439-4da7-a94c-f81cbbfdcb99] Fetching instance by UUID {{(pid=117874) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:17:42.219969 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-bb995b42-b790-4172-8233-0b5267ec39ee tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:17:42.221028 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-bb995b42-b790-4172-8233-0b5267ec39ee tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:17:42.222197 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-bb995b42-b790-4172-8233-0b5267ec39ee tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:17:42.223265 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-bb995b42-b790-4172-8233-0b5267ec39ee tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:17:42.252264 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [None req-bb995b42-b790-4172-8233-0b5267ec39ee tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] 10.222.0.43 "GET /compute/v2.1/servers/5828c9dc-3439-4da7-a94c-f81cbbfdcb99/ips" status: 200 len: 149 microversion: 2.1 time: 0.047225 Jun 22 10:17:42.253293 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 142/271] 10.222.0.43 () {58 vars in 1247 bytes} [Wed Jun 22 10:17:42 2022] GET /compute/v2.1/servers/5828c9dc-3439-4da7-a94c-f81cbbfdcb99/ips => generated 149 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 10:17:43.084133 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-8fa2f74b-225e-42dc-9072-0049cf29da87 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Calling method '>' {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:17:43.084743 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.compute.api [None req-8fa2f74b-225e-42dc-9072-0049cf29da87 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] [instance: a8d495ae-295a-4ffa-a2d9-5774249e687d] Fetching instance by UUID {{(pid=117873) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:17:43.090868 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-8fa2f74b-225e-42dc-9072-0049cf29da87 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:17:43.091317 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-8fa2f74b-225e-42dc-9072-0049cf29da87 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:17:43.092080 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-8fa2f74b-225e-42dc-9072-0049cf29da87 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:17:43.092683 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-8fa2f74b-225e-42dc-9072-0049cf29da87 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:17:43.241892 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.policy [None req-8fa2f74b-225e-42dc-9072-0049cf29da87 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d7292401816437fba46d073c4746e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3277b9cbc4b4a8bbacee8440cea1ed2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117873) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:17:43.250680 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [None req-8fa2f74b-225e-42dc-9072-0049cf29da87 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] 10.222.0.43 "GET /compute/v2.1/servers/a8d495ae-295a-4ffa-a2d9-5774249e687d" status: 200 len: 1523 microversion: 2.1 time: 0.170717 Jun 22 10:17:43.251330 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 130/272] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:17:43 2022] GET /compute/v2.1/servers/a8d495ae-295a-4ffa-a2d9-5774249e687d => generated 1523 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:17:44.273118 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-52a22d17-31fd-4e8c-a885-b555ee692dfe tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Calling method '>' {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:17:44.274280 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.compute.api [None req-52a22d17-31fd-4e8c-a885-b555ee692dfe tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] [instance: a8d495ae-295a-4ffa-a2d9-5774249e687d] Fetching instance by UUID {{(pid=117874) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:17:44.278381 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG dbcounter [-] [117874] Writing DB stats nova_api:SELECT=63,nova_api:UPDATE=1 {{(pid=117874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:17:44.288859 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-52a22d17-31fd-4e8c-a885-b555ee692dfe tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:17:44.289556 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-52a22d17-31fd-4e8c-a885-b555ee692dfe tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:17:44.290855 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-52a22d17-31fd-4e8c-a885-b555ee692dfe tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:17:44.291538 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-52a22d17-31fd-4e8c-a885-b555ee692dfe tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:17:44.445289 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.policy [None req-52a22d17-31fd-4e8c-a885-b555ee692dfe tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d7292401816437fba46d073c4746e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3277b9cbc4b4a8bbacee8440cea1ed2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117874) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:17:44.455747 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [None req-52a22d17-31fd-4e8c-a885-b555ee692dfe tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] 10.222.0.43 "GET /compute/v2.1/servers/a8d495ae-295a-4ffa-a2d9-5774249e687d" status: 200 len: 1523 microversion: 2.1 time: 0.188747 Jun 22 10:17:44.456761 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 143/273] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:17:44 2022] GET /compute/v2.1/servers/a8d495ae-295a-4ffa-a2d9-5774249e687d => generated 1523 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 10:17:45.476087 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-75939dac-f8cb-42f3-9642-9bf261f54a14 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Calling method '>' {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:17:45.476690 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.compute.api [None req-75939dac-f8cb-42f3-9642-9bf261f54a14 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] [instance: a8d495ae-295a-4ffa-a2d9-5774249e687d] Fetching instance by UUID {{(pid=117873) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:17:45.483141 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-75939dac-f8cb-42f3-9642-9bf261f54a14 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:17:45.483575 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-75939dac-f8cb-42f3-9642-9bf261f54a14 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:17:45.484318 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-75939dac-f8cb-42f3-9642-9bf261f54a14 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:17:45.484738 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-75939dac-f8cb-42f3-9642-9bf261f54a14 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:17:45.613744 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-f36b9503-3855-4861-ba8a-28eb39dbc1bf tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Calling method '>' {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:17:45.614207 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.policy [None req-75939dac-f8cb-42f3-9642-9bf261f54a14 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d7292401816437fba46d073c4746e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3277b9cbc4b4a8bbacee8440cea1ed2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117873) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:17:45.614338 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.compute.api [None req-f36b9503-3855-4861-ba8a-28eb39dbc1bf tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] [instance: 73dbd5ab-5688-4de4-9da2-0b89d7cefb11] Fetching instance by UUID {{(pid=117874) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:17:45.620790 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-f36b9503-3855-4861-ba8a-28eb39dbc1bf tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:17:45.621241 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-f36b9503-3855-4861-ba8a-28eb39dbc1bf tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:17:45.621340 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [None req-75939dac-f8cb-42f3-9642-9bf261f54a14 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] 10.222.0.43 "GET /compute/v2.1/servers/a8d495ae-295a-4ffa-a2d9-5774249e687d" status: 200 len: 1523 microversion: 2.1 time: 0.149256 Jun 22 10:17:45.621873 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 131/274] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:17:45 2022] GET /compute/v2.1/servers/a8d495ae-295a-4ffa-a2d9-5774249e687d => generated 1523 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:17:45.622043 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-f36b9503-3855-4861-ba8a-28eb39dbc1bf tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:17:45.622606 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-f36b9503-3855-4861-ba8a-28eb39dbc1bf tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:17:45.645669 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [None req-f36b9503-3855-4861-ba8a-28eb39dbc1bf tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] 10.222.0.43 "GET /compute/v2.1/servers/73dbd5ab-5688-4de4-9da2-0b89d7cefb11/ips" status: 200 len: 152 microversion: 2.20 time: 0.036785 Jun 22 10:17:45.646251 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 144/275] 10.222.0.43 () {60 vars in 1288 bytes} [Wed Jun 22 10:17:45 2022] GET /compute/v2.1/servers/73dbd5ab-5688-4de4-9da2-0b89d7cefb11/ips => generated 152 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 22 10:17:46.637594 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-45aa41d3-53aa-4789-9c30-02a9bf708932 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Calling method '>' {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:17:46.638232 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.compute.api [None req-45aa41d3-53aa-4789-9c30-02a9bf708932 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] [instance: a8d495ae-295a-4ffa-a2d9-5774249e687d] Fetching instance by UUID {{(pid=117873) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:17:46.644726 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-45aa41d3-53aa-4789-9c30-02a9bf708932 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:17:46.645158 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-45aa41d3-53aa-4789-9c30-02a9bf708932 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:17:46.645932 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-45aa41d3-53aa-4789-9c30-02a9bf708932 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:17:46.646407 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-45aa41d3-53aa-4789-9c30-02a9bf708932 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:17:46.777126 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.policy [None req-45aa41d3-53aa-4789-9c30-02a9bf708932 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d7292401816437fba46d073c4746e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3277b9cbc4b4a8bbacee8440cea1ed2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117873) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:17:46.784711 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [None req-45aa41d3-53aa-4789-9c30-02a9bf708932 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] 10.222.0.43 "GET /compute/v2.1/servers/a8d495ae-295a-4ffa-a2d9-5774249e687d" status: 200 len: 1523 microversion: 2.1 time: 0.150918 Jun 22 10:17:46.785284 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 132/276] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:17:46 2022] GET /compute/v2.1/servers/a8d495ae-295a-4ffa-a2d9-5774249e687d => generated 1523 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:17:47.803536 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-dbb51d80-fe3b-464e-91e4-817a31f98ecf tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Calling method '>' {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:17:47.805486 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.compute.api [None req-dbb51d80-fe3b-464e-91e4-817a31f98ecf tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] [instance: a8d495ae-295a-4ffa-a2d9-5774249e687d] Fetching instance by UUID {{(pid=117874) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:17:47.811828 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-dbb51d80-fe3b-464e-91e4-817a31f98ecf tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:17:47.812361 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-dbb51d80-fe3b-464e-91e4-817a31f98ecf tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:17:47.813671 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-dbb51d80-fe3b-464e-91e4-817a31f98ecf tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:17:47.814170 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-dbb51d80-fe3b-464e-91e4-817a31f98ecf tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:17:47.820848 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-da996271-5216-47e4-ad4f-8b58123a53cd tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8e895d50-268e-428c-a673-cadd98bdb03f"}} {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:17:47.821928 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.compute.api [None req-da996271-5216-47e4-ad4f-8b58123a53cd tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] [instance: 5828c9dc-3439-4da7-a94c-f81cbbfdcb99] Fetching instance by UUID {{(pid=117873) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:17:47.827910 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-da996271-5216-47e4-ad4f-8b58123a53cd tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:17:47.828347 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-da996271-5216-47e4-ad4f-8b58123a53cd tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:17:47.829095 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-da996271-5216-47e4-ad4f-8b58123a53cd tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:17:47.829549 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-da996271-5216-47e4-ad4f-8b58123a53cd tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:17:47.958179 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.policy [None req-dbb51d80-fe3b-464e-91e4-817a31f98ecf tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d7292401816437fba46d073c4746e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3277b9cbc4b4a8bbacee8440cea1ed2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117874) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:17:47.967212 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [None req-dbb51d80-fe3b-464e-91e4-817a31f98ecf tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] 10.222.0.43 "GET /compute/v2.1/servers/a8d495ae-295a-4ffa-a2d9-5774249e687d" status: 200 len: 1523 microversion: 2.1 time: 0.169209 Jun 22 10:17:47.976901 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 145/277] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:17:47 2022] GET /compute/v2.1/servers/a8d495ae-295a-4ffa-a2d9-5774249e687d => generated 1523 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:17:48.169056 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [None req-da996271-5216-47e4-ad4f-8b58123a53cd tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] 10.222.0.43 "POST /compute/v2.1/servers/5828c9dc-3439-4da7-a94c-f81cbbfdcb99/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.351961 Jun 22 10:17:48.169719 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 133/278] 10.222.0.43 () {60 vars in 1322 bytes} [Wed Jun 22 10:17:47 2022] POST /compute/v2.1/servers/5828c9dc-3439-4da7-a94c-f81cbbfdcb99/os-volume_attachments => generated 194 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 10:17:48.983693 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-5edceb8c-6418-4625-92b9-5d5f198dfc23 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Calling method '>' {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:17:48.984306 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.compute.api [None req-5edceb8c-6418-4625-92b9-5d5f198dfc23 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] [instance: a8d495ae-295a-4ffa-a2d9-5774249e687d] Fetching instance by UUID {{(pid=117874) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:17:48.992522 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-5edceb8c-6418-4625-92b9-5d5f198dfc23 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:17:48.992979 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-5edceb8c-6418-4625-92b9-5d5f198dfc23 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:17:48.993771 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-5edceb8c-6418-4625-92b9-5d5f198dfc23 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:17:48.994210 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-5edceb8c-6418-4625-92b9-5d5f198dfc23 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:17:49.021468 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-b0c1c00b-bfcd-443c-81c6-626f7298e301 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:17:49.022269 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.compute.api [None req-b0c1c00b-bfcd-443c-81c6-626f7298e301 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] [instance: 73dbd5ab-5688-4de4-9da2-0b89d7cefb11] Fetching instance by UUID {{(pid=117873) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:17:49.029162 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-b0c1c00b-bfcd-443c-81c6-626f7298e301 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:17:49.029951 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-b0c1c00b-bfcd-443c-81c6-626f7298e301 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:17:49.030803 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-b0c1c00b-bfcd-443c-81c6-626f7298e301 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:17:49.031450 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-b0c1c00b-bfcd-443c-81c6-626f7298e301 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:17:49.056892 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.objects.instance [None req-b0c1c00b-bfcd-443c-81c6-626f7298e301 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lazy-loading 'flavor' on Instance uuid 73dbd5ab-5688-4de4-9da2-0b89d7cefb11 {{(pid=117873) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 22 10:17:49.147139 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.policy [None req-5edceb8c-6418-4625-92b9-5d5f198dfc23 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d7292401816437fba46d073c4746e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3277b9cbc4b4a8bbacee8440cea1ed2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117874) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:17:49.154726 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [None req-5edceb8c-6418-4625-92b9-5d5f198dfc23 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] 10.222.0.43 "GET /compute/v2.1/servers/a8d495ae-295a-4ffa-a2d9-5774249e687d" status: 200 len: 1523 microversion: 2.1 time: 0.174878 Jun 22 10:17:49.155278 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 146/279] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:17:48 2022] GET /compute/v2.1/servers/a8d495ae-295a-4ffa-a2d9-5774249e687d => generated 1523 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:17:49.320543 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [None req-b0c1c00b-bfcd-443c-81c6-626f7298e301 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] 10.222.0.43 "POST /compute/v2.1/servers/73dbd5ab-5688-4de4-9da2-0b89d7cefb11/action" status: 202 len: 0 microversion: 2.20 time: 0.303340 Jun 22 10:17:49.321158 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 134/280] 10.222.0.43 () {62 vars in 1318 bytes} [Wed Jun 22 10:17:49 2022] POST /compute/v2.1/servers/73dbd5ab-5688-4de4-9da2-0b89d7cefb11/action => generated 0 bytes in 305 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 22 10:17:49.329138 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-6a631da7-e590-4ada-8bc8-3aa794ccbfe4 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Calling method '>' {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:17:49.331736 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.compute.api [None req-6a631da7-e590-4ada-8bc8-3aa794ccbfe4 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] [instance: 73dbd5ab-5688-4de4-9da2-0b89d7cefb11] Fetching instance by UUID {{(pid=117874) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:17:49.335844 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-6a631da7-e590-4ada-8bc8-3aa794ccbfe4 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:17:49.336287 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-6a631da7-e590-4ada-8bc8-3aa794ccbfe4 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:17:49.337035 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-6a631da7-e590-4ada-8bc8-3aa794ccbfe4 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:17:49.337463 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-6a631da7-e590-4ada-8bc8-3aa794ccbfe4 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:17:49.468777 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.policy [None req-6a631da7-e590-4ada-8bc8-3aa794ccbfe4 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75753b29a78640df9622d4e2655baf9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee9d603d9cc4a8797f55d544f189720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117874) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:17:49.477924 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.policy [None req-6a631da7-e590-4ada-8bc8-3aa794ccbfe4 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75753b29a78640df9622d4e2655baf9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee9d603d9cc4a8797f55d544f189720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117874) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:17:49.479668 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.policy [None req-6a631da7-e590-4ada-8bc8-3aa794ccbfe4 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75753b29a78640df9622d4e2655baf9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee9d603d9cc4a8797f55d544f189720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117874) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:17:49.480807 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [None req-6a631da7-e590-4ada-8bc8-3aa794ccbfe4 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] 10.222.0.43 "GET /compute/v2.1/servers/73dbd5ab-5688-4de4-9da2-0b89d7cefb11" status: 200 len: 1724 microversion: 2.20 time: 0.155461 Jun 22 10:17:49.481363 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 147/281] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jun 22 10:17:49 2022] GET /compute/v2.1/servers/73dbd5ab-5688-4de4-9da2-0b89d7cefb11 => generated 1724 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 10:17:50.173041 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-f5e79e60-22d7-406e-9d87-8742167d1f96 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Calling method '>' {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:17:50.173858 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.compute.api [None req-f5e79e60-22d7-406e-9d87-8742167d1f96 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] [instance: a8d495ae-295a-4ffa-a2d9-5774249e687d] Fetching instance by UUID {{(pid=117873) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:17:50.180512 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-f5e79e60-22d7-406e-9d87-8742167d1f96 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:17:50.180958 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-f5e79e60-22d7-406e-9d87-8742167d1f96 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:17:50.181745 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-f5e79e60-22d7-406e-9d87-8742167d1f96 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:17:50.182182 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-f5e79e60-22d7-406e-9d87-8742167d1f96 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:17:50.310256 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.policy [None req-f5e79e60-22d7-406e-9d87-8742167d1f96 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d7292401816437fba46d073c4746e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3277b9cbc4b4a8bbacee8440cea1ed2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117873) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:17:50.317934 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [None req-f5e79e60-22d7-406e-9d87-8742167d1f96 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] 10.222.0.43 "GET /compute/v2.1/servers/a8d495ae-295a-4ffa-a2d9-5774249e687d" status: 200 len: 1523 microversion: 2.1 time: 0.149361 Jun 22 10:17:50.318519 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 135/282] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:17:50 2022] GET /compute/v2.1/servers/a8d495ae-295a-4ffa-a2d9-5774249e687d => generated 1523 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:17:50.501317 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-7eae19e0-1bf2-42be-ab11-0ccaadb6249e tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Calling method '>' {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:17:50.502607 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.compute.api [None req-7eae19e0-1bf2-42be-ab11-0ccaadb6249e tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] [instance: 73dbd5ab-5688-4de4-9da2-0b89d7cefb11] Fetching instance by UUID {{(pid=117874) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:17:50.509355 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-7eae19e0-1bf2-42be-ab11-0ccaadb6249e tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:17:50.510061 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-7eae19e0-1bf2-42be-ab11-0ccaadb6249e tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:17:50.510821 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-7eae19e0-1bf2-42be-ab11-0ccaadb6249e tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:17:50.511250 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-7eae19e0-1bf2-42be-ab11-0ccaadb6249e tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:17:50.642955 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.policy [None req-7eae19e0-1bf2-42be-ab11-0ccaadb6249e tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75753b29a78640df9622d4e2655baf9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee9d603d9cc4a8797f55d544f189720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117874) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:17:50.651000 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.policy [None req-7eae19e0-1bf2-42be-ab11-0ccaadb6249e tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75753b29a78640df9622d4e2655baf9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee9d603d9cc4a8797f55d544f189720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117874) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:17:50.652506 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.policy [None req-7eae19e0-1bf2-42be-ab11-0ccaadb6249e tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75753b29a78640df9622d4e2655baf9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee9d603d9cc4a8797f55d544f189720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117874) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:17:50.653643 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [None req-7eae19e0-1bf2-42be-ab11-0ccaadb6249e tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] 10.222.0.43 "GET /compute/v2.1/servers/73dbd5ab-5688-4de4-9da2-0b89d7cefb11" status: 200 len: 1724 microversion: 2.20 time: 0.156380 Jun 22 10:17:50.654235 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 148/283] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jun 22 10:17:50 2022] GET /compute/v2.1/servers/73dbd5ab-5688-4de4-9da2-0b89d7cefb11 => generated 1724 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 10:17:51.335326 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-d43d61d6-bb5b-4c42-a46c-251200c31eba tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Calling method '>' {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:17:51.336109 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.compute.api [None req-d43d61d6-bb5b-4c42-a46c-251200c31eba tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] [instance: a8d495ae-295a-4ffa-a2d9-5774249e687d] Fetching instance by UUID {{(pid=117873) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:17:51.342390 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-d43d61d6-bb5b-4c42-a46c-251200c31eba tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:17:51.342839 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-d43d61d6-bb5b-4c42-a46c-251200c31eba tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:17:51.343603 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-d43d61d6-bb5b-4c42-a46c-251200c31eba tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:17:51.344037 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-d43d61d6-bb5b-4c42-a46c-251200c31eba tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:17:51.486655 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.policy [None req-d43d61d6-bb5b-4c42-a46c-251200c31eba tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d7292401816437fba46d073c4746e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3277b9cbc4b4a8bbacee8440cea1ed2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117873) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:17:51.495455 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [None req-d43d61d6-bb5b-4c42-a46c-251200c31eba tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] 10.222.0.43 "GET /compute/v2.1/servers/a8d495ae-295a-4ffa-a2d9-5774249e687d" status: 200 len: 1523 microversion: 2.1 time: 0.165108 Jun 22 10:17:51.496098 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 136/284] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:17:51 2022] GET /compute/v2.1/servers/a8d495ae-295a-4ffa-a2d9-5774249e687d => generated 1523 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:17:51.672270 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-3ec0c32f-2789-422e-99cd-db1b37b14fc1 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Calling method '>' {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:17:51.672906 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.compute.api [None req-3ec0c32f-2789-422e-99cd-db1b37b14fc1 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] [instance: 73dbd5ab-5688-4de4-9da2-0b89d7cefb11] Fetching instance by UUID {{(pid=117874) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:17:51.679911 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-3ec0c32f-2789-422e-99cd-db1b37b14fc1 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:17:51.680357 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-3ec0c32f-2789-422e-99cd-db1b37b14fc1 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:17:51.681128 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-3ec0c32f-2789-422e-99cd-db1b37b14fc1 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:17:51.681573 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-3ec0c32f-2789-422e-99cd-db1b37b14fc1 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:17:51.812488 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.policy [None req-3ec0c32f-2789-422e-99cd-db1b37b14fc1 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75753b29a78640df9622d4e2655baf9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee9d603d9cc4a8797f55d544f189720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117874) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:17:51.821532 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.policy [None req-3ec0c32f-2789-422e-99cd-db1b37b14fc1 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75753b29a78640df9622d4e2655baf9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee9d603d9cc4a8797f55d544f189720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117874) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:17:51.823059 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.policy [None req-3ec0c32f-2789-422e-99cd-db1b37b14fc1 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75753b29a78640df9622d4e2655baf9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee9d603d9cc4a8797f55d544f189720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117874) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:17:51.824220 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [None req-3ec0c32f-2789-422e-99cd-db1b37b14fc1 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] 10.222.0.43 "GET /compute/v2.1/servers/73dbd5ab-5688-4de4-9da2-0b89d7cefb11" status: 200 len: 1724 microversion: 2.20 time: 0.155959 Jun 22 10:17:51.824767 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 149/285] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jun 22 10:17:51 2022] GET /compute/v2.1/servers/73dbd5ab-5688-4de4-9da2-0b89d7cefb11 => generated 1724 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 22 10:17:52.513559 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-df7015d3-1c6e-4f20-bf9f-38be03991aec tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Calling method '>' {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:17:52.516057 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.compute.api [None req-df7015d3-1c6e-4f20-bf9f-38be03991aec tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] [instance: a8d495ae-295a-4ffa-a2d9-5774249e687d] Fetching instance by UUID {{(pid=117873) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:17:52.523953 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG dbcounter [-] [117873] Writing DB stats nova_api:SELECT=46 {{(pid=117873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:17:52.530120 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-df7015d3-1c6e-4f20-bf9f-38be03991aec tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:17:52.531211 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-df7015d3-1c6e-4f20-bf9f-38be03991aec tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:17:52.533583 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-df7015d3-1c6e-4f20-bf9f-38be03991aec tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:17:52.534814 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-df7015d3-1c6e-4f20-bf9f-38be03991aec tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:17:52.683178 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.policy [None req-df7015d3-1c6e-4f20-bf9f-38be03991aec tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d7292401816437fba46d073c4746e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3277b9cbc4b4a8bbacee8440cea1ed2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117873) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:17:52.693913 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [None req-df7015d3-1c6e-4f20-bf9f-38be03991aec tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] 10.222.0.43 "GET /compute/v2.1/servers/a8d495ae-295a-4ffa-a2d9-5774249e687d" status: 200 len: 1523 microversion: 2.1 time: 0.182390 Jun 22 10:17:52.694505 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 137/286] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:17:52 2022] GET /compute/v2.1/servers/a8d495ae-295a-4ffa-a2d9-5774249e687d => generated 1523 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:17:52.844319 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-227b9a73-598a-49ad-b416-b4cc8960deaf tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Calling method '>' {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:17:52.844919 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.compute.api [None req-227b9a73-598a-49ad-b416-b4cc8960deaf tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] [instance: 73dbd5ab-5688-4de4-9da2-0b89d7cefb11] Fetching instance by UUID {{(pid=117874) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:17:52.851936 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-227b9a73-598a-49ad-b416-b4cc8960deaf tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:17:52.852437 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-227b9a73-598a-49ad-b416-b4cc8960deaf tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:17:52.853195 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-227b9a73-598a-49ad-b416-b4cc8960deaf tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:17:52.853626 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-227b9a73-598a-49ad-b416-b4cc8960deaf tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:17:53.010193 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.policy [None req-227b9a73-598a-49ad-b416-b4cc8960deaf tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75753b29a78640df9622d4e2655baf9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee9d603d9cc4a8797f55d544f189720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117874) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:17:53.018823 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.policy [None req-227b9a73-598a-49ad-b416-b4cc8960deaf tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75753b29a78640df9622d4e2655baf9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee9d603d9cc4a8797f55d544f189720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117874) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:17:53.020309 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.policy [None req-227b9a73-598a-49ad-b416-b4cc8960deaf tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75753b29a78640df9622d4e2655baf9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee9d603d9cc4a8797f55d544f189720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117874) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:17:53.021452 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [None req-227b9a73-598a-49ad-b416-b4cc8960deaf tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] 10.222.0.43 "GET /compute/v2.1/servers/73dbd5ab-5688-4de4-9da2-0b89d7cefb11" status: 200 len: 1724 microversion: 2.20 time: 0.181023 Jun 22 10:17:53.022033 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 150/287] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jun 22 10:17:52 2022] GET /compute/v2.1/servers/73dbd5ab-5688-4de4-9da2-0b89d7cefb11 => generated 1724 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 22 10:17:53.710932 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-7599336e-ddb0-4054-aab8-1190321cfe03 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Calling method '>' {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:17:53.711442 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.compute.api [None req-7599336e-ddb0-4054-aab8-1190321cfe03 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] [instance: a8d495ae-295a-4ffa-a2d9-5774249e687d] Fetching instance by UUID {{(pid=117873) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:17:53.717914 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-7599336e-ddb0-4054-aab8-1190321cfe03 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:17:53.718355 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-7599336e-ddb0-4054-aab8-1190321cfe03 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:17:53.719094 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-7599336e-ddb0-4054-aab8-1190321cfe03 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:17:53.719520 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-7599336e-ddb0-4054-aab8-1190321cfe03 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:17:53.997103 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.policy [None req-7599336e-ddb0-4054-aab8-1190321cfe03 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d7292401816437fba46d073c4746e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3277b9cbc4b4a8bbacee8440cea1ed2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117873) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:17:53.999303 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG dbcounter [-] [117873] Writing DB stats nova_cell1:UPDATE=6,nova_cell1:SELECT=91,nova_cell1:INSERT=3 {{(pid=117873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:17:54.006343 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [None req-7599336e-ddb0-4054-aab8-1190321cfe03 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] 10.222.0.43 "GET /compute/v2.1/servers/a8d495ae-295a-4ffa-a2d9-5774249e687d" status: 200 len: 1523 microversion: 2.1 time: 0.299241 Jun 22 10:17:54.006911 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 138/288] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:17:53 2022] GET /compute/v2.1/servers/a8d495ae-295a-4ffa-a2d9-5774249e687d => generated 1523 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:17:54.039826 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-5df7b2e0-906e-441d-ba8f-cc7a15fc3c5b tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Calling method '>' {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:17:54.040422 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.compute.api [None req-5df7b2e0-906e-441d-ba8f-cc7a15fc3c5b tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] [instance: 73dbd5ab-5688-4de4-9da2-0b89d7cefb11] Fetching instance by UUID {{(pid=117874) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:17:54.046836 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-5df7b2e0-906e-441d-ba8f-cc7a15fc3c5b tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:17:54.047279 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-5df7b2e0-906e-441d-ba8f-cc7a15fc3c5b tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:17:54.048025 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-5df7b2e0-906e-441d-ba8f-cc7a15fc3c5b tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:17:54.048481 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-5df7b2e0-906e-441d-ba8f-cc7a15fc3c5b tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:17:54.175381 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.policy [None req-5df7b2e0-906e-441d-ba8f-cc7a15fc3c5b tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75753b29a78640df9622d4e2655baf9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee9d603d9cc4a8797f55d544f189720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117874) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:17:54.183273 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.policy [None req-5df7b2e0-906e-441d-ba8f-cc7a15fc3c5b tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75753b29a78640df9622d4e2655baf9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee9d603d9cc4a8797f55d544f189720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117874) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:17:54.184758 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.policy [None req-5df7b2e0-906e-441d-ba8f-cc7a15fc3c5b tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75753b29a78640df9622d4e2655baf9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee9d603d9cc4a8797f55d544f189720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117874) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:17:54.185926 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [None req-5df7b2e0-906e-441d-ba8f-cc7a15fc3c5b tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] 10.222.0.43 "GET /compute/v2.1/servers/73dbd5ab-5688-4de4-9da2-0b89d7cefb11" status: 200 len: 1724 microversion: 2.20 time: 0.149893 Jun 22 10:17:54.186484 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 151/289] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jun 22 10:17:54 2022] GET /compute/v2.1/servers/73dbd5ab-5688-4de4-9da2-0b89d7cefb11 => generated 1724 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 10:17:55.022359 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-357bdbc5-e76c-4ae4-8f69-78a4d6442752 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Calling method '>' {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:17:55.022961 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.compute.api [None req-357bdbc5-e76c-4ae4-8f69-78a4d6442752 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] [instance: a8d495ae-295a-4ffa-a2d9-5774249e687d] Fetching instance by UUID {{(pid=117873) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:17:55.030412 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-357bdbc5-e76c-4ae4-8f69-78a4d6442752 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:17:55.030855 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-357bdbc5-e76c-4ae4-8f69-78a4d6442752 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:17:55.031611 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-357bdbc5-e76c-4ae4-8f69-78a4d6442752 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:17:55.032035 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-357bdbc5-e76c-4ae4-8f69-78a4d6442752 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:17:55.165212 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.policy [None req-357bdbc5-e76c-4ae4-8f69-78a4d6442752 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d7292401816437fba46d073c4746e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3277b9cbc4b4a8bbacee8440cea1ed2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117873) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:17:55.172678 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [None req-357bdbc5-e76c-4ae4-8f69-78a4d6442752 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] 10.222.0.43 "GET /compute/v2.1/servers/a8d495ae-295a-4ffa-a2d9-5774249e687d" status: 200 len: 1523 microversion: 2.1 time: 0.154105 Jun 22 10:17:55.173240 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 139/290] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:17:55 2022] GET /compute/v2.1/servers/a8d495ae-295a-4ffa-a2d9-5774249e687d => generated 1523 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:17:55.204217 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-4df37268-2328-4be4-8183-b2bc891020db tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Calling method '>' {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:17:55.205896 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.compute.api [None req-4df37268-2328-4be4-8183-b2bc891020db tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] [instance: 73dbd5ab-5688-4de4-9da2-0b89d7cefb11] Fetching instance by UUID {{(pid=117874) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:17:55.212765 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-4df37268-2328-4be4-8183-b2bc891020db tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:17:55.213212 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-4df37268-2328-4be4-8183-b2bc891020db tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:17:55.213999 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-4df37268-2328-4be4-8183-b2bc891020db tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:17:55.214433 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-4df37268-2328-4be4-8183-b2bc891020db tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:17:55.339869 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.policy [None req-4df37268-2328-4be4-8183-b2bc891020db tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75753b29a78640df9622d4e2655baf9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee9d603d9cc4a8797f55d544f189720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117874) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:17:55.348287 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.policy [None req-4df37268-2328-4be4-8183-b2bc891020db tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75753b29a78640df9622d4e2655baf9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee9d603d9cc4a8797f55d544f189720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117874) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:17:55.349831 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.policy [None req-4df37268-2328-4be4-8183-b2bc891020db tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75753b29a78640df9622d4e2655baf9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee9d603d9cc4a8797f55d544f189720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117874) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:17:55.350981 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [None req-4df37268-2328-4be4-8183-b2bc891020db tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] 10.222.0.43 "GET /compute/v2.1/servers/73dbd5ab-5688-4de4-9da2-0b89d7cefb11" status: 200 len: 1724 microversion: 2.20 time: 0.150631 Jun 22 10:17:55.351539 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 152/291] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jun 22 10:17:55 2022] GET /compute/v2.1/servers/73dbd5ab-5688-4de4-9da2-0b89d7cefb11 => generated 1724 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 10:17:56.190463 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-74011030-bb50-42ec-9c18-64a208d05fd6 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Calling method '>' {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:17:56.191816 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.compute.api [None req-74011030-bb50-42ec-9c18-64a208d05fd6 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] [instance: a8d495ae-295a-4ffa-a2d9-5774249e687d] Fetching instance by UUID {{(pid=117873) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:17:56.198347 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-74011030-bb50-42ec-9c18-64a208d05fd6 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:17:56.198794 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-74011030-bb50-42ec-9c18-64a208d05fd6 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:17:56.199562 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-74011030-bb50-42ec-9c18-64a208d05fd6 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:17:56.199997 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-74011030-bb50-42ec-9c18-64a208d05fd6 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:17:56.347159 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.policy [None req-74011030-bb50-42ec-9c18-64a208d05fd6 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d7292401816437fba46d073c4746e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3277b9cbc4b4a8bbacee8440cea1ed2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117873) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:17:56.362447 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [None req-74011030-bb50-42ec-9c18-64a208d05fd6 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] 10.222.0.43 "GET /compute/v2.1/servers/a8d495ae-295a-4ffa-a2d9-5774249e687d" status: 200 len: 1523 microversion: 2.1 time: 0.176172 Jun 22 10:17:56.363125 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 140/292] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:17:56 2022] GET /compute/v2.1/servers/a8d495ae-295a-4ffa-a2d9-5774249e687d => generated 1523 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:17:56.370083 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-3c23307c-752f-408b-90a8-61e3c519b216 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Calling method '>' {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:17:56.370676 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.compute.api [None req-3c23307c-752f-408b-90a8-61e3c519b216 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] [instance: 73dbd5ab-5688-4de4-9da2-0b89d7cefb11] Fetching instance by UUID {{(pid=117874) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:17:56.379775 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-3c23307c-752f-408b-90a8-61e3c519b216 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:17:56.380358 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-3c23307c-752f-408b-90a8-61e3c519b216 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:17:56.381598 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-3c23307c-752f-408b-90a8-61e3c519b216 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:17:56.382115 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-3c23307c-752f-408b-90a8-61e3c519b216 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:17:56.525823 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.policy [None req-3c23307c-752f-408b-90a8-61e3c519b216 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75753b29a78640df9622d4e2655baf9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee9d603d9cc4a8797f55d544f189720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117874) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:17:56.533840 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.policy [None req-3c23307c-752f-408b-90a8-61e3c519b216 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75753b29a78640df9622d4e2655baf9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee9d603d9cc4a8797f55d544f189720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117874) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:17:56.535346 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.policy [None req-3c23307c-752f-408b-90a8-61e3c519b216 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75753b29a78640df9622d4e2655baf9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee9d603d9cc4a8797f55d544f189720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117874) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:17:56.536502 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [None req-3c23307c-752f-408b-90a8-61e3c519b216 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] 10.222.0.43 "GET /compute/v2.1/servers/73dbd5ab-5688-4de4-9da2-0b89d7cefb11" status: 200 len: 1724 microversion: 2.20 time: 0.170335 Jun 22 10:17:56.537055 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 153/293] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jun 22 10:17:56 2022] GET /compute/v2.1/servers/73dbd5ab-5688-4de4-9da2-0b89d7cefb11 => generated 1724 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 10:17:57.381456 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-de77d888-d0a9-41be-b792-a6d32ac4f6f5 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Calling method '>' {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:17:57.382695 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.compute.api [None req-de77d888-d0a9-41be-b792-a6d32ac4f6f5 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] [instance: a8d495ae-295a-4ffa-a2d9-5774249e687d] Fetching instance by UUID {{(pid=117873) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:17:57.390093 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-de77d888-d0a9-41be-b792-a6d32ac4f6f5 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:17:57.390532 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-de77d888-d0a9-41be-b792-a6d32ac4f6f5 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:17:57.391302 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-de77d888-d0a9-41be-b792-a6d32ac4f6f5 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:17:57.391731 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-de77d888-d0a9-41be-b792-a6d32ac4f6f5 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:17:57.543614 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.policy [None req-de77d888-d0a9-41be-b792-a6d32ac4f6f5 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d7292401816437fba46d073c4746e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3277b9cbc4b4a8bbacee8440cea1ed2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117873) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:17:57.553816 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [None req-de77d888-d0a9-41be-b792-a6d32ac4f6f5 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] 10.222.0.43 "GET /compute/v2.1/servers/a8d495ae-295a-4ffa-a2d9-5774249e687d" status: 200 len: 1523 microversion: 2.1 time: 0.177612 Jun 22 10:17:57.554718 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 141/294] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:17:57 2022] GET /compute/v2.1/servers/a8d495ae-295a-4ffa-a2d9-5774249e687d => generated 1523 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:17:57.565322 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-ebc6ac93-f371-46a5-9ead-b595133cd9e1 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Calling method '>' {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:17:57.566096 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.compute.api [None req-ebc6ac93-f371-46a5-9ead-b595133cd9e1 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] [instance: 73dbd5ab-5688-4de4-9da2-0b89d7cefb11] Fetching instance by UUID {{(pid=117874) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:17:57.573290 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-ebc6ac93-f371-46a5-9ead-b595133cd9e1 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:17:57.574697 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-ebc6ac93-f371-46a5-9ead-b595133cd9e1 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:17:57.575868 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-ebc6ac93-f371-46a5-9ead-b595133cd9e1 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:17:57.577216 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-ebc6ac93-f371-46a5-9ead-b595133cd9e1 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:17:57.780719 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.policy [None req-ebc6ac93-f371-46a5-9ead-b595133cd9e1 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75753b29a78640df9622d4e2655baf9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee9d603d9cc4a8797f55d544f189720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117874) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:17:57.790625 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.policy [None req-ebc6ac93-f371-46a5-9ead-b595133cd9e1 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75753b29a78640df9622d4e2655baf9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee9d603d9cc4a8797f55d544f189720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117874) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:17:57.792447 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.policy [None req-ebc6ac93-f371-46a5-9ead-b595133cd9e1 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75753b29a78640df9622d4e2655baf9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee9d603d9cc4a8797f55d544f189720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117874) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:17:57.794081 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [None req-ebc6ac93-f371-46a5-9ead-b595133cd9e1 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] 10.222.0.43 "GET /compute/v2.1/servers/73dbd5ab-5688-4de4-9da2-0b89d7cefb11" status: 200 len: 1724 microversion: 2.20 time: 0.243179 Jun 22 10:17:57.794899 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 154/295] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jun 22 10:17:57 2022] GET /compute/v2.1/servers/73dbd5ab-5688-4de4-9da2-0b89d7cefb11 => generated 1724 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 10:17:58.571838 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-de655c24-c3b7-423d-9ccf-2076a2c08d8c tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Calling method '>' {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:17:58.572439 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.compute.api [None req-de655c24-c3b7-423d-9ccf-2076a2c08d8c tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] [instance: a8d495ae-295a-4ffa-a2d9-5774249e687d] Fetching instance by UUID {{(pid=117873) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:17:58.581493 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-de655c24-c3b7-423d-9ccf-2076a2c08d8c tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:17:58.582247 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-de655c24-c3b7-423d-9ccf-2076a2c08d8c tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:17:58.583179 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-de655c24-c3b7-423d-9ccf-2076a2c08d8c tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:17:58.583617 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-de655c24-c3b7-423d-9ccf-2076a2c08d8c tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:17:58.743339 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.policy [None req-de655c24-c3b7-423d-9ccf-2076a2c08d8c tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d7292401816437fba46d073c4746e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3277b9cbc4b4a8bbacee8440cea1ed2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117873) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:17:58.753953 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [None req-de655c24-c3b7-423d-9ccf-2076a2c08d8c tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] 10.222.0.43 "GET /compute/v2.1/servers/a8d495ae-295a-4ffa-a2d9-5774249e687d" status: 200 len: 1523 microversion: 2.1 time: 0.185990 Jun 22 10:17:58.755020 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 142/296] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:17:58 2022] GET /compute/v2.1/servers/a8d495ae-295a-4ffa-a2d9-5774249e687d => generated 1523 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:17:58.813205 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-05cbeb57-4a7b-4a6d-b070-fe06fdf7306c tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Calling method '>' {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:17:58.815688 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.compute.api [None req-05cbeb57-4a7b-4a6d-b070-fe06fdf7306c tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] [instance: 73dbd5ab-5688-4de4-9da2-0b89d7cefb11] Fetching instance by UUID {{(pid=117874) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:17:58.822718 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-05cbeb57-4a7b-4a6d-b070-fe06fdf7306c tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:17:58.823268 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-05cbeb57-4a7b-4a6d-b070-fe06fdf7306c tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:17:58.824144 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-05cbeb57-4a7b-4a6d-b070-fe06fdf7306c tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:17:58.824696 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-05cbeb57-4a7b-4a6d-b070-fe06fdf7306c tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:17:58.904627 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-9dffbc5f-8953-4983-b651-15914d9fbf11 tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Action: 'create', calling method: .version_select at 0x7f36bee58160>, body: {"keypair": {"name": "tempest-keypair-1497354139", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNWF2+eXS5grwp5FFgpA7iCtMTYL04/irYYtN4wGbBx3jl+Y8d2AW+JGGp/xGYqV9wq5CeFIvYkccS/m/dwc5h3wrlfw5AeLcOrt6lydelUnn5aG9Tx9j7/i6gOOphzzlQ=="}} {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:17:58.926576 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.quota [None req-9dffbc5f-8953-4983-b651-15914d9fbf11 tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Getting quotas for project 78629282e2b74418a2c1cdac32576ef1. Resources: {'key_pairs'} {{(pid=117873) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 22 10:17:58.933605 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.quota [None req-9dffbc5f-8953-4983-b651-15914d9fbf11 tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Getting quotas for user 7be3d844dcee4d19966fc7944463a0bc and project 78629282e2b74418a2c1cdac32576ef1. Resources: {'key_pairs'} {{(pid=117873) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 22 10:17:58.982406 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [None req-9dffbc5f-8953-4983-b651-15914d9fbf11 tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.084229 Jun 22 10:17:58.983319 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 143/297] 10.222.0.43 () {60 vars in 1158 bytes} [Wed Jun 22 10:17:58 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 10:17:59.076999 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.policy [None req-05cbeb57-4a7b-4a6d-b070-fe06fdf7306c tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75753b29a78640df9622d4e2655baf9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee9d603d9cc4a8797f55d544f189720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117874) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:17:59.088622 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.policy [None req-05cbeb57-4a7b-4a6d-b070-fe06fdf7306c tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75753b29a78640df9622d4e2655baf9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee9d603d9cc4a8797f55d544f189720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117874) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:17:59.092071 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.policy [None req-05cbeb57-4a7b-4a6d-b070-fe06fdf7306c tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75753b29a78640df9622d4e2655baf9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee9d603d9cc4a8797f55d544f189720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117874) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:17:59.093288 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [None req-05cbeb57-4a7b-4a6d-b070-fe06fdf7306c tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] 10.222.0.43 "GET /compute/v2.1/servers/73dbd5ab-5688-4de4-9da2-0b89d7cefb11" status: 200 len: 1724 microversion: 2.20 time: 0.284896 Jun 22 10:17:59.094517 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 155/298] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jun 22 10:17:58 2022] GET /compute/v2.1/servers/73dbd5ab-5688-4de4-9da2-0b89d7cefb11 => generated 1724 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 10:17:59.773949 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-455edeff-9b5d-42f2-b07f-efb5e550a1df tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Calling method '>' {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:17:59.774566 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.compute.api [None req-455edeff-9b5d-42f2-b07f-efb5e550a1df tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] [instance: a8d495ae-295a-4ffa-a2d9-5774249e687d] Fetching instance by UUID {{(pid=117873) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:17:59.791229 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-455edeff-9b5d-42f2-b07f-efb5e550a1df tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:17:59.791997 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-455edeff-9b5d-42f2-b07f-efb5e550a1df tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:17:59.793008 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-455edeff-9b5d-42f2-b07f-efb5e550a1df tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:17:59.795691 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-455edeff-9b5d-42f2-b07f-efb5e550a1df tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:18:00.113776 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-b40a0235-6d1f-475d-aa39-f125dcdc526d tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Calling method '>' {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:18:00.114915 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.compute.api [None req-b40a0235-6d1f-475d-aa39-f125dcdc526d tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] [instance: 73dbd5ab-5688-4de4-9da2-0b89d7cefb11] Fetching instance by UUID {{(pid=117874) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:18:00.122695 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-b40a0235-6d1f-475d-aa39-f125dcdc526d tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:18:00.123345 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-b40a0235-6d1f-475d-aa39-f125dcdc526d tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:18:00.124260 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-b40a0235-6d1f-475d-aa39-f125dcdc526d tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:18:00.124847 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-b40a0235-6d1f-475d-aa39-f125dcdc526d tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:18:00.313988 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.policy [None req-455edeff-9b5d-42f2-b07f-efb5e550a1df tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d7292401816437fba46d073c4746e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3277b9cbc4b4a8bbacee8440cea1ed2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117873) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:18:00.341284 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.policy [None req-b40a0235-6d1f-475d-aa39-f125dcdc526d tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75753b29a78640df9622d4e2655baf9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee9d603d9cc4a8797f55d544f189720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117874) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:18:00.345074 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [None req-455edeff-9b5d-42f2-b07f-efb5e550a1df tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] 10.222.0.43 "GET /compute/v2.1/servers/a8d495ae-295a-4ffa-a2d9-5774249e687d" status: 200 len: 1523 microversion: 2.1 time: 0.577683 Jun 22 10:18:00.347176 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 144/299] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:17:59 2022] GET /compute/v2.1/servers/a8d495ae-295a-4ffa-a2d9-5774249e687d => generated 1523 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:18:00.350493 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG dbcounter [-] [117874] Writing DB stats nova_cell1:SELECT=100 {{(pid=117874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:18:00.357135 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.policy [None req-b40a0235-6d1f-475d-aa39-f125dcdc526d tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75753b29a78640df9622d4e2655baf9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee9d603d9cc4a8797f55d544f189720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117874) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:18:00.358740 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.policy [None req-b40a0235-6d1f-475d-aa39-f125dcdc526d tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75753b29a78640df9622d4e2655baf9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee9d603d9cc4a8797f55d544f189720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117874) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:18:00.359940 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [None req-b40a0235-6d1f-475d-aa39-f125dcdc526d tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] 10.222.0.43 "GET /compute/v2.1/servers/73dbd5ab-5688-4de4-9da2-0b89d7cefb11" status: 200 len: 1724 microversion: 2.20 time: 0.250415 Jun 22 10:18:00.360793 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 156/300] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jun 22 10:18:00 2022] GET /compute/v2.1/servers/73dbd5ab-5688-4de4-9da2-0b89d7cefb11 => generated 1724 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 22 10:18:00.914329 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-70d97984-d138-481f-9b20-1c8f841b800d tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1482540089", "imageRef": "22d2c064-5bf7-438e-bbb7-47259e4bdab5", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "8bc94bec-5b18-4b15-a531-8b4a0778b280"}], "security_groups": [{"name": "tempest-securitygroup--830641006"}], "key_name": "tempest-keypair-1497354139", "user_data": "}} {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:18:01.023409 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.network.neutron [None req-70d97984-d138-481f-9b20-1c8f841b800d tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] validate_networks() for [('8bc94bec-5b18-4b15-a531-8b4a0778b280', None, None, None, None, None)] {{(pid=117873) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 22 10:18:01.366526 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-ded6da6a-0f8f-46d2-8eb1-2186566696d0 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Calling method '>' {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:18:01.367141 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.compute.api [None req-ded6da6a-0f8f-46d2-8eb1-2186566696d0 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] [instance: a8d495ae-295a-4ffa-a2d9-5774249e687d] Fetching instance by UUID {{(pid=117874) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:18:01.375897 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-ded6da6a-0f8f-46d2-8eb1-2186566696d0 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:18:01.376357 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-ded6da6a-0f8f-46d2-8eb1-2186566696d0 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:18:01.378403 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-ded6da6a-0f8f-46d2-8eb1-2186566696d0 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:18:01.378891 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-ded6da6a-0f8f-46d2-8eb1-2186566696d0 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:18:01.414303 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.virt.hardware [None req-70d97984-d138-481f-9b20-1c8f841b800d tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Flavor limits 0:0:0 {{(pid=117873) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 22 10:18:01.414941 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.virt.hardware [None req-70d97984-d138-481f-9b20-1c8f841b800d tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Image limits 0:0:0 {{(pid=117873) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 22 10:18:01.415571 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.virt.hardware [None req-70d97984-d138-481f-9b20-1c8f841b800d tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Flavor pref 0:0:0 {{(pid=117873) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 22 10:18:01.416147 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.virt.hardware [None req-70d97984-d138-481f-9b20-1c8f841b800d tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Image pref 0:0:0 {{(pid=117873) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 22 10:18:01.416557 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.virt.hardware [None req-70d97984-d138-481f-9b20-1c8f841b800d tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117873) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 22 10:18:01.435507 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-70d97984-d138-481f-9b20-1c8f841b800d tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:18:01.435959 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-70d97984-d138-481f-9b20-1c8f841b800d tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:18:01.436757 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-70d97984-d138-481f-9b20-1c8f841b800d tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:18:01.437194 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-70d97984-d138-481f-9b20-1c8f841b800d tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:18:01.454731 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.quota [None req-70d97984-d138-481f-9b20-1c8f841b800d tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Getting quotas for project 78629282e2b74418a2c1cdac32576ef1. Resources: {'instances', 'cores', 'ram'} {{(pid=117873) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 22 10:18:01.459130 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.quota [None req-70d97984-d138-481f-9b20-1c8f841b800d tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Getting quotas for user 7be3d844dcee4d19966fc7944463a0bc and project 78629282e2b74418a2c1cdac32576ef1. Resources: {'instances', 'cores', 'ram'} {{(pid=117873) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 22 10:18:01.470618 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.compute.api [None req-70d97984-d138-481f-9b20-1c8f841b800d tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Going to run 1 instances... {{(pid=117873) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 22 10:18:01.480669 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.compute.api [None req-70d97984-d138-481f-9b20-1c8f841b800d tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] [instance: 0b2e66bb-efd5-4ff0-8163-5973db8e0db7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='22d2c064-5bf7-438e-bbb7-47259e4bdab5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117873) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 22 10:18:01.527358 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.policy [None req-ded6da6a-0f8f-46d2-8eb1-2186566696d0 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d7292401816437fba46d073c4746e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3277b9cbc4b4a8bbacee8440cea1ed2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117874) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:18:01.537999 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [None req-70d97984-d138-481f-9b20-1c8f841b800d tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.630152 Jun 22 10:18:01.538650 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 145/301] 10.222.0.43 () {60 vars in 1146 bytes} [Wed Jun 22 10:18:00 2022] POST /compute/v2.1/servers => generated 401 bytes in 632 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 22 10:18:01.547391 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [None req-ded6da6a-0f8f-46d2-8eb1-2186566696d0 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] 10.222.0.43 "GET /compute/v2.1/servers/a8d495ae-295a-4ffa-a2d9-5774249e687d" status: 200 len: 1523 microversion: 2.1 time: 0.186928 Jun 22 10:18:01.548222 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-e8d022cd-2cd5-4180-8981-7cfdb89900d4 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Calling method '>' {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:18:01.549048 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.compute.api [None req-e8d022cd-2cd5-4180-8981-7cfdb89900d4 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] [instance: 73dbd5ab-5688-4de4-9da2-0b89d7cefb11] Fetching instance by UUID {{(pid=117873) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:18:01.556120 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-e8d022cd-2cd5-4180-8981-7cfdb89900d4 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:18:01.556568 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-e8d022cd-2cd5-4180-8981-7cfdb89900d4 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:18:01.557083 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 157/302] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:18:01 2022] GET /compute/v2.1/servers/a8d495ae-295a-4ffa-a2d9-5774249e687d => generated 1523 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:18:01.557347 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-e8d022cd-2cd5-4180-8981-7cfdb89900d4 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:18:01.557875 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-e8d022cd-2cd5-4180-8981-7cfdb89900d4 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:18:01.573729 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-a1dc6b17-987e-4252-a84a-7174fcd74aaa tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Calling method '>' {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:18:01.574369 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.compute.api [None req-a1dc6b17-987e-4252-a84a-7174fcd74aaa tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] [instance: 0b2e66bb-efd5-4ff0-8163-5973db8e0db7] Fetching instance by UUID {{(pid=117874) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:18:01.684573 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.policy [None req-a1dc6b17-987e-4252-a84a-7174fcd74aaa tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7be3d844dcee4d19966fc7944463a0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78629282e2b74418a2c1cdac32576ef1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117874) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:18:01.699778 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [None req-a1dc6b17-987e-4252-a84a-7174fcd74aaa tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] 10.222.0.43 "GET /compute/v2.1/servers/0b2e66bb-efd5-4ff0-8163-5973db8e0db7" status: 200 len: 1242 microversion: 2.1 time: 0.141182 Jun 22 10:18:01.702013 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 158/303] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:18:01 2022] GET /compute/v2.1/servers/0b2e66bb-efd5-4ff0-8163-5973db8e0db7 => generated 1242 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:18:01.782486 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.policy [None req-e8d022cd-2cd5-4180-8981-7cfdb89900d4 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75753b29a78640df9622d4e2655baf9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee9d603d9cc4a8797f55d544f189720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117873) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:18:01.796015 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.policy [None req-e8d022cd-2cd5-4180-8981-7cfdb89900d4 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75753b29a78640df9622d4e2655baf9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee9d603d9cc4a8797f55d544f189720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117873) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:18:01.799735 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.policy [None req-e8d022cd-2cd5-4180-8981-7cfdb89900d4 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75753b29a78640df9622d4e2655baf9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee9d603d9cc4a8797f55d544f189720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117873) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:18:01.802085 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [None req-e8d022cd-2cd5-4180-8981-7cfdb89900d4 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] 10.222.0.43 "GET /compute/v2.1/servers/73dbd5ab-5688-4de4-9da2-0b89d7cefb11" status: 200 len: 1724 microversion: 2.20 time: 0.257447 Jun 22 10:18:01.802998 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 146/304] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jun 22 10:18:01 2022] GET /compute/v2.1/servers/73dbd5ab-5688-4de4-9da2-0b89d7cefb11 => generated 1724 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 10:18:02.564273 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-7bcbe8e8-d448-4a43-be63-86c717996fba tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Calling method '>' {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:18:02.565044 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.compute.api [None req-7bcbe8e8-d448-4a43-be63-86c717996fba tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] [instance: a8d495ae-295a-4ffa-a2d9-5774249e687d] Fetching instance by UUID {{(pid=117874) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:18:02.572607 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-7bcbe8e8-d448-4a43-be63-86c717996fba tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:18:02.573057 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-7bcbe8e8-d448-4a43-be63-86c717996fba tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:18:02.597419 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-7bcbe8e8-d448-4a43-be63-86c717996fba tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:18:02.597909 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-7bcbe8e8-d448-4a43-be63-86c717996fba tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:18:02.724222 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-d4b89f2a-7698-4832-83bb-57b84fd67c50 tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Calling method '>' {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:18:02.725116 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.compute.api [None req-d4b89f2a-7698-4832-83bb-57b84fd67c50 tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] [instance: 0b2e66bb-efd5-4ff0-8163-5973db8e0db7] Fetching instance by UUID {{(pid=117873) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:18:02.745647 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-d4b89f2a-7698-4832-83bb-57b84fd67c50 tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:18:02.746143 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-d4b89f2a-7698-4832-83bb-57b84fd67c50 tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:18:02.747177 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-d4b89f2a-7698-4832-83bb-57b84fd67c50 tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:18:02.747778 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-d4b89f2a-7698-4832-83bb-57b84fd67c50 tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:18:02.787654 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.policy [None req-7bcbe8e8-d448-4a43-be63-86c717996fba tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d7292401816437fba46d073c4746e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3277b9cbc4b4a8bbacee8440cea1ed2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117874) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:18:02.796041 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [None req-7bcbe8e8-d448-4a43-be63-86c717996fba tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] 10.222.0.43 "GET /compute/v2.1/servers/a8d495ae-295a-4ffa-a2d9-5774249e687d" status: 200 len: 1523 microversion: 2.1 time: 0.235627 Jun 22 10:18:02.796760 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 159/305] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:18:02 2022] GET /compute/v2.1/servers/a8d495ae-295a-4ffa-a2d9-5774249e687d => generated 1523 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:18:02.820775 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.policy [None req-d4b89f2a-7698-4832-83bb-57b84fd67c50 tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7be3d844dcee4d19966fc7944463a0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78629282e2b74418a2c1cdac32576ef1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117873) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:18:02.825412 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-03395618-123b-490a-8dd1-fdb187960c65 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Calling method '>' {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:18:02.826041 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.compute.api [None req-03395618-123b-490a-8dd1-fdb187960c65 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] [instance: 73dbd5ab-5688-4de4-9da2-0b89d7cefb11] Fetching instance by UUID {{(pid=117874) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:18:02.831718 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [None req-d4b89f2a-7698-4832-83bb-57b84fd67c50 tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] 10.222.0.43 "GET /compute/v2.1/servers/0b2e66bb-efd5-4ff0-8163-5973db8e0db7" status: 200 len: 1294 microversion: 2.1 time: 0.116257 Jun 22 10:18:02.832655 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 147/306] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:18:02 2022] GET /compute/v2.1/servers/0b2e66bb-efd5-4ff0-8163-5973db8e0db7 => generated 1294 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:18:02.849828 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-03395618-123b-490a-8dd1-fdb187960c65 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:18:02.850277 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-03395618-123b-490a-8dd1-fdb187960c65 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:18:02.851242 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-03395618-123b-490a-8dd1-fdb187960c65 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:18:02.851674 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-03395618-123b-490a-8dd1-fdb187960c65 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:18:02.995443 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.policy [None req-03395618-123b-490a-8dd1-fdb187960c65 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75753b29a78640df9622d4e2655baf9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee9d603d9cc4a8797f55d544f189720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117874) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:18:03.005332 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.policy [None req-03395618-123b-490a-8dd1-fdb187960c65 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75753b29a78640df9622d4e2655baf9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee9d603d9cc4a8797f55d544f189720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117874) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:18:03.007128 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.policy [None req-03395618-123b-490a-8dd1-fdb187960c65 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75753b29a78640df9622d4e2655baf9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee9d603d9cc4a8797f55d544f189720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117874) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:18:03.008578 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [None req-03395618-123b-490a-8dd1-fdb187960c65 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] 10.222.0.43 "GET /compute/v2.1/servers/73dbd5ab-5688-4de4-9da2-0b89d7cefb11" status: 200 len: 1724 microversion: 2.20 time: 0.189919 Jun 22 10:18:03.009172 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 160/307] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jun 22 10:18:02 2022] GET /compute/v2.1/servers/73dbd5ab-5688-4de4-9da2-0b89d7cefb11 => generated 1724 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 10:18:03.815975 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-197ddd90-fd81-4ff1-b22d-29eb5626cf68 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Calling method '>' {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:18:03.816870 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.compute.api [None req-197ddd90-fd81-4ff1-b22d-29eb5626cf68 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] [instance: a8d495ae-295a-4ffa-a2d9-5774249e687d] Fetching instance by UUID {{(pid=117873) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:18:03.823533 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-197ddd90-fd81-4ff1-b22d-29eb5626cf68 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:18:03.823999 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-197ddd90-fd81-4ff1-b22d-29eb5626cf68 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:18:03.824833 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-197ddd90-fd81-4ff1-b22d-29eb5626cf68 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:18:03.825339 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-197ddd90-fd81-4ff1-b22d-29eb5626cf68 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:18:03.857290 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-283b1d25-957e-48a2-962d-f0c7bc03eeb8 tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Calling method '>' {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:18:03.858609 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.compute.api [None req-283b1d25-957e-48a2-962d-f0c7bc03eeb8 tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] [instance: 0b2e66bb-efd5-4ff0-8163-5973db8e0db7] Fetching instance by UUID {{(pid=117874) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:18:03.871969 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-283b1d25-957e-48a2-962d-f0c7bc03eeb8 tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:18:03.872520 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-283b1d25-957e-48a2-962d-f0c7bc03eeb8 tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:18:03.873373 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-283b1d25-957e-48a2-962d-f0c7bc03eeb8 tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:18:03.873908 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-283b1d25-957e-48a2-962d-f0c7bc03eeb8 tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:18:03.980932 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.policy [None req-283b1d25-957e-48a2-962d-f0c7bc03eeb8 tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7be3d844dcee4d19966fc7944463a0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78629282e2b74418a2c1cdac32576ef1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117874) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:18:03.996544 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [None req-283b1d25-957e-48a2-962d-f0c7bc03eeb8 tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] 10.222.0.43 "GET /compute/v2.1/servers/0b2e66bb-efd5-4ff0-8163-5973db8e0db7" status: 200 len: 1302 microversion: 2.1 time: 0.143638 Jun 22 10:18:04.002418 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 161/308] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:18:03 2022] GET /compute/v2.1/servers/0b2e66bb-efd5-4ff0-8163-5973db8e0db7 => generated 1302 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 10:18:04.027568 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-7951347c-691c-4d7c-be33-02379c389ebd tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Calling method '>' {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:18:04.028183 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.compute.api [None req-7951347c-691c-4d7c-be33-02379c389ebd tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] [instance: 73dbd5ab-5688-4de4-9da2-0b89d7cefb11] Fetching instance by UUID {{(pid=117874) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:18:04.036144 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-7951347c-691c-4d7c-be33-02379c389ebd tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:18:04.036836 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-7951347c-691c-4d7c-be33-02379c389ebd tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:18:04.037958 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-7951347c-691c-4d7c-be33-02379c389ebd tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:18:04.038567 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-7951347c-691c-4d7c-be33-02379c389ebd tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:18:04.063280 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.policy [None req-197ddd90-fd81-4ff1-b22d-29eb5626cf68 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d7292401816437fba46d073c4746e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3277b9cbc4b4a8bbacee8440cea1ed2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117873) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:18:04.076419 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [None req-197ddd90-fd81-4ff1-b22d-29eb5626cf68 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] 10.222.0.43 "GET /compute/v2.1/servers/a8d495ae-295a-4ffa-a2d9-5774249e687d" status: 200 len: 1503 microversion: 2.1 time: 0.264882 Jun 22 10:18:04.106598 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 148/309] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:18:03 2022] GET /compute/v2.1/servers/a8d495ae-295a-4ffa-a2d9-5774249e687d => generated 1503 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:18:04.113048 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-de4439eb-8c44-4555-b62e-8860cdd87003 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8fb99d04-e6a9-4fb4-8539-16306124777e"}} {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:18:04.114858 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.compute.api [None req-de4439eb-8c44-4555-b62e-8860cdd87003 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] [instance: a8d495ae-295a-4ffa-a2d9-5774249e687d] Fetching instance by UUID {{(pid=117873) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:18:04.133681 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-de4439eb-8c44-4555-b62e-8860cdd87003 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:18:04.134422 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-de4439eb-8c44-4555-b62e-8860cdd87003 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:18:04.135722 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-de4439eb-8c44-4555-b62e-8860cdd87003 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:18:04.136326 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-de4439eb-8c44-4555-b62e-8860cdd87003 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:18:04.163016 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.wsgi [None req-de4439eb-8c44-4555-b62e-8860cdd87003 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] HTTP exception thrown: Cannot 'attach_volume' instance a8d495ae-295a-4ffa-a2d9-5774249e687d while it is in vm_state rescued Jun 22 10:18:04.164704 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-de4439eb-8c44-4555-b62e-8860cdd87003 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Request method failure captured: Jun 22 10:18:04.164704 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: request: POST /compute/v2.1/servers/a8d495ae-295a-4ffa-a2d9-5774249e687d/os-volume_attachments HTTP/1.1 Jun 22 10:18:04.164704 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: Accept: application/json Jun 22 10:18:04.164704 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: Accept-Encoding: identity Jun 22 10:18:04.164704 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: Connection: close Jun 22 10:18:04.164704 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: Content-Length: 74 Jun 22 10:18:04.164704 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: Content-Type: application/json Jun 22 10:18:04.164704 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: Host: 10.222.0.43 Jun 22 10:18:04.164704 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: Openstack-System-Scope: None Jun 22 10:18:04.164704 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: User-Agent: python-urllib3/1.26.9 Jun 22 10:18:04.164704 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-Auth-Token: gAAAAABisuvjVgSjiKizNMOSSpCqXljNGSFOhAJqDEs6LcefAlRz8CAyn7YtQIZuzfdzoXcb1I3sPaeBjRE3nGlR4nfnglF3o0W8ZwIXa-t2T7Kvu9u_9tTAcMDpcQ53GMtzR-i0HixNHH9XjiiRNTwzoo0r6BKSTSNuiStSMHwEgpkRgSyLC2I Jun 22 10:18:04.164704 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-Domain-Id: None Jun 22 10:18:04.164704 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-Domain-Name: None Jun 22 10:18:04.164704 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-Identity-Status: Confirmed Jun 22 10:18:04.164704 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-Is-Admin-Project: True Jun 22 10:18:04.164704 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-Project-Domain-Id: default Jun 22 10:18:04.164704 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-Project-Domain-Name: Default Jun 22 10:18:04.164704 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-Project-Id: c3277b9cbc4b4a8bbacee8440cea1ed2 Jun 22 10:18:04.164704 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-2023039799 Jun 22 10:18:04.164704 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-Role: reader,member Jun 22 10:18:04.164704 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-Roles: reader,member Jun 22 10:18:04.166249 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/c3277b9cbc4b4a8bbacee8440cea1ed2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/c3277b9cbc4b4a8bbacee8440cea1ed2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_c3277b9cbc4b4a8bbacee8440cea1ed2", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/c3277b9cbc4b4a8bbacee8440cea1ed2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}] Jun 22 10:18:04.166249 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-Tenant: tempest-ServerRescueNegativeTestJSON-2023039799 Jun 22 10:18:04.166249 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-Tenant-Id: c3277b9cbc4b4a8bbacee8440cea1ed2 Jun 22 10:18:04.166249 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-2023039799 Jun 22 10:18:04.166249 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-User: tempest-ServerRescueNegativeTestJSON-2023039799-project Jun 22 10:18:04.166249 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-User-Domain-Id: default Jun 22 10:18:04.166249 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-User-Domain-Name: Default Jun 22 10:18:04.166249 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-User-Id: 0d7292401816437fba46d073c4746e45 Jun 22 10:18:04.166249 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-User-Name: tempest-ServerRescueNegativeTestJSON-2023039799-project Jun 22 10:18:04.166249 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: Jun 22 10:18:04.166249 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: {"volumeAttachment": {"volumeId": "8fb99d04-e6a9-4fb4-8539-16306124777e"}} Jun 22 10:18:04.166249 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: method: > Jun 22 10:18:04.167113 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: exception: Cannot 'attach_volume' instance a8d495ae-295a-4ffa-a2d9-5774249e687d while it is in vm_state rescued Jun 22 10:18:04.167113 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: action_args: {'server_id': 'a8d495ae-295a-4ffa-a2d9-5774249e687d', 'body': {'volumeAttachment': {'volumeId': '8fb99d04-e6a9-4fb4-8539-16306124777e'}}} Jun 22 10:18:04.167113 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 10:18:04.167113 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:18:04.167113 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jun 22 10:18:04.167113 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jun 22 10:18:04.167113 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 22 10:18:04.167113 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 22 10:18:04.167113 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jun 22 10:18:04.167113 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jun 22 10:18:04.167113 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance a8d495ae-295a-4ffa-a2d9-5774249e687d in vm_state rescued. Cannot attach_volume while the instance is in this state. Jun 22 10:18:04.167113 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi Jun 22 10:18:04.167113 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 10:18:04.167113 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi Jun 22 10:18:04.167113 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:18:04.167113 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 10:18:04.167113 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 10:18:04.167113 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 10:18:04.167113 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 10:18:04.168472 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 10:18:04.168472 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 10:18:04.168472 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 22 10:18:04.168472 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 22 10:18:04.168472 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 22 10:18:04.168472 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 22 10:18:04.168472 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 22 10:18:04.168472 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 22 10:18:04.168472 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Jun 22 10:18:04.168472 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jun 22 10:18:04.168472 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jun 22 10:18:04.168472 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jun 22 10:18:04.168472 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance a8d495ae-295a-4ffa-a2d9-5774249e687d while it is in vm_state rescued Jun 22 10:18:04.168472 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi Jun 22 10:18:04.168472 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 10:18:04.168472 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi Jun 22 10:18:04.168472 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:18:04.168472 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 10:18:04.168472 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 10:18:04.169805 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 10:18:04.169805 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 10:18:04.169805 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance a8d495ae-295a-4ffa-a2d9-5774249e687d while it is in vm_state rescued Jun 22 10:18:04.169805 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi Jun 22 10:18:04.169805 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-de4439eb-8c44-4555-b62e-8860cdd87003 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Returning 409 to user: Cannot 'attach_volume' instance a8d495ae-295a-4ffa-a2d9-5774249e687d while it is in vm_state rescued {{(pid=117873) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 10:18:04.169805 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [None req-de4439eb-8c44-4555-b62e-8860cdd87003 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] 10.222.0.43 "POST /compute/v2.1/servers/a8d495ae-295a-4ffa-a2d9-5774249e687d/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.058184 Jun 22 10:18:04.169805 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 149/310] 10.222.0.43 () {60 vars in 1322 bytes} [Wed Jun 22 10:18:04 2022] POST /compute/v2.1/servers/a8d495ae-295a-4ffa-a2d9-5774249e687d/os-volume_attachments => generated 152 bytes in 59 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jun 22 10:18:04.178577 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-0c1583d1-b3cb-40c8-a810-0662665f3e5b tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:18:04.179320 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.compute.api [None req-0c1583d1-b3cb-40c8-a810-0662665f3e5b tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] [instance: a8d495ae-295a-4ffa-a2d9-5774249e687d] Fetching instance by UUID {{(pid=117873) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:18:04.186741 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-0c1583d1-b3cb-40c8-a810-0662665f3e5b tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:18:04.187200 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-0c1583d1-b3cb-40c8-a810-0662665f3e5b tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:18:04.187985 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-0c1583d1-b3cb-40c8-a810-0662665f3e5b tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:18:04.188537 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-0c1583d1-b3cb-40c8-a810-0662665f3e5b tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:18:04.239384 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.policy [None req-7951347c-691c-4d7c-be33-02379c389ebd tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75753b29a78640df9622d4e2655baf9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee9d603d9cc4a8797f55d544f189720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117874) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:18:04.247966 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.policy [None req-7951347c-691c-4d7c-be33-02379c389ebd tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75753b29a78640df9622d4e2655baf9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee9d603d9cc4a8797f55d544f189720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117874) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:18:04.249606 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.policy [None req-7951347c-691c-4d7c-be33-02379c389ebd tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75753b29a78640df9622d4e2655baf9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee9d603d9cc4a8797f55d544f189720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117874) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:18:04.251032 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [None req-7951347c-691c-4d7c-be33-02379c389ebd tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] 10.222.0.43 "GET /compute/v2.1/servers/73dbd5ab-5688-4de4-9da2-0b89d7cefb11" status: 200 len: 1724 microversion: 2.20 time: 0.227515 Jun 22 10:18:04.252308 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 162/311] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jun 22 10:18:04 2022] GET /compute/v2.1/servers/73dbd5ab-5688-4de4-9da2-0b89d7cefb11 => generated 1724 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 22 10:18:04.271482 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [None req-0c1583d1-b3cb-40c8-a810-0662665f3e5b tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] 10.222.0.43 "POST /compute/v2.1/servers/a8d495ae-295a-4ffa-a2d9-5774249e687d/action" status: 202 len: 0 microversion: 2.1 time: 0.096593 Jun 22 10:18:04.272111 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 150/312] 10.222.0.43 () {60 vars in 1277 bytes} [Wed Jun 22 10:18:04 2022] POST /compute/v2.1/servers/a8d495ae-295a-4ffa-a2d9-5774249e687d/action => generated 0 bytes in 98 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 22 10:18:04.281002 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-e70071b5-ca84-4863-816c-95e40a352316 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Calling method '>' {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:18:04.282073 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.compute.api [None req-e70071b5-ca84-4863-816c-95e40a352316 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] [instance: a8d495ae-295a-4ffa-a2d9-5774249e687d] Fetching instance by UUID {{(pid=117874) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:18:04.288947 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-e70071b5-ca84-4863-816c-95e40a352316 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:18:04.289399 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-e70071b5-ca84-4863-816c-95e40a352316 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:18:04.290203 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-e70071b5-ca84-4863-816c-95e40a352316 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:18:04.290640 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-e70071b5-ca84-4863-816c-95e40a352316 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:18:04.438831 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.policy [None req-e70071b5-ca84-4863-816c-95e40a352316 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d7292401816437fba46d073c4746e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3277b9cbc4b4a8bbacee8440cea1ed2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117874) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:18:04.456557 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [None req-e70071b5-ca84-4863-816c-95e40a352316 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] 10.222.0.43 "GET /compute/v2.1/servers/a8d495ae-295a-4ffa-a2d9-5774249e687d" status: 200 len: 1511 microversion: 2.1 time: 0.179573 Jun 22 10:18:04.460406 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 163/313] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:18:04 2022] GET /compute/v2.1/servers/a8d495ae-295a-4ffa-a2d9-5774249e687d => generated 1511 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:18:05.020111 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-10091f98-3702-4132-a3b7-720d9496b325 tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Calling method '>' {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:18:05.020808 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.compute.api [None req-10091f98-3702-4132-a3b7-720d9496b325 tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] [instance: 0b2e66bb-efd5-4ff0-8163-5973db8e0db7] Fetching instance by UUID {{(pid=117873) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:18:05.027296 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-10091f98-3702-4132-a3b7-720d9496b325 tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:18:05.027701 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-10091f98-3702-4132-a3b7-720d9496b325 tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:18:05.028483 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-10091f98-3702-4132-a3b7-720d9496b325 tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:18:05.028920 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-10091f98-3702-4132-a3b7-720d9496b325 tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:18:05.099392 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.policy [None req-10091f98-3702-4132-a3b7-720d9496b325 tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7be3d844dcee4d19966fc7944463a0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78629282e2b74418a2c1cdac32576ef1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117873) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:18:05.110999 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [None req-10091f98-3702-4132-a3b7-720d9496b325 tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] 10.222.0.43 "GET /compute/v2.1/servers/0b2e66bb-efd5-4ff0-8163-5973db8e0db7" status: 200 len: 1300 microversion: 2.1 time: 0.095298 Jun 22 10:18:05.113842 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 151/314] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:18:05 2022] GET /compute/v2.1/servers/0b2e66bb-efd5-4ff0-8163-5973db8e0db7 => generated 1300 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 10:18:05.272063 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-b5e76449-c2bf-41c0-93d4-dffdeedbe7ee tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Calling method '>' {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:18:05.272662 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.compute.api [None req-b5e76449-c2bf-41c0-93d4-dffdeedbe7ee tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] [instance: 73dbd5ab-5688-4de4-9da2-0b89d7cefb11] Fetching instance by UUID {{(pid=117874) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:18:05.282448 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-b5e76449-c2bf-41c0-93d4-dffdeedbe7ee tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:18:05.284413 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-b5e76449-c2bf-41c0-93d4-dffdeedbe7ee tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:18:05.285328 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-b5e76449-c2bf-41c0-93d4-dffdeedbe7ee tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:18:05.286541 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-b5e76449-c2bf-41c0-93d4-dffdeedbe7ee tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:18:05.465314 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.policy [None req-b5e76449-c2bf-41c0-93d4-dffdeedbe7ee tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75753b29a78640df9622d4e2655baf9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee9d603d9cc4a8797f55d544f189720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117874) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:18:05.479801 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-0c61013a-84bf-4ef1-8eb1-c98faeb9bcb8 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Calling method '>' {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:18:05.480769 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.compute.api [None req-0c61013a-84bf-4ef1-8eb1-c98faeb9bcb8 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] [instance: a8d495ae-295a-4ffa-a2d9-5774249e687d] Fetching instance by UUID {{(pid=117873) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:18:05.481334 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.policy [None req-b5e76449-c2bf-41c0-93d4-dffdeedbe7ee tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75753b29a78640df9622d4e2655baf9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee9d603d9cc4a8797f55d544f189720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117874) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:18:05.482884 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.policy [None req-b5e76449-c2bf-41c0-93d4-dffdeedbe7ee tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75753b29a78640df9622d4e2655baf9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee9d603d9cc4a8797f55d544f189720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117874) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:18:05.484252 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [None req-b5e76449-c2bf-41c0-93d4-dffdeedbe7ee tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] 10.222.0.43 "GET /compute/v2.1/servers/73dbd5ab-5688-4de4-9da2-0b89d7cefb11" status: 200 len: 1724 microversion: 2.20 time: 0.218295 Jun 22 10:18:05.486478 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 164/315] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jun 22 10:18:05 2022] GET /compute/v2.1/servers/73dbd5ab-5688-4de4-9da2-0b89d7cefb11 => generated 1724 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 10:18:05.500656 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-0c61013a-84bf-4ef1-8eb1-c98faeb9bcb8 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:18:05.509219 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-0c61013a-84bf-4ef1-8eb1-c98faeb9bcb8 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:18:05.510615 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-0c61013a-84bf-4ef1-8eb1-c98faeb9bcb8 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:18:05.511305 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-0c61013a-84bf-4ef1-8eb1-c98faeb9bcb8 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:18:05.682484 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.policy [None req-0c61013a-84bf-4ef1-8eb1-c98faeb9bcb8 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d7292401816437fba46d073c4746e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3277b9cbc4b4a8bbacee8440cea1ed2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117873) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:18:05.694571 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [None req-0c61013a-84bf-4ef1-8eb1-c98faeb9bcb8 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] 10.222.0.43 "GET /compute/v2.1/servers/a8d495ae-295a-4ffa-a2d9-5774249e687d" status: 200 len: 1511 microversion: 2.1 time: 0.217695 Jun 22 10:18:05.694571 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 152/316] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:18:05 2022] GET /compute/v2.1/servers/a8d495ae-295a-4ffa-a2d9-5774249e687d => generated 1511 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:18:06.121156 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [req-eb828576-5487-4017-be28-a8ccb92a5bfd req-0d906003-3ce8-4c50-9ecf-b19987861331 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0b2e66bb-efd5-4ff0-8163-5973db8e0db7", "tag": "96fa324f-1235-4750-a242-7810d3d32273"}]} {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:18:06.132107 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-addbb315-8154-4809-bad5-15a7784e407e tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Calling method '>' {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:18:06.132717 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.compute.api [None req-addbb315-8154-4809-bad5-15a7784e407e tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] [instance: 0b2e66bb-efd5-4ff0-8163-5973db8e0db7] Fetching instance by UUID {{(pid=117873) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:18:06.151433 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-addbb315-8154-4809-bad5-15a7784e407e tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:18:06.156298 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-addbb315-8154-4809-bad5-15a7784e407e tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:18:06.156600 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [req-eb828576-5487-4017-be28-a8ccb92a5bfd req-0d906003-3ce8-4c50-9ecf-b19987861331 service nova] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:18:06.157126 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [req-eb828576-5487-4017-be28-a8ccb92a5bfd req-0d906003-3ce8-4c50-9ecf-b19987861331 service nova] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:18:06.158463 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-addbb315-8154-4809-bad5-15a7784e407e tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:18:06.159096 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-addbb315-8154-4809-bad5-15a7784e407e tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:18:06.172608 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.compute.server_external_events [req-eb828576-5487-4017-be28-a8ccb92a5bfd req-0d906003-3ce8-4c50-9ecf-b19987861331 service nova] Creating event network-changed:96fa324f-1235-4750-a242-7810d3d32273 for instance 0b2e66bb-efd5-4ff0-8163-5973db8e0db7 on hv-cinder-84713 Jun 22 10:18:06.190840 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [req-eb828576-5487-4017-be28-a8ccb92a5bfd req-0d906003-3ce8-4c50-9ecf-b19987861331 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080318 Jun 22 10:18:06.191758 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 165/317] 10.222.0.43 () {64 vars in 1317 bytes} [Wed Jun 22 10:18:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 10:18:06.328577 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.policy [None req-addbb315-8154-4809-bad5-15a7784e407e tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7be3d844dcee4d19966fc7944463a0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78629282e2b74418a2c1cdac32576ef1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117873) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:18:06.343918 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [None req-addbb315-8154-4809-bad5-15a7784e407e tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] 10.222.0.43 "GET /compute/v2.1/servers/0b2e66bb-efd5-4ff0-8163-5973db8e0db7" status: 200 len: 1367 microversion: 2.1 time: 0.216189 Jun 22 10:18:06.350720 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 153/318] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:18:06 2022] GET /compute/v2.1/servers/0b2e66bb-efd5-4ff0-8163-5973db8e0db7 => generated 1367 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:18:06.505167 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-059a1515-c242-4b97-893c-7207680329f7 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Calling method '>' {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:18:06.505890 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.compute.api [None req-059a1515-c242-4b97-893c-7207680329f7 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] [instance: 73dbd5ab-5688-4de4-9da2-0b89d7cefb11] Fetching instance by UUID {{(pid=117874) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:18:06.512196 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-059a1515-c242-4b97-893c-7207680329f7 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:18:06.512688 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-059a1515-c242-4b97-893c-7207680329f7 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:18:06.513525 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-059a1515-c242-4b97-893c-7207680329f7 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:18:06.514019 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-059a1515-c242-4b97-893c-7207680329f7 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:18:06.707263 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.policy [None req-059a1515-c242-4b97-893c-7207680329f7 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75753b29a78640df9622d4e2655baf9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee9d603d9cc4a8797f55d544f189720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117874) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:18:06.710749 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-823934ee-19fd-477d-a221-27b727a917df tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Calling method '>' {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:18:06.711357 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.compute.api [None req-823934ee-19fd-477d-a221-27b727a917df tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] [instance: a8d495ae-295a-4ffa-a2d9-5774249e687d] Fetching instance by UUID {{(pid=117873) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:18:06.716810 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.policy [None req-059a1515-c242-4b97-893c-7207680329f7 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75753b29a78640df9622d4e2655baf9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee9d603d9cc4a8797f55d544f189720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117874) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:18:06.718380 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-823934ee-19fd-477d-a221-27b727a917df tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:18:06.718602 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.policy [None req-059a1515-c242-4b97-893c-7207680329f7 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75753b29a78640df9622d4e2655baf9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee9d603d9cc4a8797f55d544f189720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117874) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:18:06.719260 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-823934ee-19fd-477d-a221-27b727a917df tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:18:06.719733 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [None req-059a1515-c242-4b97-893c-7207680329f7 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] 10.222.0.43 "GET /compute/v2.1/servers/73dbd5ab-5688-4de4-9da2-0b89d7cefb11" status: 200 len: 1724 microversion: 2.20 time: 0.220361 Jun 22 10:18:06.720553 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 166/319] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jun 22 10:18:06 2022] GET /compute/v2.1/servers/73dbd5ab-5688-4de4-9da2-0b89d7cefb11 => generated 1724 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 10:18:06.721331 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-823934ee-19fd-477d-a221-27b727a917df tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:18:06.722021 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-823934ee-19fd-477d-a221-27b727a917df tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:18:06.732961 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-b2431a72-bbf5-4ffa-9e15-9725759a40e1 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Calling method '>' {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:18:06.734007 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.compute.api [None req-b2431a72-bbf5-4ffa-9e15-9725759a40e1 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] [instance: eb851ab6-0e89-41d2-be52-d76cdc8644d6] Fetching instance by UUID {{(pid=117874) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:18:06.743084 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-b2431a72-bbf5-4ffa-9e15-9725759a40e1 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:18:06.743577 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-b2431a72-bbf5-4ffa-9e15-9725759a40e1 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:18:06.744542 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-b2431a72-bbf5-4ffa-9e15-9725759a40e1 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:18:06.745011 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-b2431a72-bbf5-4ffa-9e15-9725759a40e1 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:18:06.778116 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [None req-b2431a72-bbf5-4ffa-9e15-9725759a40e1 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] 10.222.0.43 "GET /compute/v2.1/servers/eb851ab6-0e89-41d2-be52-d76cdc8644d6/ips" status: 200 len: 146 microversion: 2.1 time: 0.055349 Jun 22 10:18:06.778943 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 167/320] 10.222.0.43 () {58 vars in 1247 bytes} [Wed Jun 22 10:18:06 2022] GET /compute/v2.1/servers/eb851ab6-0e89-41d2-be52-d76cdc8644d6/ips => generated 146 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 10:18:06.944507 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.policy [None req-823934ee-19fd-477d-a221-27b727a917df tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d7292401816437fba46d073c4746e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3277b9cbc4b4a8bbacee8440cea1ed2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117873) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:18:06.952514 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [None req-823934ee-19fd-477d-a221-27b727a917df tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] 10.222.0.43 "GET /compute/v2.1/servers/a8d495ae-295a-4ffa-a2d9-5774249e687d" status: 200 len: 1511 microversion: 2.1 time: 0.245549 Jun 22 10:18:06.953078 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 154/321] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:18:06 2022] GET /compute/v2.1/servers/a8d495ae-295a-4ffa-a2d9-5774249e687d => generated 1511 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:18:07.367342 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-77104f43-1a8d-44ed-83c7-b40e6416fffe tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Calling method '>' {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:18:07.367954 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.compute.api [None req-77104f43-1a8d-44ed-83c7-b40e6416fffe tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] [instance: 0b2e66bb-efd5-4ff0-8163-5973db8e0db7] Fetching instance by UUID {{(pid=117874) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:18:07.373910 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-77104f43-1a8d-44ed-83c7-b40e6416fffe tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:18:07.374630 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-77104f43-1a8d-44ed-83c7-b40e6416fffe tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:18:07.375389 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-77104f43-1a8d-44ed-83c7-b40e6416fffe tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:18:07.375823 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-77104f43-1a8d-44ed-83c7-b40e6416fffe tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:18:07.529625 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.policy [None req-77104f43-1a8d-44ed-83c7-b40e6416fffe tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7be3d844dcee4d19966fc7944463a0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78629282e2b74418a2c1cdac32576ef1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117874) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:18:07.537165 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [None req-77104f43-1a8d-44ed-83c7-b40e6416fffe tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] 10.222.0.43 "GET /compute/v2.1/servers/0b2e66bb-efd5-4ff0-8163-5973db8e0db7" status: 200 len: 1367 microversion: 2.1 time: 0.173587 Jun 22 10:18:07.537972 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 168/322] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:18:07 2022] GET /compute/v2.1/servers/0b2e66bb-efd5-4ff0-8163-5973db8e0db7 => generated 1367 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:18:07.739716 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-5e9f9a66-04ac-41d7-b652-114f8e66cd9e tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Calling method '>' {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:18:07.740963 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.compute.api [None req-5e9f9a66-04ac-41d7-b652-114f8e66cd9e tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] [instance: 73dbd5ab-5688-4de4-9da2-0b89d7cefb11] Fetching instance by UUID {{(pid=117873) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:18:07.747341 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-5e9f9a66-04ac-41d7-b652-114f8e66cd9e tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:18:07.747779 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-5e9f9a66-04ac-41d7-b652-114f8e66cd9e tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:18:07.748533 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-5e9f9a66-04ac-41d7-b652-114f8e66cd9e tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:18:07.748962 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-5e9f9a66-04ac-41d7-b652-114f8e66cd9e tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:18:07.913156 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.policy [None req-5e9f9a66-04ac-41d7-b652-114f8e66cd9e tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75753b29a78640df9622d4e2655baf9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee9d603d9cc4a8797f55d544f189720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117873) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:18:07.930651 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.policy [None req-5e9f9a66-04ac-41d7-b652-114f8e66cd9e tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75753b29a78640df9622d4e2655baf9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee9d603d9cc4a8797f55d544f189720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117873) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:18:07.932438 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.policy [None req-5e9f9a66-04ac-41d7-b652-114f8e66cd9e tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75753b29a78640df9622d4e2655baf9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee9d603d9cc4a8797f55d544f189720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117873) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:18:07.933827 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [None req-5e9f9a66-04ac-41d7-b652-114f8e66cd9e tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] 10.222.0.43 "GET /compute/v2.1/servers/73dbd5ab-5688-4de4-9da2-0b89d7cefb11" status: 200 len: 1745 microversion: 2.20 time: 0.198985 Jun 22 10:18:07.934460 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 155/323] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jun 22 10:18:07 2022] GET /compute/v2.1/servers/73dbd5ab-5688-4de4-9da2-0b89d7cefb11 => generated 1745 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 10:18:07.970824 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-c2646af9-c6f7-44b0-aa83-66de827f179a tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Calling method '>' {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:18:07.972165 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.compute.api [None req-c2646af9-c6f7-44b0-aa83-66de827f179a tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] [instance: a8d495ae-295a-4ffa-a2d9-5774249e687d] Fetching instance by UUID {{(pid=117874) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:18:07.979406 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-c2646af9-c6f7-44b0-aa83-66de827f179a tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:18:07.980081 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-c2646af9-c6f7-44b0-aa83-66de827f179a tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:18:07.980855 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-c2646af9-c6f7-44b0-aa83-66de827f179a tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:18:07.981498 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-c2646af9-c6f7-44b0-aa83-66de827f179a tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:18:08.136254 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.policy [None req-c2646af9-c6f7-44b0-aa83-66de827f179a tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d7292401816437fba46d073c4746e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3277b9cbc4b4a8bbacee8440cea1ed2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117874) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:18:08.144752 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [None req-c2646af9-c6f7-44b0-aa83-66de827f179a tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] 10.222.0.43 "GET /compute/v2.1/servers/a8d495ae-295a-4ffa-a2d9-5774249e687d" status: 200 len: 1517 microversion: 2.1 time: 0.178750 Jun 22 10:18:08.154319 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 169/324] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:18:07 2022] GET /compute/v2.1/servers/a8d495ae-295a-4ffa-a2d9-5774249e687d => generated 1517 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:18:08.555192 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-e3c9e282-056a-4609-82af-0185f703702d tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Calling method '>' {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:18:08.556036 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.compute.api [None req-e3c9e282-056a-4609-82af-0185f703702d tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] [instance: 0b2e66bb-efd5-4ff0-8163-5973db8e0db7] Fetching instance by UUID {{(pid=117873) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:18:08.562071 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-e3c9e282-056a-4609-82af-0185f703702d tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:18:08.562474 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-e3c9e282-056a-4609-82af-0185f703702d tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:18:08.563327 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-e3c9e282-056a-4609-82af-0185f703702d tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:18:08.564327 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-e3c9e282-056a-4609-82af-0185f703702d tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:18:08.580209 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG dbcounter [-] [117873] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:18:08.718121 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.policy [None req-e3c9e282-056a-4609-82af-0185f703702d tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7be3d844dcee4d19966fc7944463a0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78629282e2b74418a2c1cdac32576ef1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117873) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:18:08.736775 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [None req-e3c9e282-056a-4609-82af-0185f703702d tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] 10.222.0.43 "GET /compute/v2.1/servers/0b2e66bb-efd5-4ff0-8163-5973db8e0db7" status: 200 len: 1367 microversion: 2.1 time: 0.185232 Jun 22 10:18:08.737371 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 156/325] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:18:08 2022] GET /compute/v2.1/servers/0b2e66bb-efd5-4ff0-8163-5973db8e0db7 => generated 1367 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:18:08.952458 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-691b8915-9179-4647-aad9-1a638e1dfb5e tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Calling method '>' {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:18:08.953099 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.compute.api [None req-691b8915-9179-4647-aad9-1a638e1dfb5e tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] [instance: 73dbd5ab-5688-4de4-9da2-0b89d7cefb11] Fetching instance by UUID {{(pid=117874) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:18:08.963135 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-691b8915-9179-4647-aad9-1a638e1dfb5e tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:18:08.963590 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-691b8915-9179-4647-aad9-1a638e1dfb5e tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:18:08.964365 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-691b8915-9179-4647-aad9-1a638e1dfb5e tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:18:08.964798 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-691b8915-9179-4647-aad9-1a638e1dfb5e tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:18:09.128577 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.policy [None req-691b8915-9179-4647-aad9-1a638e1dfb5e tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75753b29a78640df9622d4e2655baf9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee9d603d9cc4a8797f55d544f189720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117874) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:18:09.137383 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.policy [None req-691b8915-9179-4647-aad9-1a638e1dfb5e tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75753b29a78640df9622d4e2655baf9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee9d603d9cc4a8797f55d544f189720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117874) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:18:09.138961 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.policy [None req-691b8915-9179-4647-aad9-1a638e1dfb5e tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75753b29a78640df9622d4e2655baf9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee9d603d9cc4a8797f55d544f189720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117874) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:18:09.140214 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [None req-691b8915-9179-4647-aad9-1a638e1dfb5e tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] 10.222.0.43 "GET /compute/v2.1/servers/73dbd5ab-5688-4de4-9da2-0b89d7cefb11" status: 200 len: 1745 microversion: 2.20 time: 0.191538 Jun 22 10:18:09.140957 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 170/326] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jun 22 10:18:08 2022] GET /compute/v2.1/servers/73dbd5ab-5688-4de4-9da2-0b89d7cefb11 => generated 1745 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 10:18:09.587575 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-566d7fc2-7920-44d9-bde1-5edc2b289368 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Action: 'create', calling method: .version_select at 0x7f36bef10e50>, body: {"keypair": {"name": "tempest-keypair-1141776868", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBfn0XVItIw8BluJ4t5YHiMqIhiNmEazNGXTXZg2oPIfQiKpMFbyrmoarLjiC/wGXBOx92DwGyDg8slkn/IU5rQUU2m2aDIETPm9iLi2kuZgdwwa6CGVeCpWQyVjcaMoDQ=="}} {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:18:09.604641 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.quota [None req-566d7fc2-7920-44d9-bde1-5edc2b289368 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Getting quotas for project c3277b9cbc4b4a8bbacee8440cea1ed2. Resources: {'key_pairs'} {{(pid=117873) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 22 10:18:09.609010 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.quota [None req-566d7fc2-7920-44d9-bde1-5edc2b289368 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Getting quotas for user 0d7292401816437fba46d073c4746e45 and project c3277b9cbc4b4a8bbacee8440cea1ed2. Resources: {'key_pairs'} {{(pid=117873) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 22 10:18:09.651933 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [None req-566d7fc2-7920-44d9-bde1-5edc2b289368 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.068286 Jun 22 10:18:09.652553 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 157/327] 10.222.0.43 () {60 vars in 1158 bytes} [Wed Jun 22 10:18:09 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 10:18:09.755224 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-0475892b-24cf-44dd-9430-d5a4cd8b0488 tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Calling method '>' {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:18:09.755833 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.compute.api [None req-0475892b-24cf-44dd-9430-d5a4cd8b0488 tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] [instance: 0b2e66bb-efd5-4ff0-8163-5973db8e0db7] Fetching instance by UUID {{(pid=117874) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:18:09.763138 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-0475892b-24cf-44dd-9430-d5a4cd8b0488 tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:18:09.764028 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-0475892b-24cf-44dd-9430-d5a4cd8b0488 tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:18:09.764808 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-0475892b-24cf-44dd-9430-d5a4cd8b0488 tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:18:09.765241 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-0475892b-24cf-44dd-9430-d5a4cd8b0488 tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:18:09.955041 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.policy [None req-0475892b-24cf-44dd-9430-d5a4cd8b0488 tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7be3d844dcee4d19966fc7944463a0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78629282e2b74418a2c1cdac32576ef1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117874) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:18:09.965418 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [None req-0475892b-24cf-44dd-9430-d5a4cd8b0488 tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] 10.222.0.43 "GET /compute/v2.1/servers/0b2e66bb-efd5-4ff0-8163-5973db8e0db7" status: 200 len: 1367 microversion: 2.1 time: 0.215530 Jun 22 10:18:09.966026 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 171/328] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:18:09 2022] GET /compute/v2.1/servers/0b2e66bb-efd5-4ff0-8163-5973db8e0db7 => generated 1367 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:18:10.159914 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-70956e6b-4071-4865-8c15-0ef44faefbc1 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Calling method '>' {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:18:10.160533 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.compute.api [None req-70956e6b-4071-4865-8c15-0ef44faefbc1 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] [instance: 73dbd5ab-5688-4de4-9da2-0b89d7cefb11] Fetching instance by UUID {{(pid=117873) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:18:10.167035 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-70956e6b-4071-4865-8c15-0ef44faefbc1 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:18:10.167487 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-70956e6b-4071-4865-8c15-0ef44faefbc1 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:18:10.168260 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-70956e6b-4071-4865-8c15-0ef44faefbc1 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:18:10.168699 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-70956e6b-4071-4865-8c15-0ef44faefbc1 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:18:10.388536 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.policy [None req-70956e6b-4071-4865-8c15-0ef44faefbc1 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75753b29a78640df9622d4e2655baf9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee9d603d9cc4a8797f55d544f189720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117873) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:18:10.397361 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.policy [None req-70956e6b-4071-4865-8c15-0ef44faefbc1 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75753b29a78640df9622d4e2655baf9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee9d603d9cc4a8797f55d544f189720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117873) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:18:10.399134 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.policy [None req-70956e6b-4071-4865-8c15-0ef44faefbc1 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75753b29a78640df9622d4e2655baf9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee9d603d9cc4a8797f55d544f189720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117873) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:18:10.400322 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [None req-70956e6b-4071-4865-8c15-0ef44faefbc1 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] 10.222.0.43 "GET /compute/v2.1/servers/73dbd5ab-5688-4de4-9da2-0b89d7cefb11" status: 200 len: 1745 microversion: 2.20 time: 0.244512 Jun 22 10:18:10.400892 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 158/329] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jun 22 10:18:10 2022] GET /compute/v2.1/servers/73dbd5ab-5688-4de4-9da2-0b89d7cefb11 => generated 1745 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 10:18:10.989546 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-c981afa6-5165-4083-a25f-1547a1e68dc7 tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Calling method '>' {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:18:10.991374 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.compute.api [None req-c981afa6-5165-4083-a25f-1547a1e68dc7 tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] [instance: 0b2e66bb-efd5-4ff0-8163-5973db8e0db7] Fetching instance by UUID {{(pid=117874) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:18:11.014894 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-c981afa6-5165-4083-a25f-1547a1e68dc7 tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:18:11.019003 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-c981afa6-5165-4083-a25f-1547a1e68dc7 tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:18:11.020265 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-c981afa6-5165-4083-a25f-1547a1e68dc7 tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:18:11.021132 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-c981afa6-5165-4083-a25f-1547a1e68dc7 tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:18:11.419405 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-b72ad8ef-760b-4b26-ba62-4db7d2af407a tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Calling method '>' {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:18:11.420806 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.compute.api [None req-b72ad8ef-760b-4b26-ba62-4db7d2af407a tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] [instance: 73dbd5ab-5688-4de4-9da2-0b89d7cefb11] Fetching instance by UUID {{(pid=117873) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:18:11.430461 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-b72ad8ef-760b-4b26-ba62-4db7d2af407a tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:18:11.431233 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-b72ad8ef-760b-4b26-ba62-4db7d2af407a tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:18:11.432379 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-b72ad8ef-760b-4b26-ba62-4db7d2af407a tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:18:11.433031 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-b72ad8ef-760b-4b26-ba62-4db7d2af407a tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:18:11.474680 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG dbcounter [-] [117873] Writing DB stats nova_cell0:SELECT=2 {{(pid=117873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:18:11.690787 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.policy [None req-c981afa6-5165-4083-a25f-1547a1e68dc7 tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7be3d844dcee4d19966fc7944463a0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78629282e2b74418a2c1cdac32576ef1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117874) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:18:11.700479 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG dbcounter [-] [117874] Writing DB stats nova_cell0:SELECT=2 {{(pid=117874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:18:11.707115 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [None req-c981afa6-5165-4083-a25f-1547a1e68dc7 tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] 10.222.0.43 "GET /compute/v2.1/servers/0b2e66bb-efd5-4ff0-8163-5973db8e0db7" status: 200 len: 1367 microversion: 2.1 time: 0.727400 Jun 22 10:18:11.707629 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 172/330] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:18:10 2022] GET /compute/v2.1/servers/0b2e66bb-efd5-4ff0-8163-5973db8e0db7 => generated 1367 bytes in 729 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:18:11.713955 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [req-ea93f0ac-9330-423d-9dd3-3e80035ef5b5 req-5d23fc6d-9db7-4651-af64-d8ae8970bcd0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "73dbd5ab-5688-4de4-9da2-0b89d7cefb11", "name": "network-vif-plugged", "status": "completed", "tag": "468a7090-7d3f-43e5-8303-b6f8870ced56"}]} {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:18:11.735474 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [req-ea93f0ac-9330-423d-9dd3-3e80035ef5b5 req-5d23fc6d-9db7-4651-af64-d8ae8970bcd0 service nova] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:18:11.736307 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [req-ea93f0ac-9330-423d-9dd3-3e80035ef5b5 req-5d23fc6d-9db7-4651-af64-d8ae8970bcd0 service nova] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:18:11.745799 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.policy [None req-b72ad8ef-760b-4b26-ba62-4db7d2af407a tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75753b29a78640df9622d4e2655baf9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee9d603d9cc4a8797f55d544f189720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117873) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:18:11.757196 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.policy [None req-b72ad8ef-760b-4b26-ba62-4db7d2af407a tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75753b29a78640df9622d4e2655baf9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee9d603d9cc4a8797f55d544f189720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117873) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:18:11.759186 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.policy [None req-b72ad8ef-760b-4b26-ba62-4db7d2af407a tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75753b29a78640df9622d4e2655baf9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee9d603d9cc4a8797f55d544f189720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117873) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:18:11.760604 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [None req-b72ad8ef-760b-4b26-ba62-4db7d2af407a tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] 10.222.0.43 "GET /compute/v2.1/servers/73dbd5ab-5688-4de4-9da2-0b89d7cefb11" status: 200 len: 1740 microversion: 2.20 time: 0.345302 Jun 22 10:18:11.761395 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 159/331] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jun 22 10:18:11 2022] GET /compute/v2.1/servers/73dbd5ab-5688-4de4-9da2-0b89d7cefb11 => generated 1740 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 10:18:11.774691 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.compute.server_external_events [req-ea93f0ac-9330-423d-9dd3-3e80035ef5b5 req-5d23fc6d-9db7-4651-af64-d8ae8970bcd0 service nova] Creating event network-vif-plugged:468a7090-7d3f-43e5-8303-b6f8870ced56 for instance 73dbd5ab-5688-4de4-9da2-0b89d7cefb11 on hv-cinder-84713 Jun 22 10:18:11.781239 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [req-ea93f0ac-9330-423d-9dd3-3e80035ef5b5 req-5d23fc6d-9db7-4651-af64-d8ae8970bcd0 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070982 Jun 22 10:18:11.782442 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 173/332] 10.222.0.43 () {64 vars in 1317 bytes} [Wed Jun 22 10:18:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 10:18:11.969274 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-407e0a6e-4d9e-40ec-9e44-506dedb01e5e tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1477010552", "imageRef": "22d2c064-5bf7-438e-bbb7-47259e4bdab5", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "4f5c1d12-de71-40fa-95b0-3e1b37dac412"}], "security_groups": [{"name": "tempest-securitygroup--1537501427"}], "key_name": "tempest-keypair-1141776868", "user_data": "}} {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:18:12.535114 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-7050458b-77a3-4990-afdf-3ef1da34d4a3 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "eca82687-7d3f-41fa-9ae2-fb95a95357e8"}} {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:18:12.536959 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.compute.api [None req-7050458b-77a3-4990-afdf-3ef1da34d4a3 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] [instance: eb851ab6-0e89-41d2-be52-d76cdc8644d6] Fetching instance by UUID {{(pid=117874) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:18:12.543524 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-7050458b-77a3-4990-afdf-3ef1da34d4a3 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:18:12.544214 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-7050458b-77a3-4990-afdf-3ef1da34d4a3 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:18:12.545139 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-7050458b-77a3-4990-afdf-3ef1da34d4a3 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:18:12.545757 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-7050458b-77a3-4990-afdf-3ef1da34d4a3 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:18:12.899243 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG dbcounter [-] [117874] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:18:12.913939 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [None req-7050458b-77a3-4990-afdf-3ef1da34d4a3 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] 10.222.0.43 "POST /compute/v2.1/servers/eb851ab6-0e89-41d2-be52-d76cdc8644d6/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.383919 Jun 22 10:18:12.916908 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 174/333] 10.222.0.43 () {60 vars in 1322 bytes} [Wed Jun 22 10:18:12 2022] POST /compute/v2.1/servers/eb851ab6-0e89-41d2-be52-d76cdc8644d6/os-volume_attachments => generated 194 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 10:18:12.928144 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-34c18884-5601-41f1-9e6c-ecd4250e035e tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Calling method '>' {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:18:12.928871 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.compute.api [None req-34c18884-5601-41f1-9e6c-ecd4250e035e tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] [instance: 0b2e66bb-efd5-4ff0-8163-5973db8e0db7] Fetching instance by UUID {{(pid=117874) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:18:12.935842 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-34c18884-5601-41f1-9e6c-ecd4250e035e tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:18:12.936296 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-34c18884-5601-41f1-9e6c-ecd4250e035e tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:18:12.937071 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-34c18884-5601-41f1-9e6c-ecd4250e035e tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:18:12.937506 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-34c18884-5601-41f1-9e6c-ecd4250e035e tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:18:13.209723 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.policy [None req-34c18884-5601-41f1-9e6c-ecd4250e035e tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7be3d844dcee4d19966fc7944463a0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78629282e2b74418a2c1cdac32576ef1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117874) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:18:13.249396 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [None req-34c18884-5601-41f1-9e6c-ecd4250e035e tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] 10.222.0.43 "GET /compute/v2.1/servers/0b2e66bb-efd5-4ff0-8163-5973db8e0db7" status: 200 len: 1367 microversion: 2.1 time: 0.310325 Jun 22 10:18:13.249396 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 175/334] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:18:12 2022] GET /compute/v2.1/servers/0b2e66bb-efd5-4ff0-8163-5973db8e0db7 => generated 1367 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:18:13.260512 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-e122a722-90ff-46b1-8cac-51a3dbc31a41 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Calling method '>' {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:18:13.262338 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.compute.api [None req-e122a722-90ff-46b1-8cac-51a3dbc31a41 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] [instance: 73dbd5ab-5688-4de4-9da2-0b89d7cefb11] Fetching instance by UUID {{(pid=117874) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:18:13.271205 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-e122a722-90ff-46b1-8cac-51a3dbc31a41 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:18:13.272095 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-e122a722-90ff-46b1-8cac-51a3dbc31a41 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:18:13.273107 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-e122a722-90ff-46b1-8cac-51a3dbc31a41 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:18:13.273738 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-e122a722-90ff-46b1-8cac-51a3dbc31a41 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:18:13.448183 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.policy [None req-e122a722-90ff-46b1-8cac-51a3dbc31a41 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75753b29a78640df9622d4e2655baf9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee9d603d9cc4a8797f55d544f189720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117874) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:18:13.460578 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.policy [None req-e122a722-90ff-46b1-8cac-51a3dbc31a41 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75753b29a78640df9622d4e2655baf9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee9d603d9cc4a8797f55d544f189720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117874) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:18:13.462838 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.policy [None req-e122a722-90ff-46b1-8cac-51a3dbc31a41 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75753b29a78640df9622d4e2655baf9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee9d603d9cc4a8797f55d544f189720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117874) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:18:13.464596 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [None req-e122a722-90ff-46b1-8cac-51a3dbc31a41 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] 10.222.0.43 "GET /compute/v2.1/servers/73dbd5ab-5688-4de4-9da2-0b89d7cefb11" status: 200 len: 1740 microversion: 2.20 time: 0.216487 Jun 22 10:18:13.465901 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 176/335] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jun 22 10:18:13 2022] GET /compute/v2.1/servers/73dbd5ab-5688-4de4-9da2-0b89d7cefb11 => generated 1740 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 10:18:13.811956 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [req-9128ec2a-4ba7-498f-88b2-16f555dd995e req-2f6185c9-c06f-49f9-b6d4-3649080dcb3f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0b2e66bb-efd5-4ff0-8163-5973db8e0db7", "name": "network-vif-plugged", "status": "completed", "tag": "96fa324f-1235-4750-a242-7810d3d32273"}]} {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:18:13.823883 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [req-9128ec2a-4ba7-498f-88b2-16f555dd995e req-2f6185c9-c06f-49f9-b6d4-3649080dcb3f service nova] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:18:13.824399 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [req-9128ec2a-4ba7-498f-88b2-16f555dd995e req-2f6185c9-c06f-49f9-b6d4-3649080dcb3f service nova] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:18:13.836459 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.compute.server_external_events [req-9128ec2a-4ba7-498f-88b2-16f555dd995e req-2f6185c9-c06f-49f9-b6d4-3649080dcb3f service nova] Creating event network-vif-plugged:96fa324f-1235-4750-a242-7810d3d32273 for instance 0b2e66bb-efd5-4ff0-8163-5973db8e0db7 on hv-cinder-84713 Jun 22 10:18:13.841489 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [req-9128ec2a-4ba7-498f-88b2-16f555dd995e req-2f6185c9-c06f-49f9-b6d4-3649080dcb3f service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034483 Jun 22 10:18:13.842505 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 177/336] 10.222.0.43 () {64 vars in 1317 bytes} [Wed Jun 22 10:18:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 10:18:14.252208 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-24ac3e18-f224-4b52-9c0e-4fd789b6e2ed tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Calling method '>' {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:18:14.252945 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.compute.api [None req-24ac3e18-f224-4b52-9c0e-4fd789b6e2ed tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] [instance: 0b2e66bb-efd5-4ff0-8163-5973db8e0db7] Fetching instance by UUID {{(pid=117874) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:18:14.262697 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-24ac3e18-f224-4b52-9c0e-4fd789b6e2ed tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:18:14.263414 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-24ac3e18-f224-4b52-9c0e-4fd789b6e2ed tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:18:14.264174 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-24ac3e18-f224-4b52-9c0e-4fd789b6e2ed tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:18:14.264758 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-24ac3e18-f224-4b52-9c0e-4fd789b6e2ed tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:18:14.450667 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.network.neutron [None req-407e0a6e-4d9e-40ec-9e44-506dedb01e5e tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] validate_networks() for [('4f5c1d12-de71-40fa-95b0-3e1b37dac412', None, None, None, None, None)] {{(pid=117873) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 22 10:18:14.455981 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.policy [None req-24ac3e18-f224-4b52-9c0e-4fd789b6e2ed tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7be3d844dcee4d19966fc7944463a0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78629282e2b74418a2c1cdac32576ef1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117874) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:18:14.464173 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [None req-24ac3e18-f224-4b52-9c0e-4fd789b6e2ed tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] 10.222.0.43 "GET /compute/v2.1/servers/0b2e66bb-efd5-4ff0-8163-5973db8e0db7" status: 200 len: 1367 microversion: 2.1 time: 0.216475 Jun 22 10:18:14.467787 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 178/337] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:18:14 2022] GET /compute/v2.1/servers/0b2e66bb-efd5-4ff0-8163-5973db8e0db7 => generated 1367 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 10:18:14.485217 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-b8d8ff46-dff9-46c3-abf2-45b006ac15ba tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Calling method '>' {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:18:14.485965 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.compute.api [None req-b8d8ff46-dff9-46c3-abf2-45b006ac15ba tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] [instance: 73dbd5ab-5688-4de4-9da2-0b89d7cefb11] Fetching instance by UUID {{(pid=117874) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:18:14.487835 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG dbcounter [-] [117874] Writing DB stats nova_api:SELECT=74 {{(pid=117874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:18:14.492997 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-b8d8ff46-dff9-46c3-abf2-45b006ac15ba tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:18:14.493577 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-b8d8ff46-dff9-46c3-abf2-45b006ac15ba tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:18:14.494472 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-b8d8ff46-dff9-46c3-abf2-45b006ac15ba tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:18:14.495147 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-b8d8ff46-dff9-46c3-abf2-45b006ac15ba tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:18:14.825466 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.policy [None req-b8d8ff46-dff9-46c3-abf2-45b006ac15ba tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75753b29a78640df9622d4e2655baf9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee9d603d9cc4a8797f55d544f189720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117874) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:18:14.834785 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.policy [None req-b8d8ff46-dff9-46c3-abf2-45b006ac15ba tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75753b29a78640df9622d4e2655baf9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee9d603d9cc4a8797f55d544f189720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117874) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:18:14.836283 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.policy [None req-b8d8ff46-dff9-46c3-abf2-45b006ac15ba tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75753b29a78640df9622d4e2655baf9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee9d603d9cc4a8797f55d544f189720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117874) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:18:14.837455 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [None req-b8d8ff46-dff9-46c3-abf2-45b006ac15ba tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] 10.222.0.43 "GET /compute/v2.1/servers/73dbd5ab-5688-4de4-9da2-0b89d7cefb11" status: 200 len: 1740 microversion: 2.20 time: 0.356098 Jun 22 10:18:14.852913 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 179/338] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jun 22 10:18:14 2022] GET /compute/v2.1/servers/73dbd5ab-5688-4de4-9da2-0b89d7cefb11 => generated 1740 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 22 10:18:15.069128 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.virt.hardware [None req-407e0a6e-4d9e-40ec-9e44-506dedb01e5e tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Flavor limits 0:0:0 {{(pid=117873) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 22 10:18:15.069553 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.virt.hardware [None req-407e0a6e-4d9e-40ec-9e44-506dedb01e5e tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Image limits 0:0:0 {{(pid=117873) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 22 10:18:15.070029 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.virt.hardware [None req-407e0a6e-4d9e-40ec-9e44-506dedb01e5e tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Flavor pref 0:0:0 {{(pid=117873) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 22 10:18:15.070430 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.virt.hardware [None req-407e0a6e-4d9e-40ec-9e44-506dedb01e5e tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Image pref 0:0:0 {{(pid=117873) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 22 10:18:15.071200 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.virt.hardware [None req-407e0a6e-4d9e-40ec-9e44-506dedb01e5e tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117873) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 22 10:18:15.081864 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-407e0a6e-4d9e-40ec-9e44-506dedb01e5e tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:18:15.082543 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-407e0a6e-4d9e-40ec-9e44-506dedb01e5e tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:18:15.083494 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-407e0a6e-4d9e-40ec-9e44-506dedb01e5e tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:18:15.084086 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-407e0a6e-4d9e-40ec-9e44-506dedb01e5e tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:18:15.114510 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.quota [None req-407e0a6e-4d9e-40ec-9e44-506dedb01e5e tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Getting quotas for project c3277b9cbc4b4a8bbacee8440cea1ed2. Resources: {'instances', 'cores', 'ram'} {{(pid=117873) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 22 10:18:15.119129 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.quota [None req-407e0a6e-4d9e-40ec-9e44-506dedb01e5e tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Getting quotas for user 0d7292401816437fba46d073c4746e45 and project c3277b9cbc4b4a8bbacee8440cea1ed2. Resources: {'instances', 'cores', 'ram'} {{(pid=117873) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 22 10:18:15.156611 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.compute.api [None req-407e0a6e-4d9e-40ec-9e44-506dedb01e5e tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Going to run 1 instances... {{(pid=117873) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 22 10:18:15.166236 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.compute.api [None req-407e0a6e-4d9e-40ec-9e44-506dedb01e5e tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] [instance: 86a421a6-9b8c-40a9-ab7e-30b74c7bd0f3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='22d2c064-5bf7-438e-bbb7-47259e4bdab5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117873) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 22 10:18:15.179523 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-98859617-d2ec-4a19-9956-209db9243b69 tempest-VolumesActionsTest-1453826651 tempest-VolumesActionsTest-1453826651-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-320056072", "imageRef": "22d2c064-5bf7-438e-bbb7-47259e4bdab5", "flavorRef": "452", "networks": [{"uuid": "e3bd5741-bd96-458e-92f1-363af9f36a6d"}]}} {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:18:15.238952 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [None req-407e0a6e-4d9e-40ec-9e44-506dedb01e5e tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 3.273925 Jun 22 10:18:15.240192 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 160/339] 10.222.0.43 () {60 vars in 1146 bytes} [Wed Jun 22 10:18:11 2022] POST /compute/v2.1/servers => generated 409 bytes in 3276 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 22 10:18:15.254223 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-f43b1119-61b0-41ca-b1d8-af6bfb88def8 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Calling method '>' {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:18:15.255177 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.compute.api [None req-f43b1119-61b0-41ca-b1d8-af6bfb88def8 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] [instance: 86a421a6-9b8c-40a9-ab7e-30b74c7bd0f3] Fetching instance by UUID {{(pid=117873) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:18:15.258786 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG dbcounter [-] [117873] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=8 {{(pid=117873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:18:15.270316 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.network.neutron [None req-98859617-d2ec-4a19-9956-209db9243b69 tempest-VolumesActionsTest-1453826651 tempest-VolumesActionsTest-1453826651-project] validate_networks() for [('e3bd5741-bd96-458e-92f1-363af9f36a6d', None, None, None, None, None)] {{(pid=117874) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 22 10:18:15.415598 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.policy [None req-f43b1119-61b0-41ca-b1d8-af6bfb88def8 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d7292401816437fba46d073c4746e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3277b9cbc4b4a8bbacee8440cea1ed2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117873) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:18:15.426937 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [None req-f43b1119-61b0-41ca-b1d8-af6bfb88def8 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] 10.222.0.43 "GET /compute/v2.1/servers/86a421a6-9b8c-40a9-ab7e-30b74c7bd0f3" status: 200 len: 1246 microversion: 2.1 time: 0.177092 Jun 22 10:18:15.430428 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 161/340] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:18:15 2022] GET /compute/v2.1/servers/86a421a6-9b8c-40a9-ab7e-30b74c7bd0f3 => generated 1246 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:18:15.516559 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-54890d50-2ee9-433b-9cbc-c33f73cb63bf tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Calling method '>' {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:18:15.522102 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.compute.api [None req-54890d50-2ee9-433b-9cbc-c33f73cb63bf tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] [instance: 0b2e66bb-efd5-4ff0-8163-5973db8e0db7] Fetching instance by UUID {{(pid=117873) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:18:15.535173 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-54890d50-2ee9-433b-9cbc-c33f73cb63bf tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:18:15.535869 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-54890d50-2ee9-433b-9cbc-c33f73cb63bf tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:18:15.536831 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-54890d50-2ee9-433b-9cbc-c33f73cb63bf tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:18:15.537960 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-54890d50-2ee9-433b-9cbc-c33f73cb63bf tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:18:16.077753 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.policy [None req-54890d50-2ee9-433b-9cbc-c33f73cb63bf tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7be3d844dcee4d19966fc7944463a0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78629282e2b74418a2c1cdac32576ef1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117873) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:18:16.088211 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [None req-54890d50-2ee9-433b-9cbc-c33f73cb63bf tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] 10.222.0.43 "GET /compute/v2.1/servers/0b2e66bb-efd5-4ff0-8163-5973db8e0db7" status: 200 len: 1367 microversion: 2.1 time: 0.607033 Jun 22 10:18:16.089050 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 162/341] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:18:15 2022] GET /compute/v2.1/servers/0b2e66bb-efd5-4ff0-8163-5973db8e0db7 => generated 1367 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:18:16.096343 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-0f67381e-e497-44b2-ad3f-659dc726404d tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Calling method '>' {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:18:16.096945 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.compute.api [None req-0f67381e-e497-44b2-ad3f-659dc726404d tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] [instance: 73dbd5ab-5688-4de4-9da2-0b89d7cefb11] Fetching instance by UUID {{(pid=117873) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:18:16.115516 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-0f67381e-e497-44b2-ad3f-659dc726404d tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:18:16.116268 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-0f67381e-e497-44b2-ad3f-659dc726404d tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:18:16.117249 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-0f67381e-e497-44b2-ad3f-659dc726404d tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:18:16.117955 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-0f67381e-e497-44b2-ad3f-659dc726404d tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:18:16.123620 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.virt.hardware [None req-98859617-d2ec-4a19-9956-209db9243b69 tempest-VolumesActionsTest-1453826651 tempest-VolumesActionsTest-1453826651-project] Flavor limits 0:0:0 {{(pid=117874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 22 10:18:16.124221 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.virt.hardware [None req-98859617-d2ec-4a19-9956-209db9243b69 tempest-VolumesActionsTest-1453826651 tempest-VolumesActionsTest-1453826651-project] Image limits 0:0:0 {{(pid=117874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 22 10:18:16.124841 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.virt.hardware [None req-98859617-d2ec-4a19-9956-209db9243b69 tempest-VolumesActionsTest-1453826651 tempest-VolumesActionsTest-1453826651-project] Flavor pref 0:0:0 {{(pid=117874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 22 10:18:16.125558 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.virt.hardware [None req-98859617-d2ec-4a19-9956-209db9243b69 tempest-VolumesActionsTest-1453826651 tempest-VolumesActionsTest-1453826651-project] Image pref 0:0:0 {{(pid=117874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 22 10:18:16.126614 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.virt.hardware [None req-98859617-d2ec-4a19-9956-209db9243b69 tempest-VolumesActionsTest-1453826651 tempest-VolumesActionsTest-1453826651-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 22 10:18:16.149847 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-98859617-d2ec-4a19-9956-209db9243b69 tempest-VolumesActionsTest-1453826651 tempest-VolumesActionsTest-1453826651-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:18:16.150857 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-98859617-d2ec-4a19-9956-209db9243b69 tempest-VolumesActionsTest-1453826651 tempest-VolumesActionsTest-1453826651-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:18:16.151950 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-98859617-d2ec-4a19-9956-209db9243b69 tempest-VolumesActionsTest-1453826651 tempest-VolumesActionsTest-1453826651-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:18:16.152507 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-98859617-d2ec-4a19-9956-209db9243b69 tempest-VolumesActionsTest-1453826651 tempest-VolumesActionsTest-1453826651-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:18:16.185741 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.quota [None req-98859617-d2ec-4a19-9956-209db9243b69 tempest-VolumesActionsTest-1453826651 tempest-VolumesActionsTest-1453826651-project] Getting quotas for project 0b75addf2f334d7cb584ccae7779d3f1. Resources: {'instances', 'cores', 'ram'} {{(pid=117874) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 22 10:18:16.191406 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.quota [None req-98859617-d2ec-4a19-9956-209db9243b69 tempest-VolumesActionsTest-1453826651 tempest-VolumesActionsTest-1453826651-project] Getting quotas for user f9517119110f4ab99bff1379d5f7e241 and project 0b75addf2f334d7cb584ccae7779d3f1. Resources: {'instances', 'cores', 'ram'} {{(pid=117874) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 22 10:18:16.226453 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.compute.api [None req-98859617-d2ec-4a19-9956-209db9243b69 tempest-VolumesActionsTest-1453826651 tempest-VolumesActionsTest-1453826651-project] Going to run 1 instances... {{(pid=117874) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 22 10:18:16.229013 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.compute.api [None req-98859617-d2ec-4a19-9956-209db9243b69 tempest-VolumesActionsTest-1453826651 tempest-VolumesActionsTest-1453826651-project] [instance: 884a31e3-235c-4ca6-84e5-3dbdcd403d4d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='22d2c064-5bf7-438e-bbb7-47259e4bdab5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117874) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 22 10:18:16.341792 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.policy [None req-0f67381e-e497-44b2-ad3f-659dc726404d tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75753b29a78640df9622d4e2655baf9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee9d603d9cc4a8797f55d544f189720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117873) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:18:16.356261 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.policy [None req-0f67381e-e497-44b2-ad3f-659dc726404d tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75753b29a78640df9622d4e2655baf9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee9d603d9cc4a8797f55d544f189720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117873) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:18:16.358000 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.policy [None req-0f67381e-e497-44b2-ad3f-659dc726404d tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75753b29a78640df9622d4e2655baf9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee9d603d9cc4a8797f55d544f189720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117873) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:18:16.359464 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [None req-0f67381e-e497-44b2-ad3f-659dc726404d tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] 10.222.0.43 "GET /compute/v2.1/servers/73dbd5ab-5688-4de4-9da2-0b89d7cefb11" status: 200 len: 1740 microversion: 2.20 time: 0.269213 Jun 22 10:18:16.360179 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 163/342] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jun 22 10:18:16 2022] GET /compute/v2.1/servers/73dbd5ab-5688-4de4-9da2-0b89d7cefb11 => generated 1740 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 10:18:16.392414 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [None req-98859617-d2ec-4a19-9956-209db9243b69 tempest-VolumesActionsTest-1453826651 tempest-VolumesActionsTest-1453826651-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.216964 Jun 22 10:18:16.393094 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 180/343] 10.222.0.43 () {60 vars in 1146 bytes} [Wed Jun 22 10:18:15 2022] POST /compute/v2.1/servers => generated 380 bytes in 1219 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 22 10:18:16.404029 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-06117aa8-db80-434c-b51e-17ffdc8b19a5 tempest-VolumesActionsTest-1453826651 tempest-VolumesActionsTest-1453826651-project] Calling method '>' {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:18:16.404973 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.compute.api [None req-06117aa8-db80-434c-b51e-17ffdc8b19a5 tempest-VolumesActionsTest-1453826651 tempest-VolumesActionsTest-1453826651-project] [instance: 884a31e3-235c-4ca6-84e5-3dbdcd403d4d] Fetching instance by UUID {{(pid=117873) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:18:16.449881 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-9eb4da9b-6f03-4e5d-90a5-e3949831601c tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Calling method '>' {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:18:16.450463 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.compute.api [None req-9eb4da9b-6f03-4e5d-90a5-e3949831601c tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] [instance: 86a421a6-9b8c-40a9-ab7e-30b74c7bd0f3] Fetching instance by UUID {{(pid=117874) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:18:16.476515 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-9eb4da9b-6f03-4e5d-90a5-e3949831601c tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:18:16.484184 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-9eb4da9b-6f03-4e5d-90a5-e3949831601c tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:18:16.484428 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-9eb4da9b-6f03-4e5d-90a5-e3949831601c tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:18:16.484876 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-9eb4da9b-6f03-4e5d-90a5-e3949831601c tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:18:16.492774 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.policy [None req-06117aa8-db80-434c-b51e-17ffdc8b19a5 tempest-VolumesActionsTest-1453826651 tempest-VolumesActionsTest-1453826651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9517119110f4ab99bff1379d5f7e241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b75addf2f334d7cb584ccae7779d3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117873) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:18:16.502864 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [None req-06117aa8-db80-434c-b51e-17ffdc8b19a5 tempest-VolumesActionsTest-1453826651 tempest-VolumesActionsTest-1453826651-project] 10.222.0.43 "GET /compute/v2.1/servers/884a31e3-235c-4ca6-84e5-3dbdcd403d4d" status: 200 len: 1213 microversion: 2.1 time: 0.102011 Jun 22 10:18:16.504062 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 164/344] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:18:16 2022] GET /compute/v2.1/servers/884a31e3-235c-4ca6-84e5-3dbdcd403d4d => generated 1213 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:18:16.596503 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.policy [None req-9eb4da9b-6f03-4e5d-90a5-e3949831601c tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d7292401816437fba46d073c4746e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3277b9cbc4b4a8bbacee8440cea1ed2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117874) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:18:16.605091 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [None req-9eb4da9b-6f03-4e5d-90a5-e3949831601c tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] 10.222.0.43 "GET /compute/v2.1/servers/86a421a6-9b8c-40a9-ab7e-30b74c7bd0f3" status: 200 len: 1298 microversion: 2.1 time: 0.159571 Jun 22 10:18:16.606647 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 181/345] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:18:16 2022] GET /compute/v2.1/servers/86a421a6-9b8c-40a9-ab7e-30b74c7bd0f3 => generated 1298 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 10:18:17.107774 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-e8c24a24-bc69-4f0b-b831-1881bbdedfc1 tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Calling method '>' {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:18:17.109767 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.compute.api [None req-e8c24a24-bc69-4f0b-b831-1881bbdedfc1 tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] [instance: 0b2e66bb-efd5-4ff0-8163-5973db8e0db7] Fetching instance by UUID {{(pid=117873) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:18:17.120609 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-e8c24a24-bc69-4f0b-b831-1881bbdedfc1 tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:18:17.121383 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-e8c24a24-bc69-4f0b-b831-1881bbdedfc1 tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:18:17.122797 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-e8c24a24-bc69-4f0b-b831-1881bbdedfc1 tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:18:17.123390 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-e8c24a24-bc69-4f0b-b831-1881bbdedfc1 tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:18:17.309188 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.policy [None req-e8c24a24-bc69-4f0b-b831-1881bbdedfc1 tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7be3d844dcee4d19966fc7944463a0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78629282e2b74418a2c1cdac32576ef1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117873) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:18:17.319392 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [None req-e8c24a24-bc69-4f0b-b831-1881bbdedfc1 tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] 10.222.0.43 "GET /compute/v2.1/servers/0b2e66bb-efd5-4ff0-8163-5973db8e0db7" status: 200 len: 1556 microversion: 2.1 time: 0.217124 Jun 22 10:18:17.320422 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 165/346] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:18:17 2022] GET /compute/v2.1/servers/0b2e66bb-efd5-4ff0-8163-5973db8e0db7 => generated 1556 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:18:17.339508 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-840e5b2e-f8c9-4f71-b52a-1a73eedbee57 tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Calling method '>' {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:18:17.340525 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.compute.api [None req-840e5b2e-f8c9-4f71-b52a-1a73eedbee57 tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] [instance: 0b2e66bb-efd5-4ff0-8163-5973db8e0db7] Fetching instance by UUID {{(pid=117874) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:18:17.363895 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-840e5b2e-f8c9-4f71-b52a-1a73eedbee57 tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:18:17.364579 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-840e5b2e-f8c9-4f71-b52a-1a73eedbee57 tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:18:17.365560 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-840e5b2e-f8c9-4f71-b52a-1a73eedbee57 tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:18:17.366641 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-840e5b2e-f8c9-4f71-b52a-1a73eedbee57 tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:18:17.378754 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-8d7ac64e-f44c-40fe-bf45-83d83b32fd25 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Calling method '>' {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:18:17.380285 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.compute.api [None req-8d7ac64e-f44c-40fe-bf45-83d83b32fd25 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] [instance: 73dbd5ab-5688-4de4-9da2-0b89d7cefb11] Fetching instance by UUID {{(pid=117873) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:18:17.390859 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-8d7ac64e-f44c-40fe-bf45-83d83b32fd25 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:18:17.394745 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-8d7ac64e-f44c-40fe-bf45-83d83b32fd25 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:18:17.396903 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-8d7ac64e-f44c-40fe-bf45-83d83b32fd25 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:18:17.398093 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-8d7ac64e-f44c-40fe-bf45-83d83b32fd25 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:18:17.505933 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [None req-840e5b2e-f8c9-4f71-b52a-1a73eedbee57 tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] 10.222.0.43 "GET /compute/v2.1/servers/0b2e66bb-efd5-4ff0-8163-5973db8e0db7/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.170288 Jun 22 10:18:17.512303 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 182/347] 10.222.0.43 () {58 vars in 1274 bytes} [Wed Jun 22 10:18:17 2022] GET /compute/v2.1/servers/0b2e66bb-efd5-4ff0-8163-5973db8e0db7/os-interface => generated 284 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 10:18:17.521748 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-0985c1e5-b760-4ed7-8610-43f958cb9ab3 tempest-VolumesActionsTest-1453826651 tempest-VolumesActionsTest-1453826651-project] Calling method '>' {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:18:17.523103 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.compute.api [None req-0985c1e5-b760-4ed7-8610-43f958cb9ab3 tempest-VolumesActionsTest-1453826651 tempest-VolumesActionsTest-1453826651-project] [instance: 884a31e3-235c-4ca6-84e5-3dbdcd403d4d] Fetching instance by UUID {{(pid=117874) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:18:17.531374 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-0985c1e5-b760-4ed7-8610-43f958cb9ab3 tempest-VolumesActionsTest-1453826651 tempest-VolumesActionsTest-1453826651-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:18:17.536130 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-0985c1e5-b760-4ed7-8610-43f958cb9ab3 tempest-VolumesActionsTest-1453826651 tempest-VolumesActionsTest-1453826651-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:18:17.537870 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-0985c1e5-b760-4ed7-8610-43f958cb9ab3 tempest-VolumesActionsTest-1453826651 tempest-VolumesActionsTest-1453826651-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:18:17.538602 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-0985c1e5-b760-4ed7-8610-43f958cb9ab3 tempest-VolumesActionsTest-1453826651 tempest-VolumesActionsTest-1453826651-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:18:17.712339 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.policy [None req-0985c1e5-b760-4ed7-8610-43f958cb9ab3 tempest-VolumesActionsTest-1453826651 tempest-VolumesActionsTest-1453826651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9517119110f4ab99bff1379d5f7e241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b75addf2f334d7cb584ccae7779d3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117874) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:18:17.727763 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [None req-0985c1e5-b760-4ed7-8610-43f958cb9ab3 tempest-VolumesActionsTest-1453826651 tempest-VolumesActionsTest-1453826651-project] 10.222.0.43 "GET /compute/v2.1/servers/884a31e3-235c-4ca6-84e5-3dbdcd403d4d" status: 200 len: 1265 microversion: 2.1 time: 0.210737 Jun 22 10:18:17.729793 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 183/348] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:18:17 2022] GET /compute/v2.1/servers/884a31e3-235c-4ca6-84e5-3dbdcd403d4d => generated 1265 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 10:18:17.736782 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-cf55dd33-a241-44ba-b2d9-79cedc7fbe89 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Calling method '>' {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:18:17.737952 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.compute.api [None req-cf55dd33-a241-44ba-b2d9-79cedc7fbe89 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] [instance: 86a421a6-9b8c-40a9-ab7e-30b74c7bd0f3] Fetching instance by UUID {{(pid=117874) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:18:17.744936 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-cf55dd33-a241-44ba-b2d9-79cedc7fbe89 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:18:17.745800 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-cf55dd33-a241-44ba-b2d9-79cedc7fbe89 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:18:17.747119 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-cf55dd33-a241-44ba-b2d9-79cedc7fbe89 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:18:17.748258 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-cf55dd33-a241-44ba-b2d9-79cedc7fbe89 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:18:17.832088 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.policy [None req-8d7ac64e-f44c-40fe-bf45-83d83b32fd25 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75753b29a78640df9622d4e2655baf9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee9d603d9cc4a8797f55d544f189720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117873) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:18:17.842342 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.policy [None req-8d7ac64e-f44c-40fe-bf45-83d83b32fd25 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75753b29a78640df9622d4e2655baf9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee9d603d9cc4a8797f55d544f189720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117873) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:18:17.851546 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.policy [None req-8d7ac64e-f44c-40fe-bf45-83d83b32fd25 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75753b29a78640df9622d4e2655baf9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee9d603d9cc4a8797f55d544f189720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117873) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:18:17.852773 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [None req-8d7ac64e-f44c-40fe-bf45-83d83b32fd25 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] 10.222.0.43 "GET /compute/v2.1/servers/73dbd5ab-5688-4de4-9da2-0b89d7cefb11" status: 200 len: 1740 microversion: 2.20 time: 0.478774 Jun 22 10:18:17.858302 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 166/349] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jun 22 10:18:17 2022] GET /compute/v2.1/servers/73dbd5ab-5688-4de4-9da2-0b89d7cefb11 => generated 1740 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 22 10:18:18.176404 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.policy [None req-cf55dd33-a241-44ba-b2d9-79cedc7fbe89 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d7292401816437fba46d073c4746e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3277b9cbc4b4a8bbacee8440cea1ed2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117874) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:18:18.183955 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [None req-cf55dd33-a241-44ba-b2d9-79cedc7fbe89 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] 10.222.0.43 "GET /compute/v2.1/servers/86a421a6-9b8c-40a9-ab7e-30b74c7bd0f3" status: 200 len: 1372 microversion: 2.1 time: 0.452901 Jun 22 10:18:18.184535 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 184/350] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:18:17 2022] GET /compute/v2.1/servers/86a421a6-9b8c-40a9-ab7e-30b74c7bd0f3 => generated 1372 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:18:18.748340 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-361f064d-5621-4d0d-9707-5e689664da18 tempest-VolumesActionsTest-1453826651 tempest-VolumesActionsTest-1453826651-project] Calling method '>' {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:18:18.750019 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.compute.api [None req-361f064d-5621-4d0d-9707-5e689664da18 tempest-VolumesActionsTest-1453826651 tempest-VolumesActionsTest-1453826651-project] [instance: 884a31e3-235c-4ca6-84e5-3dbdcd403d4d] Fetching instance by UUID {{(pid=117873) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:18:18.763328 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-361f064d-5621-4d0d-9707-5e689664da18 tempest-VolumesActionsTest-1453826651 tempest-VolumesActionsTest-1453826651-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:18:18.765719 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-361f064d-5621-4d0d-9707-5e689664da18 tempest-VolumesActionsTest-1453826651 tempest-VolumesActionsTest-1453826651-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:18:18.767514 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-361f064d-5621-4d0d-9707-5e689664da18 tempest-VolumesActionsTest-1453826651 tempest-VolumesActionsTest-1453826651-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:18:18.770495 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-361f064d-5621-4d0d-9707-5e689664da18 tempest-VolumesActionsTest-1453826651 tempest-VolumesActionsTest-1453826651-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:18:18.881817 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-da6ee72b-87af-4331-9b12-0012c86af946 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Calling method '>' {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:18:18.884961 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.compute.api [None req-da6ee72b-87af-4331-9b12-0012c86af946 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] [instance: 73dbd5ab-5688-4de4-9da2-0b89d7cefb11] Fetching instance by UUID {{(pid=117874) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:18:18.913431 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-da6ee72b-87af-4331-9b12-0012c86af946 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:18:18.914351 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-da6ee72b-87af-4331-9b12-0012c86af946 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:18:18.915889 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-da6ee72b-87af-4331-9b12-0012c86af946 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:18:18.916331 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-da6ee72b-87af-4331-9b12-0012c86af946 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:18:19.012816 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.policy [None req-361f064d-5621-4d0d-9707-5e689664da18 tempest-VolumesActionsTest-1453826651 tempest-VolumesActionsTest-1453826651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9517119110f4ab99bff1379d5f7e241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b75addf2f334d7cb584ccae7779d3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117873) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:18:19.029470 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [None req-361f064d-5621-4d0d-9707-5e689664da18 tempest-VolumesActionsTest-1453826651 tempest-VolumesActionsTest-1453826651-project] 10.222.0.43 "GET /compute/v2.1/servers/884a31e3-235c-4ca6-84e5-3dbdcd403d4d" status: 200 len: 1271 microversion: 2.1 time: 0.287332 Jun 22 10:18:19.046046 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 167/351] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:18:18 2022] GET /compute/v2.1/servers/884a31e3-235c-4ca6-84e5-3dbdcd403d4d => generated 1271 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:18:19.202139 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-9293166a-faa0-4d40-85b5-df0f4b3ce0e5 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Calling method '>' {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:18:19.203580 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.compute.api [None req-9293166a-faa0-4d40-85b5-df0f4b3ce0e5 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] [instance: 86a421a6-9b8c-40a9-ab7e-30b74c7bd0f3] Fetching instance by UUID {{(pid=117873) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:18:19.230325 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-9293166a-faa0-4d40-85b5-df0f4b3ce0e5 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:18:19.230691 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-9293166a-faa0-4d40-85b5-df0f4b3ce0e5 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:18:19.231462 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-9293166a-faa0-4d40-85b5-df0f4b3ce0e5 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:18:19.232391 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-9293166a-faa0-4d40-85b5-df0f4b3ce0e5 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:18:19.271707 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.policy [None req-da6ee72b-87af-4331-9b12-0012c86af946 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75753b29a78640df9622d4e2655baf9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee9d603d9cc4a8797f55d544f189720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117874) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:18:19.293219 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.policy [None req-da6ee72b-87af-4331-9b12-0012c86af946 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75753b29a78640df9622d4e2655baf9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee9d603d9cc4a8797f55d544f189720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117874) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:18:19.294767 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.policy [None req-da6ee72b-87af-4331-9b12-0012c86af946 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75753b29a78640df9622d4e2655baf9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee9d603d9cc4a8797f55d544f189720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117874) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:18:19.295941 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [None req-da6ee72b-87af-4331-9b12-0012c86af946 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] 10.222.0.43 "GET /compute/v2.1/servers/73dbd5ab-5688-4de4-9da2-0b89d7cefb11" status: 200 len: 1740 microversion: 2.20 time: 0.422230 Jun 22 10:18:19.305727 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 185/352] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jun 22 10:18:18 2022] GET /compute/v2.1/servers/73dbd5ab-5688-4de4-9da2-0b89d7cefb11 => generated 1740 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 10:18:19.424291 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [req-d7400df9-0cc2-43f7-9789-6f0a59e2f849 req-f8e325f0-05de-4940-806e-807440b4284c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0b2e66bb-efd5-4ff0-8163-5973db8e0db7", "tag": "96fa324f-1235-4750-a242-7810d3d32273"}]} {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:18:19.441031 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [req-d7400df9-0cc2-43f7-9789-6f0a59e2f849 req-f8e325f0-05de-4940-806e-807440b4284c service nova] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:18:19.442530 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [req-d7400df9-0cc2-43f7-9789-6f0a59e2f849 req-f8e325f0-05de-4940-806e-807440b4284c service nova] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:18:19.475081 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.compute.server_external_events [req-d7400df9-0cc2-43f7-9789-6f0a59e2f849 req-f8e325f0-05de-4940-806e-807440b4284c service nova] Creating event network-changed:96fa324f-1235-4750-a242-7810d3d32273 for instance 0b2e66bb-efd5-4ff0-8163-5973db8e0db7 on hv-cinder-84713 Jun 22 10:18:19.485138 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [req-d7400df9-0cc2-43f7-9789-6f0a59e2f849 req-f8e325f0-05de-4940-806e-807440b4284c service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065224 Jun 22 10:18:19.490980 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 186/353] 10.222.0.43 () {64 vars in 1317 bytes} [Wed Jun 22 10:18:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 22 10:18:19.632125 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [req-d51f4ff5-fada-4e88-8ba2-b714b97ec9ba req-d6481a18-d591-452d-8bf9-e5f94d2dd0f2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "86a421a6-9b8c-40a9-ab7e-30b74c7bd0f3", "tag": "b3cb81b4-fc19-4acc-bb84-84c1f3b739b7"}]} {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:18:19.639557 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.policy [None req-9293166a-faa0-4d40-85b5-df0f4b3ce0e5 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d7292401816437fba46d073c4746e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3277b9cbc4b4a8bbacee8440cea1ed2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117873) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:18:19.664107 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [None req-9293166a-faa0-4d40-85b5-df0f4b3ce0e5 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] 10.222.0.43 "GET /compute/v2.1/servers/86a421a6-9b8c-40a9-ab7e-30b74c7bd0f3" status: 200 len: 1372 microversion: 2.1 time: 0.466779 Jun 22 10:18:19.665202 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 168/354] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:18:19 2022] GET /compute/v2.1/servers/86a421a6-9b8c-40a9-ab7e-30b74c7bd0f3 => generated 1372 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 10:18:19.684580 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [req-d51f4ff5-fada-4e88-8ba2-b714b97ec9ba req-d6481a18-d591-452d-8bf9-e5f94d2dd0f2 service nova] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:18:19.685014 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [req-d51f4ff5-fada-4e88-8ba2-b714b97ec9ba req-d6481a18-d591-452d-8bf9-e5f94d2dd0f2 service nova] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:18:19.714216 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.compute.server_external_events [req-d51f4ff5-fada-4e88-8ba2-b714b97ec9ba req-d6481a18-d591-452d-8bf9-e5f94d2dd0f2 service nova] Creating event network-changed:b3cb81b4-fc19-4acc-bb84-84c1f3b739b7 for instance 86a421a6-9b8c-40a9-ab7e-30b74c7bd0f3 on hv-cinder-84713 Jun 22 10:18:19.726421 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [req-d51f4ff5-fada-4e88-8ba2-b714b97ec9ba req-d6481a18-d591-452d-8bf9-e5f94d2dd0f2 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.103055 Jun 22 10:18:19.728159 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 187/355] 10.222.0.43 () {64 vars in 1317 bytes} [Wed Jun 22 10:18:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 22 10:18:20.054959 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-9a7d0485-221e-490d-8c89-2ae3fe4e1baa tempest-VolumesActionsTest-1453826651 tempest-VolumesActionsTest-1453826651-project] Calling method '>' {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:18:20.055602 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.compute.api [None req-9a7d0485-221e-490d-8c89-2ae3fe4e1baa tempest-VolumesActionsTest-1453826651 tempest-VolumesActionsTest-1453826651-project] [instance: 884a31e3-235c-4ca6-84e5-3dbdcd403d4d] Fetching instance by UUID {{(pid=117873) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:18:20.072842 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-9a7d0485-221e-490d-8c89-2ae3fe4e1baa tempest-VolumesActionsTest-1453826651 tempest-VolumesActionsTest-1453826651-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:18:20.074314 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-9a7d0485-221e-490d-8c89-2ae3fe4e1baa tempest-VolumesActionsTest-1453826651 tempest-VolumesActionsTest-1453826651-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:18:20.075584 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-9a7d0485-221e-490d-8c89-2ae3fe4e1baa tempest-VolumesActionsTest-1453826651 tempest-VolumesActionsTest-1453826651-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:18:20.076261 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-9a7d0485-221e-490d-8c89-2ae3fe4e1baa tempest-VolumesActionsTest-1453826651 tempest-VolumesActionsTest-1453826651-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:18:20.322550 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-0051bee1-de74-4004-83e4-389e8748f147 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Calling method '>' {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:18:20.323619 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.compute.api [None req-0051bee1-de74-4004-83e4-389e8748f147 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] [instance: 73dbd5ab-5688-4de4-9da2-0b89d7cefb11] Fetching instance by UUID {{(pid=117874) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:18:20.334863 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.policy [None req-9a7d0485-221e-490d-8c89-2ae3fe4e1baa tempest-VolumesActionsTest-1453826651 tempest-VolumesActionsTest-1453826651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9517119110f4ab99bff1379d5f7e241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b75addf2f334d7cb584ccae7779d3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117873) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:18:20.359083 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [None req-9a7d0485-221e-490d-8c89-2ae3fe4e1baa tempest-VolumesActionsTest-1453826651 tempest-VolumesActionsTest-1453826651-project] 10.222.0.43 "GET /compute/v2.1/servers/884a31e3-235c-4ca6-84e5-3dbdcd403d4d" status: 200 len: 1313 microversion: 2.1 time: 0.311471 Jun 22 10:18:20.361738 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-0051bee1-de74-4004-83e4-389e8748f147 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:18:20.364322 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 169/356] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:18:20 2022] GET /compute/v2.1/servers/884a31e3-235c-4ca6-84e5-3dbdcd403d4d => generated 1313 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:18:20.365000 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-0051bee1-de74-4004-83e4-389e8748f147 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:18:20.366156 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-0051bee1-de74-4004-83e4-389e8748f147 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:18:20.366797 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-0051bee1-de74-4004-83e4-389e8748f147 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:18:20.633017 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.policy [None req-0051bee1-de74-4004-83e4-389e8748f147 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75753b29a78640df9622d4e2655baf9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee9d603d9cc4a8797f55d544f189720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117874) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:18:20.646237 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.policy [None req-0051bee1-de74-4004-83e4-389e8748f147 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75753b29a78640df9622d4e2655baf9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee9d603d9cc4a8797f55d544f189720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117874) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:18:20.654272 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.policy [None req-0051bee1-de74-4004-83e4-389e8748f147 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75753b29a78640df9622d4e2655baf9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee9d603d9cc4a8797f55d544f189720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117874) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:18:20.656347 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [None req-0051bee1-de74-4004-83e4-389e8748f147 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] 10.222.0.43 "GET /compute/v2.1/servers/73dbd5ab-5688-4de4-9da2-0b89d7cefb11" status: 200 len: 1740 microversion: 2.20 time: 0.339179 Jun 22 10:18:20.658400 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 188/357] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jun 22 10:18:20 2022] GET /compute/v2.1/servers/73dbd5ab-5688-4de4-9da2-0b89d7cefb11 => generated 1740 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 10:18:20.686399 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-b397998e-a00f-452e-bfde-29ab9d59457e tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Calling method '>' {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:18:20.687011 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.compute.api [None req-b397998e-a00f-452e-bfde-29ab9d59457e tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] [instance: 86a421a6-9b8c-40a9-ab7e-30b74c7bd0f3] Fetching instance by UUID {{(pid=117873) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:18:20.699025 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-b397998e-a00f-452e-bfde-29ab9d59457e tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:18:20.700068 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-b397998e-a00f-452e-bfde-29ab9d59457e tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:18:20.700855 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-b397998e-a00f-452e-bfde-29ab9d59457e tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:18:20.701286 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-b397998e-a00f-452e-bfde-29ab9d59457e tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:18:20.867611 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.policy [None req-b397998e-a00f-452e-bfde-29ab9d59457e tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d7292401816437fba46d073c4746e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3277b9cbc4b4a8bbacee8440cea1ed2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117873) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:18:20.876095 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [None req-b397998e-a00f-452e-bfde-29ab9d59457e tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] 10.222.0.43 "GET /compute/v2.1/servers/86a421a6-9b8c-40a9-ab7e-30b74c7bd0f3" status: 200 len: 1372 microversion: 2.1 time: 0.193503 Jun 22 10:18:20.878436 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 170/358] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:18:20 2022] GET /compute/v2.1/servers/86a421a6-9b8c-40a9-ab7e-30b74c7bd0f3 => generated 1372 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:18:21.056537 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-89b0a355-1054-4809-869e-7902116e2c49 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:18:21.064719 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-89b0a355-1054-4809-869e-7902116e2c49 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:18:21.069033 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-89b0a355-1054-4809-869e-7902116e2c49 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:18:21.310114 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.compute.api [None req-89b0a355-1054-4809-869e-7902116e2c49 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] [instance: eb851ab6-0e89-41d2-be52-d76cdc8644d6] Going to try to stop instance {{(pid=117874) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jun 22 10:18:21.392214 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-9a0d9f71-8f31-4079-9ce0-49bf38cbb1e9 tempest-VolumesActionsTest-1453826651 tempest-VolumesActionsTest-1453826651-project] Calling method '>' {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:18:21.395241 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.compute.api [None req-9a0d9f71-8f31-4079-9ce0-49bf38cbb1e9 tempest-VolumesActionsTest-1453826651 tempest-VolumesActionsTest-1453826651-project] [instance: 884a31e3-235c-4ca6-84e5-3dbdcd403d4d] Fetching instance by UUID {{(pid=117873) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:18:21.409912 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-9a0d9f71-8f31-4079-9ce0-49bf38cbb1e9 tempest-VolumesActionsTest-1453826651 tempest-VolumesActionsTest-1453826651-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:18:21.410750 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-9a0d9f71-8f31-4079-9ce0-49bf38cbb1e9 tempest-VolumesActionsTest-1453826651 tempest-VolumesActionsTest-1453826651-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:18:21.412238 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-9a0d9f71-8f31-4079-9ce0-49bf38cbb1e9 tempest-VolumesActionsTest-1453826651 tempest-VolumesActionsTest-1453826651-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:18:21.412947 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-9a0d9f71-8f31-4079-9ce0-49bf38cbb1e9 tempest-VolumesActionsTest-1453826651 tempest-VolumesActionsTest-1453826651-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:18:21.429577 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [None req-89b0a355-1054-4809-869e-7902116e2c49 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] 10.222.0.43 "POST /compute/v2.1/servers/eb851ab6-0e89-41d2-be52-d76cdc8644d6/action" status: 202 len: 0 microversion: 2.1 time: 0.376872 Jun 22 10:18:21.430519 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 189/359] 10.222.0.43 () {60 vars in 1277 bytes} [Wed Jun 22 10:18:21 2022] POST /compute/v2.1/servers/eb851ab6-0e89-41d2-be52-d76cdc8644d6/action => generated 0 bytes in 378 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 22 10:18:21.470625 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-695d9ad9-ae73-4d72-9fca-47f8283b45af tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Calling method '>' {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:18:21.470625 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.compute.api [None req-695d9ad9-ae73-4d72-9fca-47f8283b45af tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] [instance: eb851ab6-0e89-41d2-be52-d76cdc8644d6] Fetching instance by UUID {{(pid=117874) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:18:21.490897 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-695d9ad9-ae73-4d72-9fca-47f8283b45af tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:18:21.491304 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-695d9ad9-ae73-4d72-9fca-47f8283b45af tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:18:21.492076 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-695d9ad9-ae73-4d72-9fca-47f8283b45af tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:18:21.502521 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-695d9ad9-ae73-4d72-9fca-47f8283b45af tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:18:21.794777 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.policy [None req-9a0d9f71-8f31-4079-9ce0-49bf38cbb1e9 tempest-VolumesActionsTest-1453826651 tempest-VolumesActionsTest-1453826651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9517119110f4ab99bff1379d5f7e241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b75addf2f334d7cb584ccae7779d3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117873) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:18:21.803262 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [None req-9a0d9f71-8f31-4079-9ce0-49bf38cbb1e9 tempest-VolumesActionsTest-1453826651 tempest-VolumesActionsTest-1453826651-project] 10.222.0.43 "GET /compute/v2.1/servers/884a31e3-235c-4ca6-84e5-3dbdcd403d4d" status: 200 len: 1313 microversion: 2.1 time: 0.426047 Jun 22 10:18:21.808191 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 171/360] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:18:21 2022] GET /compute/v2.1/servers/884a31e3-235c-4ca6-84e5-3dbdcd403d4d => generated 1313 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:18:21.813047 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-0404461b-675c-48dc-a897-00a832eb49ed tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Calling method '>' {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:18:21.819220 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.policy [None req-695d9ad9-ae73-4d72-9fca-47f8283b45af tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78fe3fc4334c43d7a5ef6d70f9f57523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad52333bcbec425089c44c3e55df97ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117874) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:18:21.830210 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [None req-695d9ad9-ae73-4d72-9fca-47f8283b45af tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] 10.222.0.43 "GET /compute/v2.1/servers/eb851ab6-0e89-41d2-be52-d76cdc8644d6" status: 200 len: 1724 microversion: 2.1 time: 0.389117 Jun 22 10:18:21.831078 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.compute.api [None req-0404461b-675c-48dc-a897-00a832eb49ed tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] [instance: 73dbd5ab-5688-4de4-9da2-0b89d7cefb11] Fetching instance by UUID {{(pid=117873) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:18:21.834620 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 190/361] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:18:21 2022] GET /compute/v2.1/servers/eb851ab6-0e89-41d2-be52-d76cdc8644d6 => generated 1724 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 10:18:21.840961 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-0404461b-675c-48dc-a897-00a832eb49ed tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:18:21.841538 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-0404461b-675c-48dc-a897-00a832eb49ed tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:18:21.842523 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-0404461b-675c-48dc-a897-00a832eb49ed tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:18:21.843194 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-0404461b-675c-48dc-a897-00a832eb49ed tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:18:21.895067 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-d1eb7420-07ee-4138-964a-880f0ef6e8f3 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Calling method '>' {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:18:21.895777 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.compute.api [None req-d1eb7420-07ee-4138-964a-880f0ef6e8f3 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] [instance: 86a421a6-9b8c-40a9-ab7e-30b74c7bd0f3] Fetching instance by UUID {{(pid=117874) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:18:21.905143 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-d1eb7420-07ee-4138-964a-880f0ef6e8f3 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:18:21.918479 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-d1eb7420-07ee-4138-964a-880f0ef6e8f3 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:18:21.919765 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-d1eb7420-07ee-4138-964a-880f0ef6e8f3 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:18:21.920428 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-d1eb7420-07ee-4138-964a-880f0ef6e8f3 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:18:22.143019 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.policy [None req-0404461b-675c-48dc-a897-00a832eb49ed tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75753b29a78640df9622d4e2655baf9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee9d603d9cc4a8797f55d544f189720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117873) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:18:22.152687 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.policy [None req-0404461b-675c-48dc-a897-00a832eb49ed tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75753b29a78640df9622d4e2655baf9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee9d603d9cc4a8797f55d544f189720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117873) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:18:22.154614 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.policy [None req-0404461b-675c-48dc-a897-00a832eb49ed tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75753b29a78640df9622d4e2655baf9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee9d603d9cc4a8797f55d544f189720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117873) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:18:22.156242 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [None req-0404461b-675c-48dc-a897-00a832eb49ed tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] 10.222.0.43 "GET /compute/v2.1/servers/73dbd5ab-5688-4de4-9da2-0b89d7cefb11" status: 200 len: 1740 microversion: 2.20 time: 0.346644 Jun 22 10:18:22.157332 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 172/362] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jun 22 10:18:21 2022] GET /compute/v2.1/servers/73dbd5ab-5688-4de4-9da2-0b89d7cefb11 => generated 1740 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 10:18:22.192768 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.policy [None req-d1eb7420-07ee-4138-964a-880f0ef6e8f3 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d7292401816437fba46d073c4746e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3277b9cbc4b4a8bbacee8440cea1ed2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117874) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:18:22.200794 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [None req-d1eb7420-07ee-4138-964a-880f0ef6e8f3 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] 10.222.0.43 "GET /compute/v2.1/servers/86a421a6-9b8c-40a9-ab7e-30b74c7bd0f3" status: 200 len: 1372 microversion: 2.1 time: 0.309653 Jun 22 10:18:22.212038 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 191/363] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:18:21 2022] GET /compute/v2.1/servers/86a421a6-9b8c-40a9-ab7e-30b74c7bd0f3 => generated 1372 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:18:22.355913 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [req-667ed601-dd4f-42df-b438-922652cf8b02 req-09f4a8b7-19ba-4f1e-a446-63ae6efa7da1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "884a31e3-235c-4ca6-84e5-3dbdcd403d4d", "tag": "4d2f6e47-53cb-4939-a600-4f5f86cf4334"}]} {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:18:22.368009 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [req-667ed601-dd4f-42df-b438-922652cf8b02 req-09f4a8b7-19ba-4f1e-a446-63ae6efa7da1 service nova] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:18:22.368450 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [req-667ed601-dd4f-42df-b438-922652cf8b02 req-09f4a8b7-19ba-4f1e-a446-63ae6efa7da1 service nova] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:18:22.382146 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.compute.server_external_events [req-667ed601-dd4f-42df-b438-922652cf8b02 req-09f4a8b7-19ba-4f1e-a446-63ae6efa7da1 service nova] Creating event network-changed:4d2f6e47-53cb-4939-a600-4f5f86cf4334 for instance 884a31e3-235c-4ca6-84e5-3dbdcd403d4d on hv-cinder-84713 Jun 22 10:18:22.387898 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [req-667ed601-dd4f-42df-b438-922652cf8b02 req-09f4a8b7-19ba-4f1e-a446-63ae6efa7da1 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035767 Jun 22 10:18:22.389192 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 173/364] 10.222.0.43 () {64 vars in 1317 bytes} [Wed Jun 22 10:18:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 22 10:18:22.826980 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-edc0bb82-a84e-4cae-8cff-43251391011a tempest-VolumesActionsTest-1453826651 tempest-VolumesActionsTest-1453826651-project] Calling method '>' {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:18:22.828414 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.compute.api [None req-edc0bb82-a84e-4cae-8cff-43251391011a tempest-VolumesActionsTest-1453826651 tempest-VolumesActionsTest-1453826651-project] [instance: 884a31e3-235c-4ca6-84e5-3dbdcd403d4d] Fetching instance by UUID {{(pid=117874) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:18:22.835939 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-edc0bb82-a84e-4cae-8cff-43251391011a tempest-VolumesActionsTest-1453826651 tempest-VolumesActionsTest-1453826651-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:18:22.836688 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-edc0bb82-a84e-4cae-8cff-43251391011a tempest-VolumesActionsTest-1453826651 tempest-VolumesActionsTest-1453826651-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:18:22.837443 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-edc0bb82-a84e-4cae-8cff-43251391011a tempest-VolumesActionsTest-1453826651 tempest-VolumesActionsTest-1453826651-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:18:22.837937 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-edc0bb82-a84e-4cae-8cff-43251391011a tempest-VolumesActionsTest-1453826651 tempest-VolumesActionsTest-1453826651-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:18:22.854144 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-da2e07e0-d827-4b58-8103-47dad57197a9 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Calling method '>' {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:18:22.855766 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.compute.api [None req-da2e07e0-d827-4b58-8103-47dad57197a9 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] [instance: eb851ab6-0e89-41d2-be52-d76cdc8644d6] Fetching instance by UUID {{(pid=117873) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:18:22.863805 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-da2e07e0-d827-4b58-8103-47dad57197a9 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:18:22.864558 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-da2e07e0-d827-4b58-8103-47dad57197a9 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:18:22.865541 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-da2e07e0-d827-4b58-8103-47dad57197a9 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:18:22.866203 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-da2e07e0-d827-4b58-8103-47dad57197a9 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:18:23.055310 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.policy [None req-edc0bb82-a84e-4cae-8cff-43251391011a tempest-VolumesActionsTest-1453826651 tempest-VolumesActionsTest-1453826651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9517119110f4ab99bff1379d5f7e241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b75addf2f334d7cb584ccae7779d3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117874) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:18:23.065186 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [None req-edc0bb82-a84e-4cae-8cff-43251391011a tempest-VolumesActionsTest-1453826651 tempest-VolumesActionsTest-1453826651-project] 10.222.0.43 "GET /compute/v2.1/servers/884a31e3-235c-4ca6-84e5-3dbdcd403d4d" status: 200 len: 1313 microversion: 2.1 time: 0.241995 Jun 22 10:18:23.066305 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 192/365] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:18:22 2022] GET /compute/v2.1/servers/884a31e3-235c-4ca6-84e5-3dbdcd403d4d => generated 1313 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:18:23.072003 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.policy [None req-da2e07e0-d827-4b58-8103-47dad57197a9 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78fe3fc4334c43d7a5ef6d70f9f57523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad52333bcbec425089c44c3e55df97ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117873) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:18:23.081421 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [None req-da2e07e0-d827-4b58-8103-47dad57197a9 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] 10.222.0.43 "GET /compute/v2.1/servers/eb851ab6-0e89-41d2-be52-d76cdc8644d6" status: 200 len: 1724 microversion: 2.1 time: 0.232668 Jun 22 10:18:23.092313 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 174/366] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:18:22 2022] GET /compute/v2.1/servers/eb851ab6-0e89-41d2-be52-d76cdc8644d6 => generated 1724 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 10:18:23.175466 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-290630e5-cd77-41c5-b8ca-24b3d61c875b tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Calling method '>' {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:18:23.176425 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.compute.api [None req-290630e5-cd77-41c5-b8ca-24b3d61c875b tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] [instance: 73dbd5ab-5688-4de4-9da2-0b89d7cefb11] Fetching instance by UUID {{(pid=117874) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:18:23.184852 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-290630e5-cd77-41c5-b8ca-24b3d61c875b tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:18:23.185538 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-290630e5-cd77-41c5-b8ca-24b3d61c875b tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:18:23.186336 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-290630e5-cd77-41c5-b8ca-24b3d61c875b tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:18:23.186925 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-290630e5-cd77-41c5-b8ca-24b3d61c875b tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:18:23.210738 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG dbcounter [-] [117874] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:18:23.217603 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-28feda1b-460c-40cb-8d2f-32ad8b5e2d65 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Calling method '>' {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:18:23.218432 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.compute.api [None req-28feda1b-460c-40cb-8d2f-32ad8b5e2d65 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] [instance: 86a421a6-9b8c-40a9-ab7e-30b74c7bd0f3] Fetching instance by UUID {{(pid=117873) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:18:23.230140 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-28feda1b-460c-40cb-8d2f-32ad8b5e2d65 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:18:23.230647 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-28feda1b-460c-40cb-8d2f-32ad8b5e2d65 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:18:23.231501 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-28feda1b-460c-40cb-8d2f-32ad8b5e2d65 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:18:23.231984 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-28feda1b-460c-40cb-8d2f-32ad8b5e2d65 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:18:23.408975 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.policy [None req-290630e5-cd77-41c5-b8ca-24b3d61c875b tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75753b29a78640df9622d4e2655baf9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee9d603d9cc4a8797f55d544f189720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117874) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:18:23.421184 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.policy [None req-290630e5-cd77-41c5-b8ca-24b3d61c875b tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75753b29a78640df9622d4e2655baf9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee9d603d9cc4a8797f55d544f189720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117874) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:18:23.423666 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.policy [None req-290630e5-cd77-41c5-b8ca-24b3d61c875b tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75753b29a78640df9622d4e2655baf9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee9d603d9cc4a8797f55d544f189720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117874) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:18:23.424982 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [None req-290630e5-cd77-41c5-b8ca-24b3d61c875b tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] 10.222.0.43 "GET /compute/v2.1/servers/73dbd5ab-5688-4de4-9da2-0b89d7cefb11" status: 200 len: 1740 microversion: 2.20 time: 0.254067 Jun 22 10:18:23.431726 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.policy [None req-28feda1b-460c-40cb-8d2f-32ad8b5e2d65 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d7292401816437fba46d073c4746e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3277b9cbc4b4a8bbacee8440cea1ed2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117873) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:18:23.436484 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 193/367] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jun 22 10:18:23 2022] GET /compute/v2.1/servers/73dbd5ab-5688-4de4-9da2-0b89d7cefb11 => generated 1740 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 10:18:23.440017 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [None req-28feda1b-460c-40cb-8d2f-32ad8b5e2d65 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] 10.222.0.43 "GET /compute/v2.1/servers/86a421a6-9b8c-40a9-ab7e-30b74c7bd0f3" status: 200 len: 1372 microversion: 2.1 time: 0.226153 Jun 22 10:18:23.440850 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 175/368] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:18:23 2022] GET /compute/v2.1/servers/86a421a6-9b8c-40a9-ab7e-30b74c7bd0f3 => generated 1372 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 10:18:24.084940 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-400b4590-6776-4ebf-b54d-b2ed8b0de6c7 tempest-VolumesActionsTest-1453826651 tempest-VolumesActionsTest-1453826651-project] Calling method '>' {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:18:24.086333 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.compute.api [None req-400b4590-6776-4ebf-b54d-b2ed8b0de6c7 tempest-VolumesActionsTest-1453826651 tempest-VolumesActionsTest-1453826651-project] [instance: 884a31e3-235c-4ca6-84e5-3dbdcd403d4d] Fetching instance by UUID {{(pid=117874) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:18:24.094095 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-400b4590-6776-4ebf-b54d-b2ed8b0de6c7 tempest-VolumesActionsTest-1453826651 tempest-VolumesActionsTest-1453826651-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:18:24.095278 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-400b4590-6776-4ebf-b54d-b2ed8b0de6c7 tempest-VolumesActionsTest-1453826651 tempest-VolumesActionsTest-1453826651-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:18:24.096337 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-400b4590-6776-4ebf-b54d-b2ed8b0de6c7 tempest-VolumesActionsTest-1453826651 tempest-VolumesActionsTest-1453826651-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:18:24.096787 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-400b4590-6776-4ebf-b54d-b2ed8b0de6c7 tempest-VolumesActionsTest-1453826651 tempest-VolumesActionsTest-1453826651-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:18:24.112456 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-4dd7cdf6-abce-4ce6-aaa3-4cf3f432acd2 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Calling method '>' {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:18:24.113627 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.compute.api [None req-4dd7cdf6-abce-4ce6-aaa3-4cf3f432acd2 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] [instance: eb851ab6-0e89-41d2-be52-d76cdc8644d6] Fetching instance by UUID {{(pid=117873) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:18:24.120646 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-4dd7cdf6-abce-4ce6-aaa3-4cf3f432acd2 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:18:24.123621 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-4dd7cdf6-abce-4ce6-aaa3-4cf3f432acd2 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:18:24.124516 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-4dd7cdf6-abce-4ce6-aaa3-4cf3f432acd2 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:18:24.125982 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-4dd7cdf6-abce-4ce6-aaa3-4cf3f432acd2 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:18:24.340293 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.policy [None req-400b4590-6776-4ebf-b54d-b2ed8b0de6c7 tempest-VolumesActionsTest-1453826651 tempest-VolumesActionsTest-1453826651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9517119110f4ab99bff1379d5f7e241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b75addf2f334d7cb584ccae7779d3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117874) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:18:24.348496 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [None req-400b4590-6776-4ebf-b54d-b2ed8b0de6c7 tempest-VolumesActionsTest-1453826651 tempest-VolumesActionsTest-1453826651-project] 10.222.0.43 "GET /compute/v2.1/servers/884a31e3-235c-4ca6-84e5-3dbdcd403d4d" status: 200 len: 1313 microversion: 2.1 time: 0.269320 Jun 22 10:18:24.354733 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 194/369] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:18:24 2022] GET /compute/v2.1/servers/884a31e3-235c-4ca6-84e5-3dbdcd403d4d => generated 1313 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:18:24.355858 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.policy [None req-4dd7cdf6-abce-4ce6-aaa3-4cf3f432acd2 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78fe3fc4334c43d7a5ef6d70f9f57523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad52333bcbec425089c44c3e55df97ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117873) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:18:24.364721 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [None req-4dd7cdf6-abce-4ce6-aaa3-4cf3f432acd2 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] 10.222.0.43 "GET /compute/v2.1/servers/eb851ab6-0e89-41d2-be52-d76cdc8644d6" status: 200 len: 1724 microversion: 2.1 time: 0.268016 Jun 22 10:18:24.365303 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 176/370] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:18:24 2022] GET /compute/v2.1/servers/eb851ab6-0e89-41d2-be52-d76cdc8644d6 => generated 1724 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:18:24.443738 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-53ea21f8-8a3b-47f7-bdb8-771a24d9ff0e tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Calling method '>' {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:18:24.444466 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.compute.api [None req-53ea21f8-8a3b-47f7-bdb8-771a24d9ff0e tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] [instance: 73dbd5ab-5688-4de4-9da2-0b89d7cefb11] Fetching instance by UUID {{(pid=117874) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:18:24.450510 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-53ea21f8-8a3b-47f7-bdb8-771a24d9ff0e tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:18:24.450949 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-53ea21f8-8a3b-47f7-bdb8-771a24d9ff0e tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:18:24.451716 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-53ea21f8-8a3b-47f7-bdb8-771a24d9ff0e tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:18:24.452120 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-53ea21f8-8a3b-47f7-bdb8-771a24d9ff0e tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:18:24.461777 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-812f6763-4bc5-4958-8d10-19d6093763ff tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Calling method '>' {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:18:24.462870 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.compute.api [None req-812f6763-4bc5-4958-8d10-19d6093763ff tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] [instance: 86a421a6-9b8c-40a9-ab7e-30b74c7bd0f3] Fetching instance by UUID {{(pid=117873) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:18:24.469960 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-812f6763-4bc5-4958-8d10-19d6093763ff tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:18:24.470831 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-812f6763-4bc5-4958-8d10-19d6093763ff tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:18:24.471711 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-812f6763-4bc5-4958-8d10-19d6093763ff tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:18:24.472239 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-812f6763-4bc5-4958-8d10-19d6093763ff tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:18:24.493099 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG dbcounter [-] [117873] Writing DB stats nova_cell1:SELECT=100 {{(pid=117873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:18:24.684237 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.policy [None req-53ea21f8-8a3b-47f7-bdb8-771a24d9ff0e tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75753b29a78640df9622d4e2655baf9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee9d603d9cc4a8797f55d544f189720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117874) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:18:24.687813 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.policy [None req-812f6763-4bc5-4958-8d10-19d6093763ff tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d7292401816437fba46d073c4746e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3277b9cbc4b4a8bbacee8440cea1ed2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117873) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:18:24.692613 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.policy [None req-53ea21f8-8a3b-47f7-bdb8-771a24d9ff0e tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75753b29a78640df9622d4e2655baf9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee9d603d9cc4a8797f55d544f189720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117874) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:18:24.694685 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.policy [None req-53ea21f8-8a3b-47f7-bdb8-771a24d9ff0e tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75753b29a78640df9622d4e2655baf9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee9d603d9cc4a8797f55d544f189720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117874) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:18:24.696118 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [None req-53ea21f8-8a3b-47f7-bdb8-771a24d9ff0e tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] 10.222.0.43 "GET /compute/v2.1/servers/73dbd5ab-5688-4de4-9da2-0b89d7cefb11" status: 200 len: 1740 microversion: 2.20 time: 0.256209 Jun 22 10:18:24.696238 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [None req-812f6763-4bc5-4958-8d10-19d6093763ff tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] 10.222.0.43 "GET /compute/v2.1/servers/86a421a6-9b8c-40a9-ab7e-30b74c7bd0f3" status: 200 len: 1372 microversion: 2.1 time: 0.239753 Jun 22 10:18:24.706280 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 195/372] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jun 22 10:18:24 2022] GET /compute/v2.1/servers/73dbd5ab-5688-4de4-9da2-0b89d7cefb11 => generated 1740 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 10:18:24.706454 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 177/372] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:18:24 2022] GET /compute/v2.1/servers/86a421a6-9b8c-40a9-ab7e-30b74c7bd0f3 => generated 1372 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:18:25.367615 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-9dbc4abc-bff9-4048-bd8a-74c98cd6174a tempest-VolumesActionsTest-1453826651 tempest-VolumesActionsTest-1453826651-project] Calling method '>' {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:18:25.368436 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.compute.api [None req-9dbc4abc-bff9-4048-bd8a-74c98cd6174a tempest-VolumesActionsTest-1453826651 tempest-VolumesActionsTest-1453826651-project] [instance: 884a31e3-235c-4ca6-84e5-3dbdcd403d4d] Fetching instance by UUID {{(pid=117874) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:18:25.378525 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-9dbc4abc-bff9-4048-bd8a-74c98cd6174a tempest-VolumesActionsTest-1453826651 tempest-VolumesActionsTest-1453826651-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:18:25.379206 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG dbcounter [-] [117873] Writing DB stats nova_cell0:SELECT=2 {{(pid=117873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:18:25.379646 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-9dbc4abc-bff9-4048-bd8a-74c98cd6174a tempest-VolumesActionsTest-1453826651 tempest-VolumesActionsTest-1453826651-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:18:25.380663 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-9dbc4abc-bff9-4048-bd8a-74c98cd6174a tempest-VolumesActionsTest-1453826651 tempest-VolumesActionsTest-1453826651-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:18:25.381569 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-9dbc4abc-bff9-4048-bd8a-74c98cd6174a tempest-VolumesActionsTest-1453826651 tempest-VolumesActionsTest-1453826651-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:18:25.387690 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-20ddcef4-0bd3-4a17-8d67-bc2cb2d8a867 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Calling method '>' {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:18:25.387690 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.compute.api [None req-20ddcef4-0bd3-4a17-8d67-bc2cb2d8a867 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] [instance: eb851ab6-0e89-41d2-be52-d76cdc8644d6] Fetching instance by UUID {{(pid=117873) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:18:25.391337 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-20ddcef4-0bd3-4a17-8d67-bc2cb2d8a867 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:18:25.391885 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-20ddcef4-0bd3-4a17-8d67-bc2cb2d8a867 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:18:25.392663 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-20ddcef4-0bd3-4a17-8d67-bc2cb2d8a867 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:18:25.393109 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-20ddcef4-0bd3-4a17-8d67-bc2cb2d8a867 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:18:25.575748 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.policy [None req-9dbc4abc-bff9-4048-bd8a-74c98cd6174a tempest-VolumesActionsTest-1453826651 tempest-VolumesActionsTest-1453826651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9517119110f4ab99bff1379d5f7e241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b75addf2f334d7cb584ccae7779d3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117874) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:18:25.583376 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.policy [None req-20ddcef4-0bd3-4a17-8d67-bc2cb2d8a867 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78fe3fc4334c43d7a5ef6d70f9f57523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad52333bcbec425089c44c3e55df97ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117873) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:18:25.584008 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [None req-9dbc4abc-bff9-4048-bd8a-74c98cd6174a tempest-VolumesActionsTest-1453826651 tempest-VolumesActionsTest-1453826651-project] 10.222.0.43 "GET /compute/v2.1/servers/884a31e3-235c-4ca6-84e5-3dbdcd403d4d" status: 200 len: 1313 microversion: 2.1 time: 0.222306 Jun 22 10:18:25.584580 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 196/373] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:18:25 2022] GET /compute/v2.1/servers/884a31e3-235c-4ca6-84e5-3dbdcd403d4d => generated 1313 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 10:18:25.591422 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [None req-20ddcef4-0bd3-4a17-8d67-bc2cb2d8a867 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] 10.222.0.43 "GET /compute/v2.1/servers/eb851ab6-0e89-41d2-be52-d76cdc8644d6" status: 200 len: 1724 microversion: 2.1 time: 0.212917 Jun 22 10:18:25.591981 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 178/374] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:18:25 2022] GET /compute/v2.1/servers/eb851ab6-0e89-41d2-be52-d76cdc8644d6 => generated 1724 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 10:18:25.714448 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-1abb6dc4-559c-4acd-96b1-05286513c5ac tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Calling method '>' {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:18:25.715058 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.compute.api [None req-1abb6dc4-559c-4acd-96b1-05286513c5ac tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] [instance: 86a421a6-9b8c-40a9-ab7e-30b74c7bd0f3] Fetching instance by UUID {{(pid=117874) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:18:25.715250 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-2a62328b-4158-47db-aa94-d3fedba10fda tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Calling method '>' {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:18:25.715851 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.compute.api [None req-2a62328b-4158-47db-aa94-d3fedba10fda tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] [instance: 73dbd5ab-5688-4de4-9da2-0b89d7cefb11] Fetching instance by UUID {{(pid=117873) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:18:25.721793 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-1abb6dc4-559c-4acd-96b1-05286513c5ac tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:18:25.722242 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-1abb6dc4-559c-4acd-96b1-05286513c5ac tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:18:25.722376 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-2a62328b-4158-47db-aa94-d3fedba10fda tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:18:25.722787 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-2a62328b-4158-47db-aa94-d3fedba10fda tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:18:25.723013 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-1abb6dc4-559c-4acd-96b1-05286513c5ac tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:18:25.723450 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-1abb6dc4-559c-4acd-96b1-05286513c5ac tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:18:25.723558 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-2a62328b-4158-47db-aa94-d3fedba10fda tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:18:25.723958 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-2a62328b-4158-47db-aa94-d3fedba10fda tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:18:25.920544 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.policy [None req-1abb6dc4-559c-4acd-96b1-05286513c5ac tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d7292401816437fba46d073c4746e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3277b9cbc4b4a8bbacee8440cea1ed2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117874) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:18:25.924481 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.policy [None req-2a62328b-4158-47db-aa94-d3fedba10fda tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75753b29a78640df9622d4e2655baf9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee9d603d9cc4a8797f55d544f189720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117873) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:18:25.928547 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [None req-1abb6dc4-559c-4acd-96b1-05286513c5ac tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] 10.222.0.43 "GET /compute/v2.1/servers/86a421a6-9b8c-40a9-ab7e-30b74c7bd0f3" status: 200 len: 1372 microversion: 2.1 time: 0.217864 Jun 22 10:18:25.929129 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 197/375] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:18:25 2022] GET /compute/v2.1/servers/86a421a6-9b8c-40a9-ab7e-30b74c7bd0f3 => generated 1372 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:18:25.932508 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.policy [None req-2a62328b-4158-47db-aa94-d3fedba10fda tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75753b29a78640df9622d4e2655baf9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee9d603d9cc4a8797f55d544f189720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117873) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:18:25.934101 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.policy [None req-2a62328b-4158-47db-aa94-d3fedba10fda tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75753b29a78640df9622d4e2655baf9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee9d603d9cc4a8797f55d544f189720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117873) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:18:25.935242 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [None req-2a62328b-4158-47db-aa94-d3fedba10fda tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] 10.222.0.43 "GET /compute/v2.1/servers/73dbd5ab-5688-4de4-9da2-0b89d7cefb11" status: 200 len: 1740 microversion: 2.20 time: 0.223870 Jun 22 10:18:25.935790 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 179/376] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jun 22 10:18:25 2022] GET /compute/v2.1/servers/73dbd5ab-5688-4de4-9da2-0b89d7cefb11 => generated 1740 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 22 10:18:26.601566 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-caedf2b9-42a5-4aa9-b05c-c706bec7b756 tempest-VolumesActionsTest-1453826651 tempest-VolumesActionsTest-1453826651-project] Calling method '>' {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:18:26.602310 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.compute.api [None req-caedf2b9-42a5-4aa9-b05c-c706bec7b756 tempest-VolumesActionsTest-1453826651 tempest-VolumesActionsTest-1453826651-project] [instance: 884a31e3-235c-4ca6-84e5-3dbdcd403d4d] Fetching instance by UUID {{(pid=117874) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:18:26.610786 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-3388c7cf-38d6-4393-aed2-67f343a86914 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Calling method '>' {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:18:26.612288 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.compute.api [None req-3388c7cf-38d6-4393-aed2-67f343a86914 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] [instance: eb851ab6-0e89-41d2-be52-d76cdc8644d6] Fetching instance by UUID {{(pid=117873) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:18:26.614900 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG dbcounter [-] [117873] Writing DB stats nova_cell0:SELECT=24 {{(pid=117873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:18:26.617909 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG dbcounter [-] [117874] Writing DB stats nova_cell0:SELECT=2 {{(pid=117874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:18:26.618590 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG dbcounter [-] [117874] Writing DB stats nova_cell0:SELECT=6 {{(pid=117874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:18:26.630080 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-caedf2b9-42a5-4aa9-b05c-c706bec7b756 tempest-VolumesActionsTest-1453826651 tempest-VolumesActionsTest-1453826651-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:18:26.630519 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-caedf2b9-42a5-4aa9-b05c-c706bec7b756 tempest-VolumesActionsTest-1453826651 tempest-VolumesActionsTest-1453826651-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:18:26.631428 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-caedf2b9-42a5-4aa9-b05c-c706bec7b756 tempest-VolumesActionsTest-1453826651 tempest-VolumesActionsTest-1453826651-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:18:26.632043 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-3388c7cf-38d6-4393-aed2-67f343a86914 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:18:26.632474 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-3388c7cf-38d6-4393-aed2-67f343a86914 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:18:26.633226 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-3388c7cf-38d6-4393-aed2-67f343a86914 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:18:26.633646 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-3388c7cf-38d6-4393-aed2-67f343a86914 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:18:26.638084 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-caedf2b9-42a5-4aa9-b05c-c706bec7b756 tempest-VolumesActionsTest-1453826651 tempest-VolumesActionsTest-1453826651-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:18:26.833252 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.policy [None req-3388c7cf-38d6-4393-aed2-67f343a86914 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78fe3fc4334c43d7a5ef6d70f9f57523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad52333bcbec425089c44c3e55df97ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117873) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:18:26.840670 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.policy [None req-caedf2b9-42a5-4aa9-b05c-c706bec7b756 tempest-VolumesActionsTest-1453826651 tempest-VolumesActionsTest-1453826651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9517119110f4ab99bff1379d5f7e241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b75addf2f334d7cb584ccae7779d3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117874) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:18:26.843109 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [None req-3388c7cf-38d6-4393-aed2-67f343a86914 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] 10.222.0.43 "GET /compute/v2.1/servers/eb851ab6-0e89-41d2-be52-d76cdc8644d6" status: 200 len: 1724 microversion: 2.1 time: 0.237704 Jun 22 10:18:26.849751 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [None req-caedf2b9-42a5-4aa9-b05c-c706bec7b756 tempest-VolumesActionsTest-1453826651 tempest-VolumesActionsTest-1453826651-project] 10.222.0.43 "GET /compute/v2.1/servers/884a31e3-235c-4ca6-84e5-3dbdcd403d4d" status: 200 len: 1313 microversion: 2.1 time: 0.252601 Jun 22 10:18:26.850372 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 198/377] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:18:26 2022] GET /compute/v2.1/servers/884a31e3-235c-4ca6-84e5-3dbdcd403d4d => generated 1313 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:18:26.853063 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 180/378] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:18:26 2022] GET /compute/v2.1/servers/eb851ab6-0e89-41d2-be52-d76cdc8644d6 => generated 1724 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 10:18:26.945088 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-a4b61e3a-6c2b-44d7-92ab-ed685eb3dbb4 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Calling method '>' {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:18:26.945710 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.compute.api [None req-a4b61e3a-6c2b-44d7-92ab-ed685eb3dbb4 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] [instance: 86a421a6-9b8c-40a9-ab7e-30b74c7bd0f3] Fetching instance by UUID {{(pid=117874) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:18:26.951897 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-a4b61e3a-6c2b-44d7-92ab-ed685eb3dbb4 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:18:26.952338 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-a4b61e3a-6c2b-44d7-92ab-ed685eb3dbb4 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:18:26.953088 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-a4b61e3a-6c2b-44d7-92ab-ed685eb3dbb4 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:18:26.953522 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-a4b61e3a-6c2b-44d7-92ab-ed685eb3dbb4 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:18:26.956649 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-121120a2-21eb-4941-9640-8fc8b4ca04e9 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Calling method '>' {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:18:26.957610 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.compute.api [None req-121120a2-21eb-4941-9640-8fc8b4ca04e9 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] [instance: 73dbd5ab-5688-4de4-9da2-0b89d7cefb11] Fetching instance by UUID {{(pid=117873) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:18:26.965683 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-121120a2-21eb-4941-9640-8fc8b4ca04e9 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:18:26.966223 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-121120a2-21eb-4941-9640-8fc8b4ca04e9 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:18:26.967357 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-121120a2-21eb-4941-9640-8fc8b4ca04e9 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:18:26.968442 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-121120a2-21eb-4941-9640-8fc8b4ca04e9 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:18:27.201897 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.policy [None req-121120a2-21eb-4941-9640-8fc8b4ca04e9 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75753b29a78640df9622d4e2655baf9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee9d603d9cc4a8797f55d544f189720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117873) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:18:27.212637 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.policy [None req-121120a2-21eb-4941-9640-8fc8b4ca04e9 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75753b29a78640df9622d4e2655baf9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee9d603d9cc4a8797f55d544f189720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117873) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:18:27.214239 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.policy [None req-121120a2-21eb-4941-9640-8fc8b4ca04e9 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75753b29a78640df9622d4e2655baf9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee9d603d9cc4a8797f55d544f189720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117873) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:18:27.215412 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [None req-121120a2-21eb-4941-9640-8fc8b4ca04e9 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] 10.222.0.43 "GET /compute/v2.1/servers/73dbd5ab-5688-4de4-9da2-0b89d7cefb11" status: 200 len: 1722 microversion: 2.20 time: 0.264905 Jun 22 10:18:27.217045 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 181/379] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jun 22 10:18:26 2022] GET /compute/v2.1/servers/73dbd5ab-5688-4de4-9da2-0b89d7cefb11 => generated 1722 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 22 10:18:27.221314 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.policy [None req-a4b61e3a-6c2b-44d7-92ab-ed685eb3dbb4 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d7292401816437fba46d073c4746e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3277b9cbc4b4a8bbacee8440cea1ed2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117874) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:18:27.232346 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [None req-a4b61e3a-6c2b-44d7-92ab-ed685eb3dbb4 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] 10.222.0.43 "GET /compute/v2.1/servers/86a421a6-9b8c-40a9-ab7e-30b74c7bd0f3" status: 200 len: 1372 microversion: 2.1 time: 0.291214 Jun 22 10:18:27.233021 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 199/380] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:18:26 2022] GET /compute/v2.1/servers/86a421a6-9b8c-40a9-ab7e-30b74c7bd0f3 => generated 1372 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:18:27.862758 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-783d609e-8001-44c7-98ab-1281829ae453 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Calling method '>' {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:18:27.864694 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.compute.api [None req-783d609e-8001-44c7-98ab-1281829ae453 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] [instance: eb851ab6-0e89-41d2-be52-d76cdc8644d6] Fetching instance by UUID {{(pid=117873) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:18:27.869781 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-94bfab64-c893-4a61-82e3-aa965c933fac tempest-VolumesActionsTest-1453826651 tempest-VolumesActionsTest-1453826651-project] Calling method '>' {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:18:27.870385 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.compute.api [None req-94bfab64-c893-4a61-82e3-aa965c933fac tempest-VolumesActionsTest-1453826651 tempest-VolumesActionsTest-1453826651-project] [instance: 884a31e3-235c-4ca6-84e5-3dbdcd403d4d] Fetching instance by UUID {{(pid=117874) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:18:27.870860 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-783d609e-8001-44c7-98ab-1281829ae453 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:18:27.871356 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-783d609e-8001-44c7-98ab-1281829ae453 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:18:27.872103 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-783d609e-8001-44c7-98ab-1281829ae453 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:18:27.872535 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-783d609e-8001-44c7-98ab-1281829ae453 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:18:27.878507 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-94bfab64-c893-4a61-82e3-aa965c933fac tempest-VolumesActionsTest-1453826651 tempest-VolumesActionsTest-1453826651-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:18:27.878984 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-94bfab64-c893-4a61-82e3-aa965c933fac tempest-VolumesActionsTest-1453826651 tempest-VolumesActionsTest-1453826651-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:18:27.879746 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-94bfab64-c893-4a61-82e3-aa965c933fac tempest-VolumesActionsTest-1453826651 tempest-VolumesActionsTest-1453826651-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:18:27.880173 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-94bfab64-c893-4a61-82e3-aa965c933fac tempest-VolumesActionsTest-1453826651 tempest-VolumesActionsTest-1453826651-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:18:28.072719 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.policy [None req-783d609e-8001-44c7-98ab-1281829ae453 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78fe3fc4334c43d7a5ef6d70f9f57523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad52333bcbec425089c44c3e55df97ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117873) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:18:28.077200 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.policy [None req-94bfab64-c893-4a61-82e3-aa965c933fac tempest-VolumesActionsTest-1453826651 tempest-VolumesActionsTest-1453826651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9517119110f4ab99bff1379d5f7e241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b75addf2f334d7cb584ccae7779d3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117874) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:18:28.083202 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [None req-783d609e-8001-44c7-98ab-1281829ae453 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] 10.222.0.43 "GET /compute/v2.1/servers/eb851ab6-0e89-41d2-be52-d76cdc8644d6" status: 200 len: 1724 microversion: 2.1 time: 0.224868 Jun 22 10:18:28.092960 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 182/381] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:18:27 2022] GET /compute/v2.1/servers/eb851ab6-0e89-41d2-be52-d76cdc8644d6 => generated 1724 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:18:28.093296 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [None req-94bfab64-c893-4a61-82e3-aa965c933fac tempest-VolumesActionsTest-1453826651 tempest-VolumesActionsTest-1453826651-project] 10.222.0.43 "GET /compute/v2.1/servers/884a31e3-235c-4ca6-84e5-3dbdcd403d4d" status: 200 len: 1313 microversion: 2.1 time: 0.219408 Jun 22 10:18:28.098669 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 200/382] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:18:27 2022] GET /compute/v2.1/servers/884a31e3-235c-4ca6-84e5-3dbdcd403d4d => generated 1313 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:18:28.235067 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-f4cf0290-280d-4127-97e2-3b5ee8a9a295 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Calling method '>' {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:18:28.235896 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.compute.api [None req-f4cf0290-280d-4127-97e2-3b5ee8a9a295 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] [instance: 73dbd5ab-5688-4de4-9da2-0b89d7cefb11] Fetching instance by UUID {{(pid=117873) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:18:28.243162 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-f4cf0290-280d-4127-97e2-3b5ee8a9a295 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:18:28.243162 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-f4cf0290-280d-4127-97e2-3b5ee8a9a295 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:18:28.243162 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-f4cf0290-280d-4127-97e2-3b5ee8a9a295 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:18:28.251627 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-f4cf0290-280d-4127-97e2-3b5ee8a9a295 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:18:28.258222 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-d52e6b21-9404-49d7-8b87-8cb5a694b5bc tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Calling method '>' {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:18:28.258746 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.compute.api [None req-d52e6b21-9404-49d7-8b87-8cb5a694b5bc tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] [instance: 86a421a6-9b8c-40a9-ab7e-30b74c7bd0f3] Fetching instance by UUID {{(pid=117874) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:18:28.264872 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-d52e6b21-9404-49d7-8b87-8cb5a694b5bc tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:18:28.265317 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-d52e6b21-9404-49d7-8b87-8cb5a694b5bc tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:18:28.266146 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-d52e6b21-9404-49d7-8b87-8cb5a694b5bc tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:18:28.267108 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-d52e6b21-9404-49d7-8b87-8cb5a694b5bc tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:18:28.457655 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.policy [None req-f4cf0290-280d-4127-97e2-3b5ee8a9a295 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75753b29a78640df9622d4e2655baf9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee9d603d9cc4a8797f55d544f189720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117873) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:18:28.467531 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.policy [None req-f4cf0290-280d-4127-97e2-3b5ee8a9a295 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75753b29a78640df9622d4e2655baf9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee9d603d9cc4a8797f55d544f189720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117873) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:18:28.470377 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.policy [None req-f4cf0290-280d-4127-97e2-3b5ee8a9a295 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75753b29a78640df9622d4e2655baf9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee9d603d9cc4a8797f55d544f189720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117873) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:18:28.471937 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [None req-f4cf0290-280d-4127-97e2-3b5ee8a9a295 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] 10.222.0.43 "GET /compute/v2.1/servers/73dbd5ab-5688-4de4-9da2-0b89d7cefb11" status: 200 len: 1722 microversion: 2.20 time: 0.240540 Jun 22 10:18:28.478262 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 183/383] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jun 22 10:18:28 2022] GET /compute/v2.1/servers/73dbd5ab-5688-4de4-9da2-0b89d7cefb11 => generated 1722 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 10:18:28.488872 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.policy [None req-d52e6b21-9404-49d7-8b87-8cb5a694b5bc tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d7292401816437fba46d073c4746e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3277b9cbc4b4a8bbacee8440cea1ed2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117874) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:18:28.498708 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [None req-d52e6b21-9404-49d7-8b87-8cb5a694b5bc tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] 10.222.0.43 "GET /compute/v2.1/servers/86a421a6-9b8c-40a9-ab7e-30b74c7bd0f3" status: 200 len: 1372 microversion: 2.1 time: 0.254137 Jun 22 10:18:28.506051 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 201/384] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:18:28 2022] GET /compute/v2.1/servers/86a421a6-9b8c-40a9-ab7e-30b74c7bd0f3 => generated 1372 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 10:18:29.101321 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-239d846d-d0f4-409d-a9e1-b986322727b0 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Calling method '>' {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:18:29.101962 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.compute.api [None req-239d846d-d0f4-409d-a9e1-b986322727b0 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] [instance: eb851ab6-0e89-41d2-be52-d76cdc8644d6] Fetching instance by UUID {{(pid=117873) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:18:29.103505 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-5e5a546e-27bd-4d4e-b286-c6e7e700ac28 tempest-VolumesActionsTest-1453826651 tempest-VolumesActionsTest-1453826651-project] Calling method '>' {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:18:29.104845 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.compute.api [None req-5e5a546e-27bd-4d4e-b286-c6e7e700ac28 tempest-VolumesActionsTest-1453826651 tempest-VolumesActionsTest-1453826651-project] [instance: 884a31e3-235c-4ca6-84e5-3dbdcd403d4d] Fetching instance by UUID {{(pid=117874) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:18:29.108885 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-239d846d-d0f4-409d-a9e1-b986322727b0 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:18:29.109326 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-239d846d-d0f4-409d-a9e1-b986322727b0 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:18:29.110720 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-239d846d-d0f4-409d-a9e1-b986322727b0 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:18:29.111149 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-239d846d-d0f4-409d-a9e1-b986322727b0 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:18:29.112596 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-5e5a546e-27bd-4d4e-b286-c6e7e700ac28 tempest-VolumesActionsTest-1453826651 tempest-VolumesActionsTest-1453826651-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:18:29.113048 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-5e5a546e-27bd-4d4e-b286-c6e7e700ac28 tempest-VolumesActionsTest-1453826651 tempest-VolumesActionsTest-1453826651-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:18:29.113856 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-5e5a546e-27bd-4d4e-b286-c6e7e700ac28 tempest-VolumesActionsTest-1453826651 tempest-VolumesActionsTest-1453826651-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:18:29.114292 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-5e5a546e-27bd-4d4e-b286-c6e7e700ac28 tempest-VolumesActionsTest-1453826651 tempest-VolumesActionsTest-1453826651-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:18:29.542709 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.policy [None req-239d846d-d0f4-409d-a9e1-b986322727b0 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78fe3fc4334c43d7a5ef6d70f9f57523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad52333bcbec425089c44c3e55df97ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117873) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:18:29.545775 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.policy [None req-5e5a546e-27bd-4d4e-b286-c6e7e700ac28 tempest-VolumesActionsTest-1453826651 tempest-VolumesActionsTest-1453826651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9517119110f4ab99bff1379d5f7e241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b75addf2f334d7cb584ccae7779d3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117874) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:18:29.550675 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [None req-239d846d-d0f4-409d-a9e1-b986322727b0 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] 10.222.0.43 "GET /compute/v2.1/servers/eb851ab6-0e89-41d2-be52-d76cdc8644d6" status: 200 len: 1724 microversion: 2.1 time: 0.453323 Jun 22 10:18:29.551250 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 184/385] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:18:29 2022] GET /compute/v2.1/servers/eb851ab6-0e89-41d2-be52-d76cdc8644d6 => generated 1724 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:18:29.560485 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [None req-5e5a546e-27bd-4d4e-b286-c6e7e700ac28 tempest-VolumesActionsTest-1453826651 tempest-VolumesActionsTest-1453826651-project] 10.222.0.43 "GET /compute/v2.1/servers/884a31e3-235c-4ca6-84e5-3dbdcd403d4d" status: 200 len: 1313 microversion: 2.1 time: 0.453994 Jun 22 10:18:29.560485 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 202/386] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:18:29 2022] GET /compute/v2.1/servers/884a31e3-235c-4ca6-84e5-3dbdcd403d4d => generated 1313 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:18:29.560485 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-7f961857-56ff-4fa6-8c5f-78d737504e1d tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Calling method '>' {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:18:29.560485 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.compute.api [None req-7f961857-56ff-4fa6-8c5f-78d737504e1d tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] [instance: 86a421a6-9b8c-40a9-ab7e-30b74c7bd0f3] Fetching instance by UUID {{(pid=117874) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:18:29.562263 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-80dab50b-a9c4-4c97-9f75-6c28c46e1334 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Calling method '>' {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:18:29.563387 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.compute.api [None req-80dab50b-a9c4-4c97-9f75-6c28c46e1334 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] [instance: 73dbd5ab-5688-4de4-9da2-0b89d7cefb11] Fetching instance by UUID {{(pid=117873) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:18:29.565825 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-7f961857-56ff-4fa6-8c5f-78d737504e1d tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:18:29.566263 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-7f961857-56ff-4fa6-8c5f-78d737504e1d tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:18:29.567009 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-7f961857-56ff-4fa6-8c5f-78d737504e1d tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:18:29.567434 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-7f961857-56ff-4fa6-8c5f-78d737504e1d tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:18:29.570052 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-80dab50b-a9c4-4c97-9f75-6c28c46e1334 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:18:29.570495 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-80dab50b-a9c4-4c97-9f75-6c28c46e1334 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:18:29.571259 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-80dab50b-a9c4-4c97-9f75-6c28c46e1334 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:18:29.571690 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-80dab50b-a9c4-4c97-9f75-6c28c46e1334 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:18:29.758188 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.policy [None req-7f961857-56ff-4fa6-8c5f-78d737504e1d tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d7292401816437fba46d073c4746e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3277b9cbc4b4a8bbacee8440cea1ed2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117874) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:18:29.762143 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.policy [None req-80dab50b-a9c4-4c97-9f75-6c28c46e1334 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75753b29a78640df9622d4e2655baf9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee9d603d9cc4a8797f55d544f189720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117873) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:18:29.765633 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [None req-7f961857-56ff-4fa6-8c5f-78d737504e1d tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] 10.222.0.43 "GET /compute/v2.1/servers/86a421a6-9b8c-40a9-ab7e-30b74c7bd0f3" status: 200 len: 1372 microversion: 2.1 time: 0.210290 Jun 22 10:18:29.766235 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 203/387] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:18:29 2022] GET /compute/v2.1/servers/86a421a6-9b8c-40a9-ab7e-30b74c7bd0f3 => generated 1372 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:18:29.770730 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.policy [None req-80dab50b-a9c4-4c97-9f75-6c28c46e1334 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75753b29a78640df9622d4e2655baf9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee9d603d9cc4a8797f55d544f189720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117873) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:18:29.772217 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.policy [None req-80dab50b-a9c4-4c97-9f75-6c28c46e1334 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75753b29a78640df9622d4e2655baf9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee9d603d9cc4a8797f55d544f189720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117873) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:18:29.773368 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [None req-80dab50b-a9c4-4c97-9f75-6c28c46e1334 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] 10.222.0.43 "GET /compute/v2.1/servers/73dbd5ab-5688-4de4-9da2-0b89d7cefb11" status: 200 len: 1722 microversion: 2.20 time: 0.221219 Jun 22 10:18:29.774006 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 185/388] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jun 22 10:18:29 2022] GET /compute/v2.1/servers/73dbd5ab-5688-4de4-9da2-0b89d7cefb11 => generated 1722 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 10:18:30.568127 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-fb5bf96b-ac38-4e62-8085-5e14eeb71001 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Calling method '>' {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:18:30.568754 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.compute.api [None req-fb5bf96b-ac38-4e62-8085-5e14eeb71001 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] [instance: eb851ab6-0e89-41d2-be52-d76cdc8644d6] Fetching instance by UUID {{(pid=117874) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:18:30.569812 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-f70bd276-c5e3-445b-aebe-8261700c35f1 tempest-VolumesActionsTest-1453826651 tempest-VolumesActionsTest-1453826651-project] Calling method '>' {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:18:30.570414 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.compute.api [None req-f70bd276-c5e3-445b-aebe-8261700c35f1 tempest-VolumesActionsTest-1453826651 tempest-VolumesActionsTest-1453826651-project] [instance: 884a31e3-235c-4ca6-84e5-3dbdcd403d4d] Fetching instance by UUID {{(pid=117873) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:18:30.575417 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-fb5bf96b-ac38-4e62-8085-5e14eeb71001 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:18:30.575855 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-fb5bf96b-ac38-4e62-8085-5e14eeb71001 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:18:30.576607 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-fb5bf96b-ac38-4e62-8085-5e14eeb71001 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:18:30.576817 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-f70bd276-c5e3-445b-aebe-8261700c35f1 tempest-VolumesActionsTest-1453826651 tempest-VolumesActionsTest-1453826651-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:18:30.577034 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-fb5bf96b-ac38-4e62-8085-5e14eeb71001 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:18:30.577256 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-f70bd276-c5e3-445b-aebe-8261700c35f1 tempest-VolumesActionsTest-1453826651 tempest-VolumesActionsTest-1453826651-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:18:30.578036 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-f70bd276-c5e3-445b-aebe-8261700c35f1 tempest-VolumesActionsTest-1453826651 tempest-VolumesActionsTest-1453826651-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:18:30.578464 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-f70bd276-c5e3-445b-aebe-8261700c35f1 tempest-VolumesActionsTest-1453826651 tempest-VolumesActionsTest-1453826651-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:18:30.777394 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.policy [None req-fb5bf96b-ac38-4e62-8085-5e14eeb71001 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78fe3fc4334c43d7a5ef6d70f9f57523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad52333bcbec425089c44c3e55df97ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117874) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:18:30.780784 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.policy [None req-f70bd276-c5e3-445b-aebe-8261700c35f1 tempest-VolumesActionsTest-1453826651 tempest-VolumesActionsTest-1453826651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9517119110f4ab99bff1379d5f7e241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b75addf2f334d7cb584ccae7779d3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117873) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:18:30.786282 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [None req-fb5bf96b-ac38-4e62-8085-5e14eeb71001 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] 10.222.0.43 "GET /compute/v2.1/servers/eb851ab6-0e89-41d2-be52-d76cdc8644d6" status: 200 len: 1724 microversion: 2.1 time: 0.222100 Jun 22 10:18:30.787048 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 204/389] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:18:30 2022] GET /compute/v2.1/servers/eb851ab6-0e89-41d2-be52-d76cdc8644d6 => generated 1724 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:18:30.789611 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [None req-f70bd276-c5e3-445b-aebe-8261700c35f1 tempest-VolumesActionsTest-1453826651 tempest-VolumesActionsTest-1453826651-project] 10.222.0.43 "GET /compute/v2.1/servers/884a31e3-235c-4ca6-84e5-3dbdcd403d4d" status: 200 len: 1313 microversion: 2.1 time: 0.223487 Jun 22 10:18:30.790221 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 186/390] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:18:30 2022] GET /compute/v2.1/servers/884a31e3-235c-4ca6-84e5-3dbdcd403d4d => generated 1313 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:18:30.791856 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-e2d80ff8-f237-49af-a786-58fce1794ad8 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Calling method '>' {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:18:30.792455 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.compute.api [None req-e2d80ff8-f237-49af-a786-58fce1794ad8 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] [instance: 86a421a6-9b8c-40a9-ab7e-30b74c7bd0f3] Fetching instance by UUID {{(pid=117874) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:18:30.795114 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-07d62890-0de9-49c0-8ec0-92ca87908af6 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Calling method '>' {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:18:30.795882 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.compute.api [None req-07d62890-0de9-49c0-8ec0-92ca87908af6 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] [instance: 73dbd5ab-5688-4de4-9da2-0b89d7cefb11] Fetching instance by UUID {{(pid=117873) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:18:30.798766 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-e2d80ff8-f237-49af-a786-58fce1794ad8 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:18:30.799283 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-e2d80ff8-f237-49af-a786-58fce1794ad8 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:18:30.800113 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-e2d80ff8-f237-49af-a786-58fce1794ad8 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:18:30.800610 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-e2d80ff8-f237-49af-a786-58fce1794ad8 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:18:30.802586 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-07d62890-0de9-49c0-8ec0-92ca87908af6 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:18:30.803036 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-07d62890-0de9-49c0-8ec0-92ca87908af6 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:18:30.803795 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-07d62890-0de9-49c0-8ec0-92ca87908af6 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:18:30.804232 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-07d62890-0de9-49c0-8ec0-92ca87908af6 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:18:30.999380 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.policy [None req-e2d80ff8-f237-49af-a786-58fce1794ad8 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d7292401816437fba46d073c4746e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3277b9cbc4b4a8bbacee8440cea1ed2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117874) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:18:31.003682 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.policy [None req-07d62890-0de9-49c0-8ec0-92ca87908af6 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75753b29a78640df9622d4e2655baf9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee9d603d9cc4a8797f55d544f189720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117873) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:18:31.007457 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [None req-e2d80ff8-f237-49af-a786-58fce1794ad8 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] 10.222.0.43 "GET /compute/v2.1/servers/86a421a6-9b8c-40a9-ab7e-30b74c7bd0f3" status: 200 len: 1372 microversion: 2.1 time: 0.219154 Jun 22 10:18:31.008033 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 205/391] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:18:30 2022] GET /compute/v2.1/servers/86a421a6-9b8c-40a9-ab7e-30b74c7bd0f3 => generated 1372 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:18:31.011590 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.policy [None req-07d62890-0de9-49c0-8ec0-92ca87908af6 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75753b29a78640df9622d4e2655baf9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee9d603d9cc4a8797f55d544f189720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117873) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:18:31.013081 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.policy [None req-07d62890-0de9-49c0-8ec0-92ca87908af6 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75753b29a78640df9622d4e2655baf9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee9d603d9cc4a8797f55d544f189720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117873) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:18:31.014252 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [None req-07d62890-0de9-49c0-8ec0-92ca87908af6 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] 10.222.0.43 "GET /compute/v2.1/servers/73dbd5ab-5688-4de4-9da2-0b89d7cefb11" status: 200 len: 1722 microversion: 2.20 time: 0.222976 Jun 22 10:18:31.014796 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 187/392] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jun 22 10:18:30 2022] GET /compute/v2.1/servers/73dbd5ab-5688-4de4-9da2-0b89d7cefb11 => generated 1722 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 10:18:31.803755 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-0aa011ee-69ed-4f05-afd0-75a7d71c1a49 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Calling method '>' {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:18:31.804363 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.compute.api [None req-0aa011ee-69ed-4f05-afd0-75a7d71c1a49 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] [instance: eb851ab6-0e89-41d2-be52-d76cdc8644d6] Fetching instance by UUID {{(pid=117874) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:18:31.806767 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-0d617ecb-97ba-441e-8f1e-82703da506dd tempest-VolumesActionsTest-1453826651 tempest-VolumesActionsTest-1453826651-project] Calling method '>' {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:18:31.807398 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.compute.api [None req-0d617ecb-97ba-441e-8f1e-82703da506dd tempest-VolumesActionsTest-1453826651 tempest-VolumesActionsTest-1453826651-project] [instance: 884a31e3-235c-4ca6-84e5-3dbdcd403d4d] Fetching instance by UUID {{(pid=117873) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:18:31.811130 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-0aa011ee-69ed-4f05-afd0-75a7d71c1a49 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:18:31.811576 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-0aa011ee-69ed-4f05-afd0-75a7d71c1a49 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:18:31.812336 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-0aa011ee-69ed-4f05-afd0-75a7d71c1a49 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:18:31.812772 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-0aa011ee-69ed-4f05-afd0-75a7d71c1a49 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:18:31.813846 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-0d617ecb-97ba-441e-8f1e-82703da506dd tempest-VolumesActionsTest-1453826651 tempest-VolumesActionsTest-1453826651-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:18:31.814287 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-0d617ecb-97ba-441e-8f1e-82703da506dd tempest-VolumesActionsTest-1453826651 tempest-VolumesActionsTest-1453826651-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:18:31.815035 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-0d617ecb-97ba-441e-8f1e-82703da506dd tempest-VolumesActionsTest-1453826651 tempest-VolumesActionsTest-1453826651-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:18:31.815460 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-0d617ecb-97ba-441e-8f1e-82703da506dd tempest-VolumesActionsTest-1453826651 tempest-VolumesActionsTest-1453826651-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:18:32.011351 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.policy [None req-0aa011ee-69ed-4f05-afd0-75a7d71c1a49 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78fe3fc4334c43d7a5ef6d70f9f57523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad52333bcbec425089c44c3e55df97ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117874) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:18:32.016268 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.policy [None req-0d617ecb-97ba-441e-8f1e-82703da506dd tempest-VolumesActionsTest-1453826651 tempest-VolumesActionsTest-1453826651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9517119110f4ab99bff1379d5f7e241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b75addf2f334d7cb584ccae7779d3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117873) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:18:32.024365 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [None req-0d617ecb-97ba-441e-8f1e-82703da506dd tempest-VolumesActionsTest-1453826651 tempest-VolumesActionsTest-1453826651-project] 10.222.0.43 "GET /compute/v2.1/servers/884a31e3-235c-4ca6-84e5-3dbdcd403d4d" status: 200 len: 1313 microversion: 2.1 time: 0.221192 Jun 22 10:18:32.029925 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 188/393] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:18:31 2022] GET /compute/v2.1/servers/884a31e3-235c-4ca6-84e5-3dbdcd403d4d => generated 1313 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 10:18:32.029925 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-848b114a-0699-49b9-bbd9-2bf6b5852cd6 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Calling method '>' {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:18:32.030368 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.compute.api [None req-848b114a-0699-49b9-bbd9-2bf6b5852cd6 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] [instance: 86a421a6-9b8c-40a9-ab7e-30b74c7bd0f3] Fetching instance by UUID {{(pid=117873) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:18:32.033920 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [None req-0aa011ee-69ed-4f05-afd0-75a7d71c1a49 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] 10.222.0.43 "GET /compute/v2.1/servers/eb851ab6-0e89-41d2-be52-d76cdc8644d6" status: 200 len: 1724 microversion: 2.1 time: 0.233831 Jun 22 10:18:32.035184 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 206/394] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:18:31 2022] GET /compute/v2.1/servers/eb851ab6-0e89-41d2-be52-d76cdc8644d6 => generated 1724 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:18:32.043137 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-8df4d308-49c1-4933-80ed-3fa3ddd87a77 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Calling method '>' {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:18:32.043942 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.compute.api [None req-8df4d308-49c1-4933-80ed-3fa3ddd87a77 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] [instance: 73dbd5ab-5688-4de4-9da2-0b89d7cefb11] Fetching instance by UUID {{(pid=117874) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:18:32.045605 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-848b114a-0699-49b9-bbd9-2bf6b5852cd6 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:18:32.046182 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-848b114a-0699-49b9-bbd9-2bf6b5852cd6 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:18:32.047172 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-848b114a-0699-49b9-bbd9-2bf6b5852cd6 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:18:32.048376 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-848b114a-0699-49b9-bbd9-2bf6b5852cd6 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:18:32.056731 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-8df4d308-49c1-4933-80ed-3fa3ddd87a77 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:18:32.057198 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-8df4d308-49c1-4933-80ed-3fa3ddd87a77 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:18:32.058027 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-8df4d308-49c1-4933-80ed-3fa3ddd87a77 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:18:32.058470 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-8df4d308-49c1-4933-80ed-3fa3ddd87a77 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:18:32.258434 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.policy [None req-848b114a-0699-49b9-bbd9-2bf6b5852cd6 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d7292401816437fba46d073c4746e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3277b9cbc4b4a8bbacee8440cea1ed2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117873) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:18:32.265234 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.policy [None req-8df4d308-49c1-4933-80ed-3fa3ddd87a77 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75753b29a78640df9622d4e2655baf9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee9d603d9cc4a8797f55d544f189720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117874) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:18:32.274883 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [None req-848b114a-0699-49b9-bbd9-2bf6b5852cd6 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] 10.222.0.43 "GET /compute/v2.1/servers/86a421a6-9b8c-40a9-ab7e-30b74c7bd0f3" status: 200 len: 1372 microversion: 2.1 time: 0.248235 Jun 22 10:18:32.275702 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.policy [None req-8df4d308-49c1-4933-80ed-3fa3ddd87a77 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75753b29a78640df9622d4e2655baf9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee9d603d9cc4a8797f55d544f189720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117874) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:18:32.277612 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.policy [None req-8df4d308-49c1-4933-80ed-3fa3ddd87a77 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75753b29a78640df9622d4e2655baf9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee9d603d9cc4a8797f55d544f189720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117874) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:18:32.279100 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [None req-8df4d308-49c1-4933-80ed-3fa3ddd87a77 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] 10.222.0.43 "GET /compute/v2.1/servers/73dbd5ab-5688-4de4-9da2-0b89d7cefb11" status: 200 len: 1722 microversion: 2.20 time: 0.242365 Jun 22 10:18:32.280205 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 207/395] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jun 22 10:18:32 2022] GET /compute/v2.1/servers/73dbd5ab-5688-4de4-9da2-0b89d7cefb11 => generated 1722 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 10:18:32.285030 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [req-230be5d7-f550-4202-9f28-db6e09600739 req-3a0ac631-6b19-47e4-a513-cddd83da8ca6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "86a421a6-9b8c-40a9-ab7e-30b74c7bd0f3", "name": "network-vif-plugged", "status": "completed", "tag": "b3cb81b4-fc19-4acc-bb84-84c1f3b739b7"}]} {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:18:32.293885 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [req-230be5d7-f550-4202-9f28-db6e09600739 req-3a0ac631-6b19-47e4-a513-cddd83da8ca6 service nova] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:18:32.294414 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [req-230be5d7-f550-4202-9f28-db6e09600739 req-3a0ac631-6b19-47e4-a513-cddd83da8ca6 service nova] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:18:32.296152 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 189/396] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:18:32 2022] GET /compute/v2.1/servers/86a421a6-9b8c-40a9-ab7e-30b74c7bd0f3 => generated 1372 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:18:32.307106 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.compute.server_external_events [req-230be5d7-f550-4202-9f28-db6e09600739 req-3a0ac631-6b19-47e4-a513-cddd83da8ca6 service nova] Creating event network-vif-plugged:b3cb81b4-fc19-4acc-bb84-84c1f3b739b7 for instance 86a421a6-9b8c-40a9-ab7e-30b74c7bd0f3 on hv-cinder-84713 Jun 22 10:18:32.312153 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [req-230be5d7-f550-4202-9f28-db6e09600739 req-3a0ac631-6b19-47e4-a513-cddd83da8ca6 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030657 Jun 22 10:18:32.312929 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 208/397] 10.222.0.43 () {64 vars in 1317 bytes} [Wed Jun 22 10:18:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 10:18:33.041934 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-395b4856-b98a-42e9-bfb6-69dbc7ad4662 tempest-VolumesActionsTest-1453826651 tempest-VolumesActionsTest-1453826651-project] Calling method '>' {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:18:33.042580 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.compute.api [None req-395b4856-b98a-42e9-bfb6-69dbc7ad4662 tempest-VolumesActionsTest-1453826651 tempest-VolumesActionsTest-1453826651-project] [instance: 884a31e3-235c-4ca6-84e5-3dbdcd403d4d] Fetching instance by UUID {{(pid=117873) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:18:33.049122 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-395b4856-b98a-42e9-bfb6-69dbc7ad4662 tempest-VolumesActionsTest-1453826651 tempest-VolumesActionsTest-1453826651-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:18:33.049558 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-395b4856-b98a-42e9-bfb6-69dbc7ad4662 tempest-VolumesActionsTest-1453826651 tempest-VolumesActionsTest-1453826651-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:18:33.050356 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-395b4856-b98a-42e9-bfb6-69dbc7ad4662 tempest-VolumesActionsTest-1453826651 tempest-VolumesActionsTest-1453826651-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:18:33.050785 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-395b4856-b98a-42e9-bfb6-69dbc7ad4662 tempest-VolumesActionsTest-1453826651 tempest-VolumesActionsTest-1453826651-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:18:33.052094 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-28958d74-69f6-4983-b73d-de1a0b92d909 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Calling method '>' {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:18:33.052789 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.compute.api [None req-28958d74-69f6-4983-b73d-de1a0b92d909 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] [instance: eb851ab6-0e89-41d2-be52-d76cdc8644d6] Fetching instance by UUID {{(pid=117874) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:18:33.059070 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-28958d74-69f6-4983-b73d-de1a0b92d909 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:18:33.059520 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-28958d74-69f6-4983-b73d-de1a0b92d909 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:18:33.060338 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-28958d74-69f6-4983-b73d-de1a0b92d909 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:18:33.060801 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-28958d74-69f6-4983-b73d-de1a0b92d909 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:18:33.255489 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.policy [None req-395b4856-b98a-42e9-bfb6-69dbc7ad4662 tempest-VolumesActionsTest-1453826651 tempest-VolumesActionsTest-1453826651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9517119110f4ab99bff1379d5f7e241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b75addf2f334d7cb584ccae7779d3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117873) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:18:33.259561 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.policy [None req-28958d74-69f6-4983-b73d-de1a0b92d909 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78fe3fc4334c43d7a5ef6d70f9f57523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad52333bcbec425089c44c3e55df97ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117874) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:18:33.263100 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [None req-395b4856-b98a-42e9-bfb6-69dbc7ad4662 tempest-VolumesActionsTest-1453826651 tempest-VolumesActionsTest-1453826651-project] 10.222.0.43 "GET /compute/v2.1/servers/884a31e3-235c-4ca6-84e5-3dbdcd403d4d" status: 200 len: 1313 microversion: 2.1 time: 0.225032 Jun 22 10:18:33.263699 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 190/398] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:18:33 2022] GET /compute/v2.1/servers/884a31e3-235c-4ca6-84e5-3dbdcd403d4d => generated 1313 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:18:33.267708 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [None req-28958d74-69f6-4983-b73d-de1a0b92d909 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] 10.222.0.43 "GET /compute/v2.1/servers/eb851ab6-0e89-41d2-be52-d76cdc8644d6" status: 200 len: 1724 microversion: 2.1 time: 0.221038 Jun 22 10:18:33.268404 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 209/399] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:18:33 2022] GET /compute/v2.1/servers/eb851ab6-0e89-41d2-be52-d76cdc8644d6 => generated 1724 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:18:33.298221 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-fcfb9840-4e02-4524-b728-416f59b1814d tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Calling method '>' {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:18:33.298948 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.compute.api [None req-fcfb9840-4e02-4524-b728-416f59b1814d tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] [instance: 73dbd5ab-5688-4de4-9da2-0b89d7cefb11] Fetching instance by UUID {{(pid=117873) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:18:33.303421 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-62de9ee1-a6a2-4234-9fe1-06e138a49a0c tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Calling method '>' {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:18:33.304026 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.compute.api [None req-62de9ee1-a6a2-4234-9fe1-06e138a49a0c tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] [instance: 86a421a6-9b8c-40a9-ab7e-30b74c7bd0f3] Fetching instance by UUID {{(pid=117874) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:18:33.304843 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-fcfb9840-4e02-4524-b728-416f59b1814d tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:18:33.305310 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-fcfb9840-4e02-4524-b728-416f59b1814d tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:18:33.306157 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-fcfb9840-4e02-4524-b728-416f59b1814d tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:18:33.306581 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-fcfb9840-4e02-4524-b728-416f59b1814d tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:18:33.309974 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-62de9ee1-a6a2-4234-9fe1-06e138a49a0c tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:18:33.310423 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-62de9ee1-a6a2-4234-9fe1-06e138a49a0c tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:18:33.311175 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-62de9ee1-a6a2-4234-9fe1-06e138a49a0c tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:18:33.311606 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-62de9ee1-a6a2-4234-9fe1-06e138a49a0c tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:18:33.502559 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.policy [None req-fcfb9840-4e02-4524-b728-416f59b1814d tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75753b29a78640df9622d4e2655baf9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee9d603d9cc4a8797f55d544f189720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117873) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:18:33.509786 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.policy [None req-62de9ee1-a6a2-4234-9fe1-06e138a49a0c tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d7292401816437fba46d073c4746e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3277b9cbc4b4a8bbacee8440cea1ed2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117874) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:18:33.510910 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.policy [None req-fcfb9840-4e02-4524-b728-416f59b1814d tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75753b29a78640df9622d4e2655baf9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee9d603d9cc4a8797f55d544f189720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117873) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:18:33.512412 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.policy [None req-fcfb9840-4e02-4524-b728-416f59b1814d tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75753b29a78640df9622d4e2655baf9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee9d603d9cc4a8797f55d544f189720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117873) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:18:33.513269 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG dbcounter [-] [117874] Writing DB stats nova_cell1:SELECT=100 {{(pid=117874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:18:33.513561 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [None req-fcfb9840-4e02-4524-b728-416f59b1814d tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] 10.222.0.43 "GET /compute/v2.1/servers/73dbd5ab-5688-4de4-9da2-0b89d7cefb11" status: 200 len: 1665 microversion: 2.20 time: 0.219741 Jun 22 10:18:33.514194 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 191/400] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jun 22 10:18:33 2022] GET /compute/v2.1/servers/73dbd5ab-5688-4de4-9da2-0b89d7cefb11 => generated 1665 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 10:18:33.518433 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [None req-62de9ee1-a6a2-4234-9fe1-06e138a49a0c tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] 10.222.0.43 "GET /compute/v2.1/servers/86a421a6-9b8c-40a9-ab7e-30b74c7bd0f3" status: 200 len: 1372 microversion: 2.1 time: 0.218725 Jun 22 10:18:33.518985 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 210/401] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:18:33 2022] GET /compute/v2.1/servers/86a421a6-9b8c-40a9-ab7e-30b74c7bd0f3 => generated 1372 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 10:18:33.530830 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-7f8bab67-aa61-4bec-a13f-77934c226e5a tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2cb16ceb-0a80-4a93-8617-8ba2b4a1d166"}} {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:18:33.532478 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.compute.api [None req-7f8bab67-aa61-4bec-a13f-77934c226e5a tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] [instance: 73dbd5ab-5688-4de4-9da2-0b89d7cefb11] Fetching instance by UUID {{(pid=117873) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:18:33.538430 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-7f8bab67-aa61-4bec-a13f-77934c226e5a tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:18:33.538875 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-7f8bab67-aa61-4bec-a13f-77934c226e5a tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:18:33.539623 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-7f8bab67-aa61-4bec-a13f-77934c226e5a tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:18:33.540049 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-7f8bab67-aa61-4bec-a13f-77934c226e5a tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:18:33.716677 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG dbcounter [-] [117873] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=117873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:18:33.816739 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [None req-7f8bab67-aa61-4bec-a13f-77934c226e5a tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] 10.222.0.43 "POST /compute/v2.1/servers/73dbd5ab-5688-4de4-9da2-0b89d7cefb11/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.289642 Jun 22 10:18:33.817347 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 192/402] 10.222.0.43 () {62 vars in 1363 bytes} [Wed Jun 22 10:18:33 2022] POST /compute/v2.1/servers/73dbd5ab-5688-4de4-9da2-0b89d7cefb11/os-volume_attachments => generated 188 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 22 10:18:33.934531 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-68c72bc4-d36f-4e4e-a6a3-1c0addf3e1d1 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:18:33.935092 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.compute.api [None req-68c72bc4-d36f-4e4e-a6a3-1c0addf3e1d1 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] [instance: 73dbd5ab-5688-4de4-9da2-0b89d7cefb11] Fetching instance by UUID {{(pid=117874) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:18:33.942005 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-68c72bc4-d36f-4e4e-a6a3-1c0addf3e1d1 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:18:33.942447 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-68c72bc4-d36f-4e4e-a6a3-1c0addf3e1d1 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:18:33.943188 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-68c72bc4-d36f-4e4e-a6a3-1c0addf3e1d1 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:18:33.943618 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-68c72bc4-d36f-4e4e-a6a3-1c0addf3e1d1 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:18:34.049172 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [None req-68c72bc4-d36f-4e4e-a6a3-1c0addf3e1d1 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] 10.222.0.43 "POST /compute/v2.1/servers/73dbd5ab-5688-4de4-9da2-0b89d7cefb11/action" status: 202 len: 0 microversion: 2.20 time: 0.117291 Jun 22 10:18:34.050106 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 211/403] 10.222.0.43 () {62 vars in 1318 bytes} [Wed Jun 22 10:18:33 2022] POST /compute/v2.1/servers/73dbd5ab-5688-4de4-9da2-0b89d7cefb11/action => generated 0 bytes in 120 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 22 10:18:34.058540 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-4ea9251f-e6a8-440d-82e0-f4a438bfa233 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Calling method '>' {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:18:34.060420 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.compute.api [None req-4ea9251f-e6a8-440d-82e0-f4a438bfa233 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] [instance: 73dbd5ab-5688-4de4-9da2-0b89d7cefb11] Fetching instance by UUID {{(pid=117873) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:18:34.069256 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-4ea9251f-e6a8-440d-82e0-f4a438bfa233 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:18:34.069736 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-4ea9251f-e6a8-440d-82e0-f4a438bfa233 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:18:34.070660 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-4ea9251f-e6a8-440d-82e0-f4a438bfa233 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:18:34.071272 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-4ea9251f-e6a8-440d-82e0-f4a438bfa233 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:18:34.226105 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.policy [None req-4ea9251f-e6a8-440d-82e0-f4a438bfa233 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75753b29a78640df9622d4e2655baf9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee9d603d9cc4a8797f55d544f189720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117873) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:18:34.236824 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.policy [None req-4ea9251f-e6a8-440d-82e0-f4a438bfa233 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75753b29a78640df9622d4e2655baf9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee9d603d9cc4a8797f55d544f189720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117873) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:18:34.238459 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.policy [None req-4ea9251f-e6a8-440d-82e0-f4a438bfa233 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75753b29a78640df9622d4e2655baf9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee9d603d9cc4a8797f55d544f189720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117873) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:18:34.239619 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [None req-4ea9251f-e6a8-440d-82e0-f4a438bfa233 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] 10.222.0.43 "GET /compute/v2.1/servers/73dbd5ab-5688-4de4-9da2-0b89d7cefb11" status: 200 len: 1751 microversion: 2.20 time: 0.185404 Jun 22 10:18:34.240478 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 193/404] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jun 22 10:18:34 2022] GET /compute/v2.1/servers/73dbd5ab-5688-4de4-9da2-0b89d7cefb11 => generated 1751 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 22 10:18:34.280888 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-b7317ac9-4ced-4a52-9aa2-f91a536ea2c5 tempest-VolumesActionsTest-1453826651 tempest-VolumesActionsTest-1453826651-project] Calling method '>' {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:18:34.283385 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.compute.api [None req-b7317ac9-4ced-4a52-9aa2-f91a536ea2c5 tempest-VolumesActionsTest-1453826651 tempest-VolumesActionsTest-1453826651-project] [instance: 884a31e3-235c-4ca6-84e5-3dbdcd403d4d] Fetching instance by UUID {{(pid=117874) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:18:34.287371 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-be53052e-8fe8-4995-afdd-3c271ff74f56 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Calling method '>' {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:18:34.287978 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.compute.api [None req-be53052e-8fe8-4995-afdd-3c271ff74f56 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] [instance: eb851ab6-0e89-41d2-be52-d76cdc8644d6] Fetching instance by UUID {{(pid=117873) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:18:34.295733 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-be53052e-8fe8-4995-afdd-3c271ff74f56 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:18:34.296447 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-be53052e-8fe8-4995-afdd-3c271ff74f56 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:18:34.297447 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-b7317ac9-4ced-4a52-9aa2-f91a536ea2c5 tempest-VolumesActionsTest-1453826651 tempest-VolumesActionsTest-1453826651-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:18:34.297819 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-be53052e-8fe8-4995-afdd-3c271ff74f56 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:18:34.298598 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-be53052e-8fe8-4995-afdd-3c271ff74f56 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:18:34.298832 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-b7317ac9-4ced-4a52-9aa2-f91a536ea2c5 tempest-VolumesActionsTest-1453826651 tempest-VolumesActionsTest-1453826651-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:18:34.299726 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-b7317ac9-4ced-4a52-9aa2-f91a536ea2c5 tempest-VolumesActionsTest-1453826651 tempest-VolumesActionsTest-1453826651-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:18:34.300304 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-b7317ac9-4ced-4a52-9aa2-f91a536ea2c5 tempest-VolumesActionsTest-1453826651 tempest-VolumesActionsTest-1453826651-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:18:34.548559 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.policy [None req-b7317ac9-4ced-4a52-9aa2-f91a536ea2c5 tempest-VolumesActionsTest-1453826651 tempest-VolumesActionsTest-1453826651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9517119110f4ab99bff1379d5f7e241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b75addf2f334d7cb584ccae7779d3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117874) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:18:34.551736 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.policy [None req-be53052e-8fe8-4995-afdd-3c271ff74f56 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78fe3fc4334c43d7a5ef6d70f9f57523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad52333bcbec425089c44c3e55df97ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117873) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:18:34.561884 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [None req-be53052e-8fe8-4995-afdd-3c271ff74f56 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] 10.222.0.43 "GET /compute/v2.1/servers/eb851ab6-0e89-41d2-be52-d76cdc8644d6" status: 200 len: 1724 microversion: 2.1 time: 0.280141 Jun 22 10:18:34.562506 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [None req-b7317ac9-4ced-4a52-9aa2-f91a536ea2c5 tempest-VolumesActionsTest-1453826651 tempest-VolumesActionsTest-1453826651-project] 10.222.0.43 "GET /compute/v2.1/servers/884a31e3-235c-4ca6-84e5-3dbdcd403d4d" status: 200 len: 1313 microversion: 2.1 time: 0.286391 Jun 22 10:18:34.562651 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 194/405] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:18:34 2022] GET /compute/v2.1/servers/eb851ab6-0e89-41d2-be52-d76cdc8644d6 => generated 1724 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 10:18:34.563861 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 212/406] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:18:34 2022] GET /compute/v2.1/servers/884a31e3-235c-4ca6-84e5-3dbdcd403d4d => generated 1313 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:18:34.576528 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [req-5f50c800-b7b1-4dde-a41d-40c5692b1da4 req-28ce194a-1887-4938-bc3d-b970f29c1efd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "73dbd5ab-5688-4de4-9da2-0b89d7cefb11", "name": "network-vif-unplugged", "status": "completed", "tag": "468a7090-7d3f-43e5-8303-b6f8870ced56"}, {"server_uuid": "884a31e3-235c-4ca6-84e5-3dbdcd403d4d", "name": "network-vif-plugged", "status": "completed", "tag": "4d2f6e47-53cb-4939-a600-4f5f86cf4334"}]} {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:18:34.579249 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-cede5029-044c-48f7-9485-e9a9d87e7873 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Calling method '>' {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:18:34.580276 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.compute.api [None req-cede5029-044c-48f7-9485-e9a9d87e7873 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] [instance: 86a421a6-9b8c-40a9-ab7e-30b74c7bd0f3] Fetching instance by UUID {{(pid=117874) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:18:34.586330 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-cede5029-044c-48f7-9485-e9a9d87e7873 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:18:34.586833 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-cede5029-044c-48f7-9485-e9a9d87e7873 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:18:34.587238 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [req-5f50c800-b7b1-4dde-a41d-40c5692b1da4 req-28ce194a-1887-4938-bc3d-b970f29c1efd service nova] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:18:34.587589 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-cede5029-044c-48f7-9485-e9a9d87e7873 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:18:34.587732 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [req-5f50c800-b7b1-4dde-a41d-40c5692b1da4 req-28ce194a-1887-4938-bc3d-b970f29c1efd service nova] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:18:34.588300 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-cede5029-044c-48f7-9485-e9a9d87e7873 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:18:34.601289 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.compute.server_external_events [req-5f50c800-b7b1-4dde-a41d-40c5692b1da4 req-28ce194a-1887-4938-bc3d-b970f29c1efd service nova] Unable to find a host for instance 73dbd5ab-5688-4de4-9da2-0b89d7cefb11. Dropping event network-vif-unplugged {{(pid=117873) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jun 22 10:18:34.602084 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.compute.server_external_events [req-5f50c800-b7b1-4dde-a41d-40c5692b1da4 req-28ce194a-1887-4938-bc3d-b970f29c1efd service nova] Creating event network-vif-plugged:4d2f6e47-53cb-4939-a600-4f5f86cf4334 for instance 884a31e3-235c-4ca6-84e5-3dbdcd403d4d on hv-cinder-84713 Jun 22 10:18:34.607786 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [req-5f50c800-b7b1-4dde-a41d-40c5692b1da4 req-28ce194a-1887-4938-bc3d-b970f29c1efd service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 207 len: 353 microversion: 2.1 time: 0.043959 Jun 22 10:18:34.608690 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 195/407] 10.222.0.43 () {64 vars in 1317 bytes} [Wed Jun 22 10:18:34 2022] POST /compute/v2.1/os-server-external-events => generated 353 bytes in 45 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Jun 22 10:18:34.737816 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.policy [None req-cede5029-044c-48f7-9485-e9a9d87e7873 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d7292401816437fba46d073c4746e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3277b9cbc4b4a8bbacee8440cea1ed2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117874) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:18:34.748379 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [None req-cede5029-044c-48f7-9485-e9a9d87e7873 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] 10.222.0.43 "GET /compute/v2.1/servers/86a421a6-9b8c-40a9-ab7e-30b74c7bd0f3" status: 200 len: 1566 microversion: 2.1 time: 0.173113 Jun 22 10:18:34.748972 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 213/408] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:18:34 2022] GET /compute/v2.1/servers/86a421a6-9b8c-40a9-ab7e-30b74c7bd0f3 => generated 1566 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:18:34.765460 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-ee08a08b-2517-4ff1-b925-c2a7e758f584 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Calling method '>' {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:18:34.766847 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.compute.api [None req-ee08a08b-2517-4ff1-b925-c2a7e758f584 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] [instance: 86a421a6-9b8c-40a9-ab7e-30b74c7bd0f3] Fetching instance by UUID {{(pid=117873) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:18:34.774254 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-ee08a08b-2517-4ff1-b925-c2a7e758f584 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:18:34.774702 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-ee08a08b-2517-4ff1-b925-c2a7e758f584 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:18:34.775470 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-ee08a08b-2517-4ff1-b925-c2a7e758f584 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:18:34.775912 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-ee08a08b-2517-4ff1-b925-c2a7e758f584 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:18:34.895658 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [None req-ee08a08b-2517-4ff1-b925-c2a7e758f584 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] 10.222.0.43 "GET /compute/v2.1/servers/86a421a6-9b8c-40a9-ab7e-30b74c7bd0f3/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.134224 Jun 22 10:18:34.896269 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 196/409] 10.222.0.43 () {58 vars in 1274 bytes} [Wed Jun 22 10:18:34 2022] GET /compute/v2.1/servers/86a421a6-9b8c-40a9-ab7e-30b74c7bd0f3/os-interface => generated 284 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 10:18:35.260644 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-928b42fc-b47c-442d-9124-10b2063b612a tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Calling method '>' {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:18:35.261704 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.compute.api [None req-928b42fc-b47c-442d-9124-10b2063b612a tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] [instance: 73dbd5ab-5688-4de4-9da2-0b89d7cefb11] Fetching instance by UUID {{(pid=117874) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:18:35.270818 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-928b42fc-b47c-442d-9124-10b2063b612a tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:18:35.271586 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-928b42fc-b47c-442d-9124-10b2063b612a tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:18:35.272827 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-928b42fc-b47c-442d-9124-10b2063b612a tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:18:35.273503 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-928b42fc-b47c-442d-9124-10b2063b612a tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:18:35.489785 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.policy [None req-928b42fc-b47c-442d-9124-10b2063b612a tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75753b29a78640df9622d4e2655baf9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee9d603d9cc4a8797f55d544f189720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117874) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:18:35.501968 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.policy [None req-928b42fc-b47c-442d-9124-10b2063b612a tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75753b29a78640df9622d4e2655baf9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee9d603d9cc4a8797f55d544f189720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117874) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:18:35.503887 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.policy [None req-928b42fc-b47c-442d-9124-10b2063b612a tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75753b29a78640df9622d4e2655baf9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee9d603d9cc4a8797f55d544f189720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117874) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:18:35.505368 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [None req-928b42fc-b47c-442d-9124-10b2063b612a tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] 10.222.0.43 "GET /compute/v2.1/servers/73dbd5ab-5688-4de4-9da2-0b89d7cefb11" status: 200 len: 1751 microversion: 2.20 time: 0.249271 Jun 22 10:18:35.505966 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 214/410] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jun 22 10:18:35 2022] GET /compute/v2.1/servers/73dbd5ab-5688-4de4-9da2-0b89d7cefb11 => generated 1751 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 22 10:18:35.580842 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-a4a8d7a3-c6d1-4dad-8baf-588f7529a38d tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Calling method '>' {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:18:35.581454 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.compute.api [None req-a4a8d7a3-c6d1-4dad-8baf-588f7529a38d tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] [instance: eb851ab6-0e89-41d2-be52-d76cdc8644d6] Fetching instance by UUID {{(pid=117873) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:18:35.588522 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-a4a8d7a3-c6d1-4dad-8baf-588f7529a38d tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:18:35.588961 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-a4a8d7a3-c6d1-4dad-8baf-588f7529a38d tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:18:35.589249 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-675270d3-b653-427e-ac7e-77cb4d59961a tempest-VolumesActionsTest-1453826651 tempest-VolumesActionsTest-1453826651-project] Calling method '>' {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:18:35.589942 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-a4a8d7a3-c6d1-4dad-8baf-588f7529a38d tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:18:35.590311 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.compute.api [None req-675270d3-b653-427e-ac7e-77cb4d59961a tempest-VolumesActionsTest-1453826651 tempest-VolumesActionsTest-1453826651-project] [instance: 884a31e3-235c-4ca6-84e5-3dbdcd403d4d] Fetching instance by UUID {{(pid=117874) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:18:35.591264 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-a4a8d7a3-c6d1-4dad-8baf-588f7529a38d tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:18:35.599345 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-675270d3-b653-427e-ac7e-77cb4d59961a tempest-VolumesActionsTest-1453826651 tempest-VolumesActionsTest-1453826651-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:18:35.599888 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-675270d3-b653-427e-ac7e-77cb4d59961a tempest-VolumesActionsTest-1453826651 tempest-VolumesActionsTest-1453826651-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:18:35.600572 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-675270d3-b653-427e-ac7e-77cb4d59961a tempest-VolumesActionsTest-1453826651 tempest-VolumesActionsTest-1453826651-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:18:35.601020 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-675270d3-b653-427e-ac7e-77cb4d59961a tempest-VolumesActionsTest-1453826651 tempest-VolumesActionsTest-1453826651-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:18:35.855131 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.policy [None req-675270d3-b653-427e-ac7e-77cb4d59961a tempest-VolumesActionsTest-1453826651 tempest-VolumesActionsTest-1453826651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9517119110f4ab99bff1379d5f7e241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b75addf2f334d7cb584ccae7779d3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117874) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:18:35.865959 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [None req-675270d3-b653-427e-ac7e-77cb4d59961a tempest-VolumesActionsTest-1453826651 tempest-VolumesActionsTest-1453826651-project] 10.222.0.43 "GET /compute/v2.1/servers/884a31e3-235c-4ca6-84e5-3dbdcd403d4d" status: 200 len: 1313 microversion: 2.1 time: 0.280434 Jun 22 10:18:35.876461 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 215/411] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:18:35 2022] GET /compute/v2.1/servers/884a31e3-235c-4ca6-84e5-3dbdcd403d4d => generated 1313 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:18:35.900925 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.policy [None req-a4a8d7a3-c6d1-4dad-8baf-588f7529a38d tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78fe3fc4334c43d7a5ef6d70f9f57523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad52333bcbec425089c44c3e55df97ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117873) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:18:35.909821 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [None req-a4a8d7a3-c6d1-4dad-8baf-588f7529a38d tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] 10.222.0.43 "GET /compute/v2.1/servers/eb851ab6-0e89-41d2-be52-d76cdc8644d6" status: 200 len: 1724 microversion: 2.1 time: 0.333907 Jun 22 10:18:35.910319 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 197/412] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:18:35 2022] GET /compute/v2.1/servers/eb851ab6-0e89-41d2-be52-d76cdc8644d6 => generated 1724 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:18:36.346631 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [req-5cafcc9e-3381-4e09-aad2-679ff1a18087 req-ec741a38-4dc6-47fd-bfc8-e7e4709e76fe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "86a421a6-9b8c-40a9-ab7e-30b74c7bd0f3", "tag": "b3cb81b4-fc19-4acc-bb84-84c1f3b739b7"}]} {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:18:36.364411 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [req-5cafcc9e-3381-4e09-aad2-679ff1a18087 req-ec741a38-4dc6-47fd-bfc8-e7e4709e76fe service nova] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:18:36.365351 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [req-5cafcc9e-3381-4e09-aad2-679ff1a18087 req-ec741a38-4dc6-47fd-bfc8-e7e4709e76fe service nova] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:18:36.384967 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.compute.server_external_events [req-5cafcc9e-3381-4e09-aad2-679ff1a18087 req-ec741a38-4dc6-47fd-bfc8-e7e4709e76fe service nova] Creating event network-changed:b3cb81b4-fc19-4acc-bb84-84c1f3b739b7 for instance 86a421a6-9b8c-40a9-ab7e-30b74c7bd0f3 on hv-cinder-84713 Jun 22 10:18:36.390883 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [req-5cafcc9e-3381-4e09-aad2-679ff1a18087 req-ec741a38-4dc6-47fd-bfc8-e7e4709e76fe service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047887 Jun 22 10:18:36.391514 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 216/413] 10.222.0.43 () {64 vars in 1317 bytes} [Wed Jun 22 10:18:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 10:18:36.524468 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-a0e36d78-929c-4e52-8f4f-4b96b0c1316c tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Calling method '>' {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:18:36.524988 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.compute.api [None req-a0e36d78-929c-4e52-8f4f-4b96b0c1316c tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] [instance: 73dbd5ab-5688-4de4-9da2-0b89d7cefb11] Fetching instance by UUID {{(pid=117873) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:18:36.531088 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-a0e36d78-929c-4e52-8f4f-4b96b0c1316c tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:18:36.531494 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-a0e36d78-929c-4e52-8f4f-4b96b0c1316c tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:18:36.532243 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-a0e36d78-929c-4e52-8f4f-4b96b0c1316c tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:18:36.532708 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-a0e36d78-929c-4e52-8f4f-4b96b0c1316c tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:18:36.682641 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.policy [None req-a0e36d78-929c-4e52-8f4f-4b96b0c1316c tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75753b29a78640df9622d4e2655baf9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee9d603d9cc4a8797f55d544f189720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117873) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:18:36.695144 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.policy [None req-a0e36d78-929c-4e52-8f4f-4b96b0c1316c tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75753b29a78640df9622d4e2655baf9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee9d603d9cc4a8797f55d544f189720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117873) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:18:36.697562 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.policy [None req-a0e36d78-929c-4e52-8f4f-4b96b0c1316c tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75753b29a78640df9622d4e2655baf9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee9d603d9cc4a8797f55d544f189720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117873) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:18:36.700426 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [None req-a0e36d78-929c-4e52-8f4f-4b96b0c1316c tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] 10.222.0.43 "GET /compute/v2.1/servers/73dbd5ab-5688-4de4-9da2-0b89d7cefb11" status: 200 len: 1753 microversion: 2.20 time: 0.178693 Jun 22 10:18:36.711970 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 198/414] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jun 22 10:18:36 2022] GET /compute/v2.1/servers/73dbd5ab-5688-4de4-9da2-0b89d7cefb11 => generated 1753 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 10:18:36.885074 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-5490a4a0-a6a7-45a8-aeee-5576a4dfebdd tempest-VolumesActionsTest-1453826651 tempest-VolumesActionsTest-1453826651-project] Calling method '>' {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:18:36.886434 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.compute.api [None req-5490a4a0-a6a7-45a8-aeee-5576a4dfebdd tempest-VolumesActionsTest-1453826651 tempest-VolumesActionsTest-1453826651-project] [instance: 884a31e3-235c-4ca6-84e5-3dbdcd403d4d] Fetching instance by UUID {{(pid=117874) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:18:36.894631 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-5490a4a0-a6a7-45a8-aeee-5576a4dfebdd tempest-VolumesActionsTest-1453826651 tempest-VolumesActionsTest-1453826651-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:18:36.895287 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-5490a4a0-a6a7-45a8-aeee-5576a4dfebdd tempest-VolumesActionsTest-1453826651 tempest-VolumesActionsTest-1453826651-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:18:36.896362 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-5490a4a0-a6a7-45a8-aeee-5576a4dfebdd tempest-VolumesActionsTest-1453826651 tempest-VolumesActionsTest-1453826651-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:18:36.896994 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-5490a4a0-a6a7-45a8-aeee-5576a4dfebdd tempest-VolumesActionsTest-1453826651 tempest-VolumesActionsTest-1453826651-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:18:36.928501 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-fd16357b-e7f9-43c9-bf66-f172ba633dd7 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Calling method '>' {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:18:36.929110 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.compute.api [None req-fd16357b-e7f9-43c9-bf66-f172ba633dd7 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] [instance: eb851ab6-0e89-41d2-be52-d76cdc8644d6] Fetching instance by UUID {{(pid=117873) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:18:36.936920 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-fd16357b-e7f9-43c9-bf66-f172ba633dd7 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:18:36.937379 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-fd16357b-e7f9-43c9-bf66-f172ba633dd7 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:18:36.939137 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-fd16357b-e7f9-43c9-bf66-f172ba633dd7 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:18:36.940171 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-fd16357b-e7f9-43c9-bf66-f172ba633dd7 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:18:37.097181 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.policy [None req-5490a4a0-a6a7-45a8-aeee-5576a4dfebdd tempest-VolumesActionsTest-1453826651 tempest-VolumesActionsTest-1453826651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9517119110f4ab99bff1379d5f7e241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b75addf2f334d7cb584ccae7779d3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117874) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:18:37.105723 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [None req-5490a4a0-a6a7-45a8-aeee-5576a4dfebdd tempest-VolumesActionsTest-1453826651 tempest-VolumesActionsTest-1453826651-project] 10.222.0.43 "GET /compute/v2.1/servers/884a31e3-235c-4ca6-84e5-3dbdcd403d4d" status: 200 len: 1497 microversion: 2.1 time: 0.225996 Jun 22 10:18:37.111180 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 217/415] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:18:36 2022] GET /compute/v2.1/servers/884a31e3-235c-4ca6-84e5-3dbdcd403d4d => generated 1497 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:18:37.161628 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.policy [None req-fd16357b-e7f9-43c9-bf66-f172ba633dd7 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78fe3fc4334c43d7a5ef6d70f9f57523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad52333bcbec425089c44c3e55df97ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117873) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:18:37.170518 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [None req-fd16357b-e7f9-43c9-bf66-f172ba633dd7 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] 10.222.0.43 "GET /compute/v2.1/servers/eb851ab6-0e89-41d2-be52-d76cdc8644d6" status: 200 len: 1724 microversion: 2.1 time: 0.245738 Jun 22 10:18:37.171095 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 199/416] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:18:36 2022] GET /compute/v2.1/servers/eb851ab6-0e89-41d2-be52-d76cdc8644d6 => generated 1724 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 10:18:37.629818 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-583d0cd9-4ca6-4168-8e59-8da04eed137a tempest-VolumesActionsTest-1453826651 tempest-VolumesActionsTest-1453826651-project] Calling method '>' {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:18:37.630610 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.compute.api [None req-583d0cd9-4ca6-4168-8e59-8da04eed137a tempest-VolumesActionsTest-1453826651 tempest-VolumesActionsTest-1453826651-project] [instance: 884a31e3-235c-4ca6-84e5-3dbdcd403d4d] Fetching instance by UUID {{(pid=117874) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:18:37.637997 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-583d0cd9-4ca6-4168-8e59-8da04eed137a tempest-VolumesActionsTest-1453826651 tempest-VolumesActionsTest-1453826651-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:18:37.638644 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-583d0cd9-4ca6-4168-8e59-8da04eed137a tempest-VolumesActionsTest-1453826651 tempest-VolumesActionsTest-1453826651-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:18:37.639497 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-583d0cd9-4ca6-4168-8e59-8da04eed137a tempest-VolumesActionsTest-1453826651 tempest-VolumesActionsTest-1453826651-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:18:37.639998 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-583d0cd9-4ca6-4168-8e59-8da04eed137a tempest-VolumesActionsTest-1453826651 tempest-VolumesActionsTest-1453826651-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:18:37.671287 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.compute.api [None req-583d0cd9-4ca6-4168-8e59-8da04eed137a tempest-VolumesActionsTest-1453826651 tempest-VolumesActionsTest-1453826651-project] [instance: 884a31e3-235c-4ca6-84e5-3dbdcd403d4d] Going to try to terminate instance {{(pid=117874) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 22 10:18:37.718352 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-e5f23765-d33f-4dc2-a3b7-d9a4b0d05756 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Calling method '>' {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:18:37.718961 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.compute.api [None req-e5f23765-d33f-4dc2-a3b7-d9a4b0d05756 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] [instance: 73dbd5ab-5688-4de4-9da2-0b89d7cefb11] Fetching instance by UUID {{(pid=117873) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:18:37.729305 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-e5f23765-d33f-4dc2-a3b7-d9a4b0d05756 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:18:37.731532 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-e5f23765-d33f-4dc2-a3b7-d9a4b0d05756 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:18:37.734996 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-e5f23765-d33f-4dc2-a3b7-d9a4b0d05756 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:18:37.736605 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-e5f23765-d33f-4dc2-a3b7-d9a4b0d05756 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:18:37.781228 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG dbcounter [-] [117874] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=117874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:18:37.796028 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [None req-583d0cd9-4ca6-4168-8e59-8da04eed137a tempest-VolumesActionsTest-1453826651 tempest-VolumesActionsTest-1453826651-project] 10.222.0.43 "DELETE /compute/v2.1/servers/884a31e3-235c-4ca6-84e5-3dbdcd403d4d" status: 204 len: 0 microversion: 2.1 time: 0.169403 Jun 22 10:18:37.796639 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 218/417] 10.222.0.43 () {58 vars in 1238 bytes} [Wed Jun 22 10:18:37 2022] DELETE /compute/v2.1/servers/884a31e3-235c-4ca6-84e5-3dbdcd403d4d => generated 0 bytes in 172 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 22 10:18:37.807314 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-6132efdf-b06c-42e6-a997-97c29637421b tempest-VolumesActionsTest-1453826651 tempest-VolumesActionsTest-1453826651-project] Calling method '>' {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:18:37.808945 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.compute.api [None req-6132efdf-b06c-42e6-a997-97c29637421b tempest-VolumesActionsTest-1453826651 tempest-VolumesActionsTest-1453826651-project] [instance: 884a31e3-235c-4ca6-84e5-3dbdcd403d4d] Fetching instance by UUID {{(pid=117874) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:18:37.820201 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-6132efdf-b06c-42e6-a997-97c29637421b tempest-VolumesActionsTest-1453826651 tempest-VolumesActionsTest-1453826651-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:18:37.820861 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-6132efdf-b06c-42e6-a997-97c29637421b tempest-VolumesActionsTest-1453826651 tempest-VolumesActionsTest-1453826651-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:18:37.822072 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-6132efdf-b06c-42e6-a997-97c29637421b tempest-VolumesActionsTest-1453826651 tempest-VolumesActionsTest-1453826651-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:18:37.822727 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-6132efdf-b06c-42e6-a997-97c29637421b tempest-VolumesActionsTest-1453826651 tempest-VolumesActionsTest-1453826651-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:18:37.980764 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.policy [None req-e5f23765-d33f-4dc2-a3b7-d9a4b0d05756 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75753b29a78640df9622d4e2655baf9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee9d603d9cc4a8797f55d544f189720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117873) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:18:37.990420 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.policy [None req-e5f23765-d33f-4dc2-a3b7-d9a4b0d05756 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75753b29a78640df9622d4e2655baf9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee9d603d9cc4a8797f55d544f189720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117873) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:18:37.991932 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.policy [None req-e5f23765-d33f-4dc2-a3b7-d9a4b0d05756 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75753b29a78640df9622d4e2655baf9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee9d603d9cc4a8797f55d544f189720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117873) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:18:37.993078 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [None req-e5f23765-d33f-4dc2-a3b7-d9a4b0d05756 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] 10.222.0.43 "GET /compute/v2.1/servers/73dbd5ab-5688-4de4-9da2-0b89d7cefb11" status: 200 len: 1809 microversion: 2.20 time: 0.278677 Jun 22 10:18:37.993639 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 200/418] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jun 22 10:18:37 2022] GET /compute/v2.1/servers/73dbd5ab-5688-4de4-9da2-0b89d7cefb11 => generated 1809 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 22 10:18:38.039152 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.policy [None req-6132efdf-b06c-42e6-a997-97c29637421b tempest-VolumesActionsTest-1453826651 tempest-VolumesActionsTest-1453826651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9517119110f4ab99bff1379d5f7e241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b75addf2f334d7cb584ccae7779d3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117874) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:18:38.047189 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [None req-6132efdf-b06c-42e6-a997-97c29637421b tempest-VolumesActionsTest-1453826651 tempest-VolumesActionsTest-1453826651-project] 10.222.0.43 "GET /compute/v2.1/servers/884a31e3-235c-4ca6-84e5-3dbdcd403d4d" status: 200 len: 1503 microversion: 2.1 time: 0.245448 Jun 22 10:18:38.048872 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 219/419] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:18:37 2022] GET /compute/v2.1/servers/884a31e3-235c-4ca6-84e5-3dbdcd403d4d => generated 1503 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 10:18:38.187701 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-5fca129b-91b8-498f-9ef1-eea6c94e6b71 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Calling method '>' {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:18:38.189251 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.compute.api [None req-5fca129b-91b8-498f-9ef1-eea6c94e6b71 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] [instance: eb851ab6-0e89-41d2-be52-d76cdc8644d6] Fetching instance by UUID {{(pid=117873) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:18:38.195533 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-5fca129b-91b8-498f-9ef1-eea6c94e6b71 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:18:38.195980 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-5fca129b-91b8-498f-9ef1-eea6c94e6b71 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:18:38.196740 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-5fca129b-91b8-498f-9ef1-eea6c94e6b71 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:18:38.197178 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-5fca129b-91b8-498f-9ef1-eea6c94e6b71 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:18:38.336714 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.policy [None req-5fca129b-91b8-498f-9ef1-eea6c94e6b71 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78fe3fc4334c43d7a5ef6d70f9f57523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad52333bcbec425089c44c3e55df97ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117873) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:18:38.344806 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [None req-5fca129b-91b8-498f-9ef1-eea6c94e6b71 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] 10.222.0.43 "GET /compute/v2.1/servers/eb851ab6-0e89-41d2-be52-d76cdc8644d6" status: 200 len: 1724 microversion: 2.1 time: 0.160922 Jun 22 10:18:38.345389 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 201/420] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:18:38 2022] GET /compute/v2.1/servers/eb851ab6-0e89-41d2-be52-d76cdc8644d6 => generated 1724 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:18:39.012726 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-8269c4f9-1ef1-4992-835e-9002de37542b tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Calling method '>' {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:18:39.013337 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.compute.api [None req-8269c4f9-1ef1-4992-835e-9002de37542b tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] [instance: 73dbd5ab-5688-4de4-9da2-0b89d7cefb11] Fetching instance by UUID {{(pid=117874) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:18:39.020723 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-8269c4f9-1ef1-4992-835e-9002de37542b tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:18:39.021166 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-8269c4f9-1ef1-4992-835e-9002de37542b tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:18:39.021956 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-8269c4f9-1ef1-4992-835e-9002de37542b tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:18:39.022394 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-8269c4f9-1ef1-4992-835e-9002de37542b tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:18:39.065412 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-cbdf808b-9b9f-4886-a1ca-f36b936fce5b tempest-VolumesActionsTest-1453826651 tempest-VolumesActionsTest-1453826651-project] Calling method '>' {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:18:39.066153 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.compute.api [None req-cbdf808b-9b9f-4886-a1ca-f36b936fce5b tempest-VolumesActionsTest-1453826651 tempest-VolumesActionsTest-1453826651-project] [instance: 884a31e3-235c-4ca6-84e5-3dbdcd403d4d] Fetching instance by UUID {{(pid=117873) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:18:39.072556 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-cbdf808b-9b9f-4886-a1ca-f36b936fce5b tempest-VolumesActionsTest-1453826651 tempest-VolumesActionsTest-1453826651-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:18:39.072995 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-cbdf808b-9b9f-4886-a1ca-f36b936fce5b tempest-VolumesActionsTest-1453826651 tempest-VolumesActionsTest-1453826651-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:18:39.073772 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-cbdf808b-9b9f-4886-a1ca-f36b936fce5b tempest-VolumesActionsTest-1453826651 tempest-VolumesActionsTest-1453826651-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:18:39.074201 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-cbdf808b-9b9f-4886-a1ca-f36b936fce5b tempest-VolumesActionsTest-1453826651 tempest-VolumesActionsTest-1453826651-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:18:39.205635 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.policy [None req-8269c4f9-1ef1-4992-835e-9002de37542b tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75753b29a78640df9622d4e2655baf9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee9d603d9cc4a8797f55d544f189720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117874) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:18:39.216204 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.policy [None req-8269c4f9-1ef1-4992-835e-9002de37542b tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75753b29a78640df9622d4e2655baf9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee9d603d9cc4a8797f55d544f189720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117874) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:18:39.218154 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.policy [None req-8269c4f9-1ef1-4992-835e-9002de37542b tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75753b29a78640df9622d4e2655baf9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee9d603d9cc4a8797f55d544f189720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117874) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:18:39.219881 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [None req-8269c4f9-1ef1-4992-835e-9002de37542b tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] 10.222.0.43 "GET /compute/v2.1/servers/73dbd5ab-5688-4de4-9da2-0b89d7cefb11" status: 200 len: 1809 microversion: 2.20 time: 0.210551 Jun 22 10:18:39.220450 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 220/421] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jun 22 10:18:39 2022] GET /compute/v2.1/servers/73dbd5ab-5688-4de4-9da2-0b89d7cefb11 => generated 1809 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 10:18:39.244902 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.policy [None req-cbdf808b-9b9f-4886-a1ca-f36b936fce5b tempest-VolumesActionsTest-1453826651 tempest-VolumesActionsTest-1453826651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9517119110f4ab99bff1379d5f7e241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b75addf2f334d7cb584ccae7779d3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117873) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:18:39.253529 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [None req-cbdf808b-9b9f-4886-a1ca-f36b936fce5b tempest-VolumesActionsTest-1453826651 tempest-VolumesActionsTest-1453826651-project] 10.222.0.43 "GET /compute/v2.1/servers/884a31e3-235c-4ca6-84e5-3dbdcd403d4d" status: 200 len: 1503 microversion: 2.1 time: 0.191869 Jun 22 10:18:39.254128 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 202/422] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:18:39 2022] GET /compute/v2.1/servers/884a31e3-235c-4ca6-84e5-3dbdcd403d4d => generated 1503 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 10:18:39.362520 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-f80775cf-31cb-4dcb-8689-ce1e98d576af tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Calling method '>' {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:18:39.363073 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.compute.api [None req-f80775cf-31cb-4dcb-8689-ce1e98d576af tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] [instance: eb851ab6-0e89-41d2-be52-d76cdc8644d6] Fetching instance by UUID {{(pid=117874) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:18:39.369097 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-f80775cf-31cb-4dcb-8689-ce1e98d576af tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:18:39.369540 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-f80775cf-31cb-4dcb-8689-ce1e98d576af tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:18:39.370353 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-f80775cf-31cb-4dcb-8689-ce1e98d576af tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:18:39.370817 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-f80775cf-31cb-4dcb-8689-ce1e98d576af tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:18:39.503563 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.policy [None req-f80775cf-31cb-4dcb-8689-ce1e98d576af tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78fe3fc4334c43d7a5ef6d70f9f57523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad52333bcbec425089c44c3e55df97ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117874) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:18:39.512117 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [None req-f80775cf-31cb-4dcb-8689-ce1e98d576af tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] 10.222.0.43 "GET /compute/v2.1/servers/eb851ab6-0e89-41d2-be52-d76cdc8644d6" status: 200 len: 1724 microversion: 2.1 time: 0.153443 Jun 22 10:18:39.512693 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 221/423] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:18:39 2022] GET /compute/v2.1/servers/eb851ab6-0e89-41d2-be52-d76cdc8644d6 => generated 1724 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:18:40.063528 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [req-48f32836-fddf-414f-9546-3e145f8ba3fc req-c1299166-184b-4c9f-874b-d3c70520917e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "884a31e3-235c-4ca6-84e5-3dbdcd403d4d", "name": "network-vif-deleted", "tag": "4d2f6e47-53cb-4939-a600-4f5f86cf4334"}]} {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:18:40.087662 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [req-48f32836-fddf-414f-9546-3e145f8ba3fc req-c1299166-184b-4c9f-874b-d3c70520917e service nova] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:18:40.088934 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [req-48f32836-fddf-414f-9546-3e145f8ba3fc req-c1299166-184b-4c9f-874b-d3c70520917e service nova] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:18:40.102796 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.compute.server_external_events [req-48f32836-fddf-414f-9546-3e145f8ba3fc req-c1299166-184b-4c9f-874b-d3c70520917e service nova] Creating event network-vif-deleted:4d2f6e47-53cb-4939-a600-4f5f86cf4334 for instance 884a31e3-235c-4ca6-84e5-3dbdcd403d4d on hv-cinder-84713 Jun 22 10:18:40.109153 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [req-48f32836-fddf-414f-9546-3e145f8ba3fc req-c1299166-184b-4c9f-874b-d3c70520917e service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051163 Jun 22 10:18:40.112069 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 203/424] 10.222.0.43 () {64 vars in 1317 bytes} [Wed Jun 22 10:18:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 10:18:40.241393 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-d8baeabb-4d11-441a-856b-6cfa06b4371a tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Calling method '>' {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:18:40.242134 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.compute.api [None req-d8baeabb-4d11-441a-856b-6cfa06b4371a tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] [instance: 73dbd5ab-5688-4de4-9da2-0b89d7cefb11] Fetching instance by UUID {{(pid=117874) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:18:40.249769 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-d8baeabb-4d11-441a-856b-6cfa06b4371a tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:18:40.250201 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-d8baeabb-4d11-441a-856b-6cfa06b4371a tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:18:40.251488 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-d8baeabb-4d11-441a-856b-6cfa06b4371a tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:18:40.251927 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-d8baeabb-4d11-441a-856b-6cfa06b4371a tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:18:40.273352 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-bc2320af-c0c8-4252-96b9-c87ce2e0dd1e tempest-VolumesActionsTest-1453826651 tempest-VolumesActionsTest-1453826651-project] Calling method '>' {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:18:40.274254 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.compute.api [None req-bc2320af-c0c8-4252-96b9-c87ce2e0dd1e tempest-VolumesActionsTest-1453826651 tempest-VolumesActionsTest-1453826651-project] [instance: 884a31e3-235c-4ca6-84e5-3dbdcd403d4d] Fetching instance by UUID {{(pid=117873) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:18:40.281777 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-bc2320af-c0c8-4252-96b9-c87ce2e0dd1e tempest-VolumesActionsTest-1453826651 tempest-VolumesActionsTest-1453826651-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:18:40.282423 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-bc2320af-c0c8-4252-96b9-c87ce2e0dd1e tempest-VolumesActionsTest-1453826651 tempest-VolumesActionsTest-1453826651-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:18:40.283444 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-bc2320af-c0c8-4252-96b9-c87ce2e0dd1e tempest-VolumesActionsTest-1453826651 tempest-VolumesActionsTest-1453826651-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:18:40.283876 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-bc2320af-c0c8-4252-96b9-c87ce2e0dd1e tempest-VolumesActionsTest-1453826651 tempest-VolumesActionsTest-1453826651-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:18:40.323420 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-bc2320af-c0c8-4252-96b9-c87ce2e0dd1e tempest-VolumesActionsTest-1453826651 tempest-VolumesActionsTest-1453826651-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:18:40.323883 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-bc2320af-c0c8-4252-96b9-c87ce2e0dd1e tempest-VolumesActionsTest-1453826651 tempest-VolumesActionsTest-1453826651-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:18:40.327098 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.objects.instance [None req-bc2320af-c0c8-4252-96b9-c87ce2e0dd1e tempest-VolumesActionsTest-1453826651 tempest-VolumesActionsTest-1453826651-project] Lazy-loading 'fault' on Instance uuid 884a31e3-235c-4ca6-84e5-3dbdcd403d4d {{(pid=117873) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 22 10:18:40.404828 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.policy [None req-bc2320af-c0c8-4252-96b9-c87ce2e0dd1e tempest-VolumesActionsTest-1453826651 tempest-VolumesActionsTest-1453826651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9517119110f4ab99bff1379d5f7e241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b75addf2f334d7cb584ccae7779d3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117873) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:18:40.412513 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [None req-bc2320af-c0c8-4252-96b9-c87ce2e0dd1e tempest-VolumesActionsTest-1453826651 tempest-VolumesActionsTest-1453826651-project] 10.222.0.43 "GET /compute/v2.1/servers/884a31e3-235c-4ca6-84e5-3dbdcd403d4d" status: 200 len: 1303 microversion: 2.1 time: 0.144522 Jun 22 10:18:40.423595 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 204/425] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:18:40 2022] GET /compute/v2.1/servers/884a31e3-235c-4ca6-84e5-3dbdcd403d4d => generated 1303 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 10:18:40.431875 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.policy [None req-d8baeabb-4d11-441a-856b-6cfa06b4371a tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75753b29a78640df9622d4e2655baf9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee9d603d9cc4a8797f55d544f189720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117874) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:18:40.451719 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.policy [None req-d8baeabb-4d11-441a-856b-6cfa06b4371a tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75753b29a78640df9622d4e2655baf9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee9d603d9cc4a8797f55d544f189720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117874) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:18:40.454036 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.policy [None req-d8baeabb-4d11-441a-856b-6cfa06b4371a tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75753b29a78640df9622d4e2655baf9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee9d603d9cc4a8797f55d544f189720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117874) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:18:40.456209 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [None req-d8baeabb-4d11-441a-856b-6cfa06b4371a tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] 10.222.0.43 "GET /compute/v2.1/servers/73dbd5ab-5688-4de4-9da2-0b89d7cefb11" status: 200 len: 1809 microversion: 2.20 time: 0.219619 Jun 22 10:18:40.457298 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 222/426] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jun 22 10:18:40 2022] GET /compute/v2.1/servers/73dbd5ab-5688-4de4-9da2-0b89d7cefb11 => generated 1809 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 10:18:40.531376 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-a325a6dc-199a-4081-a9e9-8fe7f8d12d74 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Calling method '>' {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:18:40.532857 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.compute.api [None req-a325a6dc-199a-4081-a9e9-8fe7f8d12d74 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] [instance: eb851ab6-0e89-41d2-be52-d76cdc8644d6] Fetching instance by UUID {{(pid=117873) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:18:40.539509 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-a325a6dc-199a-4081-a9e9-8fe7f8d12d74 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:18:40.540430 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-a325a6dc-199a-4081-a9e9-8fe7f8d12d74 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:18:40.541407 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-a325a6dc-199a-4081-a9e9-8fe7f8d12d74 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:18:40.542076 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-a325a6dc-199a-4081-a9e9-8fe7f8d12d74 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:18:40.697605 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.policy [None req-a325a6dc-199a-4081-a9e9-8fe7f8d12d74 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78fe3fc4334c43d7a5ef6d70f9f57523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad52333bcbec425089c44c3e55df97ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117873) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:18:40.708308 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [None req-a325a6dc-199a-4081-a9e9-8fe7f8d12d74 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] 10.222.0.43 "GET /compute/v2.1/servers/eb851ab6-0e89-41d2-be52-d76cdc8644d6" status: 200 len: 1724 microversion: 2.1 time: 0.181863 Jun 22 10:18:40.709046 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 205/427] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:18:40 2022] GET /compute/v2.1/servers/eb851ab6-0e89-41d2-be52-d76cdc8644d6 => generated 1724 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:18:41.432872 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-88c882d0-3ba9-4c1e-ba92-caf60a360ea8 tempest-VolumesActionsTest-1453826651 tempest-VolumesActionsTest-1453826651-project] Calling method '>' {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:18:41.433598 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.compute.api [None req-88c882d0-3ba9-4c1e-ba92-caf60a360ea8 tempest-VolumesActionsTest-1453826651 tempest-VolumesActionsTest-1453826651-project] [instance: 884a31e3-235c-4ca6-84e5-3dbdcd403d4d] Fetching instance by UUID {{(pid=117874) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:18:41.440657 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-88c882d0-3ba9-4c1e-ba92-caf60a360ea8 tempest-VolumesActionsTest-1453826651 tempest-VolumesActionsTest-1453826651-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:18:41.441193 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-88c882d0-3ba9-4c1e-ba92-caf60a360ea8 tempest-VolumesActionsTest-1453826651 tempest-VolumesActionsTest-1453826651-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:18:41.442135 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-88c882d0-3ba9-4c1e-ba92-caf60a360ea8 tempest-VolumesActionsTest-1453826651 tempest-VolumesActionsTest-1453826651-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:18:41.442681 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-88c882d0-3ba9-4c1e-ba92-caf60a360ea8 tempest-VolumesActionsTest-1453826651 tempest-VolumesActionsTest-1453826651-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:18:41.478739 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-588c4cd9-d4b5-4029-832e-40259561d28a tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Calling method '>' {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:18:41.480418 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.compute.api [None req-588c4cd9-d4b5-4029-832e-40259561d28a tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] [instance: 73dbd5ab-5688-4de4-9da2-0b89d7cefb11] Fetching instance by UUID {{(pid=117873) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:18:41.482210 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-88c882d0-3ba9-4c1e-ba92-caf60a360ea8 tempest-VolumesActionsTest-1453826651 tempest-VolumesActionsTest-1453826651-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:18:41.482654 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-88c882d0-3ba9-4c1e-ba92-caf60a360ea8 tempest-VolumesActionsTest-1453826651 tempest-VolumesActionsTest-1453826651-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:18:41.483106 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.objects.instance [None req-88c882d0-3ba9-4c1e-ba92-caf60a360ea8 tempest-VolumesActionsTest-1453826651 tempest-VolumesActionsTest-1453826651-project] Lazy-loading 'fault' on Instance uuid 884a31e3-235c-4ca6-84e5-3dbdcd403d4d {{(pid=117874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 22 10:18:41.488991 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-588c4cd9-d4b5-4029-832e-40259561d28a tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:18:41.489440 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-588c4cd9-d4b5-4029-832e-40259561d28a tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:18:41.490245 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-588c4cd9-d4b5-4029-832e-40259561d28a tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:18:41.490685 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-588c4cd9-d4b5-4029-832e-40259561d28a tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:18:41.531575 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.policy [None req-88c882d0-3ba9-4c1e-ba92-caf60a360ea8 tempest-VolumesActionsTest-1453826651 tempest-VolumesActionsTest-1453826651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9517119110f4ab99bff1379d5f7e241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b75addf2f334d7cb584ccae7779d3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117874) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:18:41.541730 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [None req-88c882d0-3ba9-4c1e-ba92-caf60a360ea8 tempest-VolumesActionsTest-1453826651 tempest-VolumesActionsTest-1453826651-project] 10.222.0.43 "GET /compute/v2.1/servers/884a31e3-235c-4ca6-84e5-3dbdcd403d4d" status: 200 len: 1303 microversion: 2.1 time: 0.113976 Jun 22 10:18:41.542828 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 223/428] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:18:41 2022] GET /compute/v2.1/servers/884a31e3-235c-4ca6-84e5-3dbdcd403d4d => generated 1303 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:18:41.676048 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.policy [None req-588c4cd9-d4b5-4029-832e-40259561d28a tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75753b29a78640df9622d4e2655baf9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee9d603d9cc4a8797f55d544f189720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117873) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:18:41.685172 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.policy [None req-588c4cd9-d4b5-4029-832e-40259561d28a tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75753b29a78640df9622d4e2655baf9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee9d603d9cc4a8797f55d544f189720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117873) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:18:41.686594 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.policy [None req-588c4cd9-d4b5-4029-832e-40259561d28a tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75753b29a78640df9622d4e2655baf9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee9d603d9cc4a8797f55d544f189720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117873) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:18:41.687735 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [None req-588c4cd9-d4b5-4029-832e-40259561d28a tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] 10.222.0.43 "GET /compute/v2.1/servers/73dbd5ab-5688-4de4-9da2-0b89d7cefb11" status: 200 len: 1809 microversion: 2.20 time: 0.215514 Jun 22 10:18:41.688344 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 206/429] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jun 22 10:18:41 2022] GET /compute/v2.1/servers/73dbd5ab-5688-4de4-9da2-0b89d7cefb11 => generated 1809 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 10:18:41.726058 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-dc74aca8-915c-445e-a913-f796dd890625 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Calling method '>' {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:18:41.726657 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.compute.api [None req-dc74aca8-915c-445e-a913-f796dd890625 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] [instance: eb851ab6-0e89-41d2-be52-d76cdc8644d6] Fetching instance by UUID {{(pid=117874) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:18:41.733513 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-dc74aca8-915c-445e-a913-f796dd890625 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:18:41.733988 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-dc74aca8-915c-445e-a913-f796dd890625 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:18:41.735558 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-dc74aca8-915c-445e-a913-f796dd890625 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:18:41.736135 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-dc74aca8-915c-445e-a913-f796dd890625 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:18:41.878659 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.policy [None req-dc74aca8-915c-445e-a913-f796dd890625 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78fe3fc4334c43d7a5ef6d70f9f57523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad52333bcbec425089c44c3e55df97ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117874) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:18:41.888076 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [None req-dc74aca8-915c-445e-a913-f796dd890625 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] 10.222.0.43 "GET /compute/v2.1/servers/eb851ab6-0e89-41d2-be52-d76cdc8644d6" status: 200 len: 1724 microversion: 2.1 time: 0.165813 Jun 22 10:18:41.890585 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 224/430] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:18:41 2022] GET /compute/v2.1/servers/eb851ab6-0e89-41d2-be52-d76cdc8644d6 => generated 1724 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:18:42.563899 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-1e24c9fe-6148-42fd-a098-3e0a215d0b45 tempest-VolumesActionsTest-1453826651 tempest-VolumesActionsTest-1453826651-project] Calling method '>' {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:18:42.564897 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.compute.api [None req-1e24c9fe-6148-42fd-a098-3e0a215d0b45 tempest-VolumesActionsTest-1453826651 tempest-VolumesActionsTest-1453826651-project] [instance: 884a31e3-235c-4ca6-84e5-3dbdcd403d4d] Fetching instance by UUID {{(pid=117873) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:18:42.571921 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-1e24c9fe-6148-42fd-a098-3e0a215d0b45 tempest-VolumesActionsTest-1453826651 tempest-VolumesActionsTest-1453826651-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:18:42.572725 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-1e24c9fe-6148-42fd-a098-3e0a215d0b45 tempest-VolumesActionsTest-1453826651 tempest-VolumesActionsTest-1453826651-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:18:42.573718 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-1e24c9fe-6148-42fd-a098-3e0a215d0b45 tempest-VolumesActionsTest-1453826651 tempest-VolumesActionsTest-1453826651-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:18:42.574358 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-1e24c9fe-6148-42fd-a098-3e0a215d0b45 tempest-VolumesActionsTest-1453826651 tempest-VolumesActionsTest-1453826651-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:18:42.609238 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG dbcounter [-] [117873] Writing DB stats nova_api:SELECT=100 {{(pid=117873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:18:42.611840 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-1e24c9fe-6148-42fd-a098-3e0a215d0b45 tempest-VolumesActionsTest-1453826651 tempest-VolumesActionsTest-1453826651-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:18:42.612329 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-1e24c9fe-6148-42fd-a098-3e0a215d0b45 tempest-VolumesActionsTest-1453826651 tempest-VolumesActionsTest-1453826651-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:18:42.612780 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.objects.instance [None req-1e24c9fe-6148-42fd-a098-3e0a215d0b45 tempest-VolumesActionsTest-1453826651 tempest-VolumesActionsTest-1453826651-project] Lazy-loading 'fault' on Instance uuid 884a31e3-235c-4ca6-84e5-3dbdcd403d4d {{(pid=117873) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 22 10:18:42.657387 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.policy [None req-1e24c9fe-6148-42fd-a098-3e0a215d0b45 tempest-VolumesActionsTest-1453826651 tempest-VolumesActionsTest-1453826651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9517119110f4ab99bff1379d5f7e241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b75addf2f334d7cb584ccae7779d3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117873) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:18:42.666048 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [None req-1e24c9fe-6148-42fd-a098-3e0a215d0b45 tempest-VolumesActionsTest-1453826651 tempest-VolumesActionsTest-1453826651-project] 10.222.0.43 "GET /compute/v2.1/servers/884a31e3-235c-4ca6-84e5-3dbdcd403d4d" status: 200 len: 1303 microversion: 2.1 time: 0.106443 Jun 22 10:18:42.666895 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 207/431] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:18:42 2022] GET /compute/v2.1/servers/884a31e3-235c-4ca6-84e5-3dbdcd403d4d => generated 1303 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:18:42.707949 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-f84bfaa9-1c73-4ee0-93f8-b873f96c9bce tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Calling method '>' {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:18:42.708658 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.compute.api [None req-f84bfaa9-1c73-4ee0-93f8-b873f96c9bce tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] [instance: 73dbd5ab-5688-4de4-9da2-0b89d7cefb11] Fetching instance by UUID {{(pid=117874) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:18:42.714713 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-f84bfaa9-1c73-4ee0-93f8-b873f96c9bce tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:18:42.715156 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-f84bfaa9-1c73-4ee0-93f8-b873f96c9bce tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:18:42.715910 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-f84bfaa9-1c73-4ee0-93f8-b873f96c9bce tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:18:42.716322 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-f84bfaa9-1c73-4ee0-93f8-b873f96c9bce tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:18:42.720478 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG dbcounter [-] [117874] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=117874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:18:42.876727 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.policy [None req-f84bfaa9-1c73-4ee0-93f8-b873f96c9bce tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75753b29a78640df9622d4e2655baf9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee9d603d9cc4a8797f55d544f189720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117874) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:18:42.907161 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.policy [None req-f84bfaa9-1c73-4ee0-93f8-b873f96c9bce tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75753b29a78640df9622d4e2655baf9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee9d603d9cc4a8797f55d544f189720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117874) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:18:42.915305 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.policy [None req-f84bfaa9-1c73-4ee0-93f8-b873f96c9bce tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75753b29a78640df9622d4e2655baf9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee9d603d9cc4a8797f55d544f189720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117874) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:18:42.924531 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [None req-f84bfaa9-1c73-4ee0-93f8-b873f96c9bce tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] 10.222.0.43 "GET /compute/v2.1/servers/73dbd5ab-5688-4de4-9da2-0b89d7cefb11" status: 200 len: 1809 microversion: 2.20 time: 0.220885 Jun 22 10:18:42.925416 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 225/432] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jun 22 10:18:42 2022] GET /compute/v2.1/servers/73dbd5ab-5688-4de4-9da2-0b89d7cefb11 => generated 1809 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 10:18:42.930813 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-7d0f058c-b7f3-4dfa-bc0a-f372de3348a4 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Calling method '>' {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:18:42.931718 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.compute.api [None req-7d0f058c-b7f3-4dfa-bc0a-f372de3348a4 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] [instance: eb851ab6-0e89-41d2-be52-d76cdc8644d6] Fetching instance by UUID {{(pid=117873) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:18:42.939685 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-7d0f058c-b7f3-4dfa-bc0a-f372de3348a4 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:18:42.940429 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-7d0f058c-b7f3-4dfa-bc0a-f372de3348a4 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:18:42.950791 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-7d0f058c-b7f3-4dfa-bc0a-f372de3348a4 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:18:42.950791 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-7d0f058c-b7f3-4dfa-bc0a-f372de3348a4 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:18:43.090436 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.policy [None req-7d0f058c-b7f3-4dfa-bc0a-f372de3348a4 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78fe3fc4334c43d7a5ef6d70f9f57523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad52333bcbec425089c44c3e55df97ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117873) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:18:43.099425 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [None req-7d0f058c-b7f3-4dfa-bc0a-f372de3348a4 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] 10.222.0.43 "GET /compute/v2.1/servers/eb851ab6-0e89-41d2-be52-d76cdc8644d6" status: 200 len: 1724 microversion: 2.1 time: 0.192513 Jun 22 10:18:43.109288 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 208/433] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:18:42 2022] GET /compute/v2.1/servers/eb851ab6-0e89-41d2-be52-d76cdc8644d6 => generated 1724 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 10:18:43.684043 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-079b412c-777d-49ff-97c8-273cf39a2ef7 tempest-VolumesActionsTest-1453826651 tempest-VolumesActionsTest-1453826651-project] Calling method '>' {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:18:43.684846 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.compute.api [None req-079b412c-777d-49ff-97c8-273cf39a2ef7 tempest-VolumesActionsTest-1453826651 tempest-VolumesActionsTest-1453826651-project] [instance: 884a31e3-235c-4ca6-84e5-3dbdcd403d4d] Fetching instance by UUID {{(pid=117874) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:18:43.691506 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-079b412c-777d-49ff-97c8-273cf39a2ef7 tempest-VolumesActionsTest-1453826651 tempest-VolumesActionsTest-1453826651-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:18:43.691952 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-079b412c-777d-49ff-97c8-273cf39a2ef7 tempest-VolumesActionsTest-1453826651 tempest-VolumesActionsTest-1453826651-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:18:43.692705 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-079b412c-777d-49ff-97c8-273cf39a2ef7 tempest-VolumesActionsTest-1453826651 tempest-VolumesActionsTest-1453826651-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:18:43.693129 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-079b412c-777d-49ff-97c8-273cf39a2ef7 tempest-VolumesActionsTest-1453826651 tempest-VolumesActionsTest-1453826651-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:18:43.727021 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-079b412c-777d-49ff-97c8-273cf39a2ef7 tempest-VolumesActionsTest-1453826651 tempest-VolumesActionsTest-1453826651-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:18:43.727849 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-079b412c-777d-49ff-97c8-273cf39a2ef7 tempest-VolumesActionsTest-1453826651 tempest-VolumesActionsTest-1453826651-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:18:43.728160 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.objects.instance [None req-079b412c-777d-49ff-97c8-273cf39a2ef7 tempest-VolumesActionsTest-1453826651 tempest-VolumesActionsTest-1453826651-project] Lazy-loading 'fault' on Instance uuid 884a31e3-235c-4ca6-84e5-3dbdcd403d4d {{(pid=117874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 22 10:18:43.772166 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.policy [None req-079b412c-777d-49ff-97c8-273cf39a2ef7 tempest-VolumesActionsTest-1453826651 tempest-VolumesActionsTest-1453826651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9517119110f4ab99bff1379d5f7e241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b75addf2f334d7cb584ccae7779d3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117874) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:18:43.780117 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [None req-079b412c-777d-49ff-97c8-273cf39a2ef7 tempest-VolumesActionsTest-1453826651 tempest-VolumesActionsTest-1453826651-project] 10.222.0.43 "GET /compute/v2.1/servers/884a31e3-235c-4ca6-84e5-3dbdcd403d4d" status: 200 len: 1303 microversion: 2.1 time: 0.099929 Jun 22 10:18:43.780698 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 226/434] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:18:43 2022] GET /compute/v2.1/servers/884a31e3-235c-4ca6-84e5-3dbdcd403d4d => generated 1303 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:18:43.954400 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-38890d92-9ab1-46d4-8afe-6186de84537e tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Calling method '>' {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:18:43.956216 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.compute.api [None req-38890d92-9ab1-46d4-8afe-6186de84537e tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] [instance: 73dbd5ab-5688-4de4-9da2-0b89d7cefb11] Fetching instance by UUID {{(pid=117873) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:18:43.963938 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-38890d92-9ab1-46d4-8afe-6186de84537e tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:18:43.964377 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-38890d92-9ab1-46d4-8afe-6186de84537e tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:18:43.965140 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-38890d92-9ab1-46d4-8afe-6186de84537e tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:18:43.965621 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-38890d92-9ab1-46d4-8afe-6186de84537e tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:18:43.968234 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG dbcounter [-] [117873] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=117873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:18:44.116752 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.policy [None req-38890d92-9ab1-46d4-8afe-6186de84537e tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75753b29a78640df9622d4e2655baf9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee9d603d9cc4a8797f55d544f189720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117873) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:18:44.117042 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-d803add8-bfa4-477e-9d29-e63c460be5f5 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Calling method '>' {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:18:44.117657 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.compute.api [None req-d803add8-bfa4-477e-9d29-e63c460be5f5 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] [instance: eb851ab6-0e89-41d2-be52-d76cdc8644d6] Fetching instance by UUID {{(pid=117874) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:18:44.124153 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-d803add8-bfa4-477e-9d29-e63c460be5f5 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:18:44.124866 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-d803add8-bfa4-477e-9d29-e63c460be5f5 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:18:44.126393 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-d803add8-bfa4-477e-9d29-e63c460be5f5 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:18:44.127174 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-d803add8-bfa4-477e-9d29-e63c460be5f5 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:18:44.127637 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.policy [None req-38890d92-9ab1-46d4-8afe-6186de84537e tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75753b29a78640df9622d4e2655baf9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee9d603d9cc4a8797f55d544f189720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117873) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:18:44.129178 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.policy [None req-38890d92-9ab1-46d4-8afe-6186de84537e tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75753b29a78640df9622d4e2655baf9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee9d603d9cc4a8797f55d544f189720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117873) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:18:44.130439 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [None req-38890d92-9ab1-46d4-8afe-6186de84537e tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] 10.222.0.43 "GET /compute/v2.1/servers/73dbd5ab-5688-4de4-9da2-0b89d7cefb11" status: 200 len: 1809 microversion: 2.20 time: 0.180900 Jun 22 10:18:44.139938 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 209/435] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jun 22 10:18:43 2022] GET /compute/v2.1/servers/73dbd5ab-5688-4de4-9da2-0b89d7cefb11 => generated 1809 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 10:18:44.276275 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.policy [None req-d803add8-bfa4-477e-9d29-e63c460be5f5 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78fe3fc4334c43d7a5ef6d70f9f57523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad52333bcbec425089c44c3e55df97ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117874) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:18:44.284826 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [None req-d803add8-bfa4-477e-9d29-e63c460be5f5 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] 10.222.0.43 "GET /compute/v2.1/servers/eb851ab6-0e89-41d2-be52-d76cdc8644d6" status: 200 len: 1724 microversion: 2.1 time: 0.171912 Jun 22 10:18:44.285454 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 227/436] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:18:44 2022] GET /compute/v2.1/servers/eb851ab6-0e89-41d2-be52-d76cdc8644d6 => generated 1724 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:18:44.797938 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-9bb3a093-410c-4aa3-a68f-daae72209e45 tempest-VolumesActionsTest-1453826651 tempest-VolumesActionsTest-1453826651-project] Calling method '>' {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:18:44.798649 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.compute.api [None req-9bb3a093-410c-4aa3-a68f-daae72209e45 tempest-VolumesActionsTest-1453826651 tempest-VolumesActionsTest-1453826651-project] [instance: 884a31e3-235c-4ca6-84e5-3dbdcd403d4d] Fetching instance by UUID {{(pid=117873) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:18:44.805397 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-9bb3a093-410c-4aa3-a68f-daae72209e45 tempest-VolumesActionsTest-1453826651 tempest-VolumesActionsTest-1453826651-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:18:44.805949 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-9bb3a093-410c-4aa3-a68f-daae72209e45 tempest-VolumesActionsTest-1453826651 tempest-VolumesActionsTest-1453826651-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:18:44.806803 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-9bb3a093-410c-4aa3-a68f-daae72209e45 tempest-VolumesActionsTest-1453826651 tempest-VolumesActionsTest-1453826651-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:18:44.807300 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-9bb3a093-410c-4aa3-a68f-daae72209e45 tempest-VolumesActionsTest-1453826651 tempest-VolumesActionsTest-1453826651-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:18:44.840761 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-9bb3a093-410c-4aa3-a68f-daae72209e45 tempest-VolumesActionsTest-1453826651 tempest-VolumesActionsTest-1453826651-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:18:44.841226 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-9bb3a093-410c-4aa3-a68f-daae72209e45 tempest-VolumesActionsTest-1453826651 tempest-VolumesActionsTest-1453826651-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:18:44.841703 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.objects.instance [None req-9bb3a093-410c-4aa3-a68f-daae72209e45 tempest-VolumesActionsTest-1453826651 tempest-VolumesActionsTest-1453826651-project] Lazy-loading 'fault' on Instance uuid 884a31e3-235c-4ca6-84e5-3dbdcd403d4d {{(pid=117873) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 22 10:18:44.886126 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.policy [None req-9bb3a093-410c-4aa3-a68f-daae72209e45 tempest-VolumesActionsTest-1453826651 tempest-VolumesActionsTest-1453826651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9517119110f4ab99bff1379d5f7e241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b75addf2f334d7cb584ccae7779d3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117873) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:18:44.894495 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [None req-9bb3a093-410c-4aa3-a68f-daae72209e45 tempest-VolumesActionsTest-1453826651 tempest-VolumesActionsTest-1453826651-project] 10.222.0.43 "GET /compute/v2.1/servers/884a31e3-235c-4ca6-84e5-3dbdcd403d4d" status: 200 len: 1303 microversion: 2.1 time: 0.101096 Jun 22 10:18:44.895080 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 210/437] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:18:44 2022] GET /compute/v2.1/servers/884a31e3-235c-4ca6-84e5-3dbdcd403d4d => generated 1303 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:18:45.148621 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-1b72ba40-64e0-415c-8a87-58cb2fbd2662 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Calling method '>' {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:18:45.149313 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.compute.api [None req-1b72ba40-64e0-415c-8a87-58cb2fbd2662 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] [instance: 73dbd5ab-5688-4de4-9da2-0b89d7cefb11] Fetching instance by UUID {{(pid=117874) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:18:45.158771 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-1b72ba40-64e0-415c-8a87-58cb2fbd2662 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:18:45.159303 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-1b72ba40-64e0-415c-8a87-58cb2fbd2662 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:18:45.160110 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-1b72ba40-64e0-415c-8a87-58cb2fbd2662 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:18:45.160602 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-1b72ba40-64e0-415c-8a87-58cb2fbd2662 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:18:45.302874 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-f7dd2689-30f6-4505-8438-9c58e170665b tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Calling method '>' {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:18:45.303463 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.compute.api [None req-f7dd2689-30f6-4505-8438-9c58e170665b tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] [instance: eb851ab6-0e89-41d2-be52-d76cdc8644d6] Fetching instance by UUID {{(pid=117873) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:18:45.310423 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.policy [None req-1b72ba40-64e0-415c-8a87-58cb2fbd2662 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75753b29a78640df9622d4e2655baf9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee9d603d9cc4a8797f55d544f189720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117874) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:18:45.310828 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-f7dd2689-30f6-4505-8438-9c58e170665b tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:18:45.311587 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-f7dd2689-30f6-4505-8438-9c58e170665b tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:18:45.312605 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-f7dd2689-30f6-4505-8438-9c58e170665b tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:18:45.313775 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-f7dd2689-30f6-4505-8438-9c58e170665b tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:18:45.321165 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.policy [None req-1b72ba40-64e0-415c-8a87-58cb2fbd2662 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75753b29a78640df9622d4e2655baf9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee9d603d9cc4a8797f55d544f189720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117874) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:18:45.322694 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.policy [None req-1b72ba40-64e0-415c-8a87-58cb2fbd2662 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75753b29a78640df9622d4e2655baf9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee9d603d9cc4a8797f55d544f189720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117874) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:18:45.323888 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [None req-1b72ba40-64e0-415c-8a87-58cb2fbd2662 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] 10.222.0.43 "GET /compute/v2.1/servers/73dbd5ab-5688-4de4-9da2-0b89d7cefb11" status: 200 len: 1809 microversion: 2.20 time: 0.179253 Jun 22 10:18:45.324450 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 228/438] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jun 22 10:18:45 2022] GET /compute/v2.1/servers/73dbd5ab-5688-4de4-9da2-0b89d7cefb11 => generated 1809 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 10:18:45.455874 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.policy [None req-f7dd2689-30f6-4505-8438-9c58e170665b tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78fe3fc4334c43d7a5ef6d70f9f57523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad52333bcbec425089c44c3e55df97ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117873) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:18:45.464451 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [None req-f7dd2689-30f6-4505-8438-9c58e170665b tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] 10.222.0.43 "GET /compute/v2.1/servers/eb851ab6-0e89-41d2-be52-d76cdc8644d6" status: 200 len: 1724 microversion: 2.1 time: 0.165554 Jun 22 10:18:45.465219 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 211/439] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:18:45 2022] GET /compute/v2.1/servers/eb851ab6-0e89-41d2-be52-d76cdc8644d6 => generated 1724 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 10:18:45.921030 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-04c2980a-9d41-482b-8b55-74e2dd4daa84 tempest-VolumesActionsTest-1453826651 tempest-VolumesActionsTest-1453826651-project] Calling method '>' {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:18:45.921641 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.compute.api [None req-04c2980a-9d41-482b-8b55-74e2dd4daa84 tempest-VolumesActionsTest-1453826651 tempest-VolumesActionsTest-1453826651-project] [instance: 884a31e3-235c-4ca6-84e5-3dbdcd403d4d] Fetching instance by UUID {{(pid=117874) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:18:45.928084 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-04c2980a-9d41-482b-8b55-74e2dd4daa84 tempest-VolumesActionsTest-1453826651 tempest-VolumesActionsTest-1453826651-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:18:45.928535 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-04c2980a-9d41-482b-8b55-74e2dd4daa84 tempest-VolumesActionsTest-1453826651 tempest-VolumesActionsTest-1453826651-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:18:45.929304 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-04c2980a-9d41-482b-8b55-74e2dd4daa84 tempest-VolumesActionsTest-1453826651 tempest-VolumesActionsTest-1453826651-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:18:45.929773 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-04c2980a-9d41-482b-8b55-74e2dd4daa84 tempest-VolumesActionsTest-1453826651 tempest-VolumesActionsTest-1453826651-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:18:45.962854 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-04c2980a-9d41-482b-8b55-74e2dd4daa84 tempest-VolumesActionsTest-1453826651 tempest-VolumesActionsTest-1453826651-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:18:45.963296 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-04c2980a-9d41-482b-8b55-74e2dd4daa84 tempest-VolumesActionsTest-1453826651 tempest-VolumesActionsTest-1453826651-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:18:45.963734 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.objects.instance [None req-04c2980a-9d41-482b-8b55-74e2dd4daa84 tempest-VolumesActionsTest-1453826651 tempest-VolumesActionsTest-1453826651-project] Lazy-loading 'fault' on Instance uuid 884a31e3-235c-4ca6-84e5-3dbdcd403d4d {{(pid=117874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 22 10:18:46.007363 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.policy [None req-04c2980a-9d41-482b-8b55-74e2dd4daa84 tempest-VolumesActionsTest-1453826651 tempest-VolumesActionsTest-1453826651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9517119110f4ab99bff1379d5f7e241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b75addf2f334d7cb584ccae7779d3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117874) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:18:46.015638 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [None req-04c2980a-9d41-482b-8b55-74e2dd4daa84 tempest-VolumesActionsTest-1453826651 tempest-VolumesActionsTest-1453826651-project] 10.222.0.43 "GET /compute/v2.1/servers/884a31e3-235c-4ca6-84e5-3dbdcd403d4d" status: 200 len: 1303 microversion: 2.1 time: 0.107671 Jun 22 10:18:46.016868 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 229/440] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:18:45 2022] GET /compute/v2.1/servers/884a31e3-235c-4ca6-84e5-3dbdcd403d4d => generated 1303 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:18:46.343783 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-0ac8c31a-198c-4540-8888-04c22703fddb tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Calling method '>' {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:18:46.344514 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.compute.api [None req-0ac8c31a-198c-4540-8888-04c22703fddb tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] [instance: 73dbd5ab-5688-4de4-9da2-0b89d7cefb11] Fetching instance by UUID {{(pid=117873) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:18:46.351533 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-0ac8c31a-198c-4540-8888-04c22703fddb tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:18:46.352236 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-0ac8c31a-198c-4540-8888-04c22703fddb tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:18:46.353828 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-0ac8c31a-198c-4540-8888-04c22703fddb tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:18:46.353993 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-0ac8c31a-198c-4540-8888-04c22703fddb tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:18:46.482210 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-867d7d75-e5a3-4473-8de9-6bcfb1978890 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Calling method '>' {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:18:46.482840 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.compute.api [None req-867d7d75-e5a3-4473-8de9-6bcfb1978890 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] [instance: eb851ab6-0e89-41d2-be52-d76cdc8644d6] Fetching instance by UUID {{(pid=117874) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:18:46.491154 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-867d7d75-e5a3-4473-8de9-6bcfb1978890 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:18:46.491994 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-867d7d75-e5a3-4473-8de9-6bcfb1978890 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:18:46.492841 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-867d7d75-e5a3-4473-8de9-6bcfb1978890 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:18:46.493344 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-867d7d75-e5a3-4473-8de9-6bcfb1978890 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:18:46.509217 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.policy [None req-0ac8c31a-198c-4540-8888-04c22703fddb tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75753b29a78640df9622d4e2655baf9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee9d603d9cc4a8797f55d544f189720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117873) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:18:46.518703 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.policy [None req-0ac8c31a-198c-4540-8888-04c22703fddb tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75753b29a78640df9622d4e2655baf9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee9d603d9cc4a8797f55d544f189720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117873) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:18:46.523785 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.policy [None req-0ac8c31a-198c-4540-8888-04c22703fddb tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75753b29a78640df9622d4e2655baf9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee9d603d9cc4a8797f55d544f189720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117873) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:18:46.525086 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [None req-0ac8c31a-198c-4540-8888-04c22703fddb tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] 10.222.0.43 "GET /compute/v2.1/servers/73dbd5ab-5688-4de4-9da2-0b89d7cefb11" status: 200 len: 1809 microversion: 2.20 time: 0.185376 Jun 22 10:18:46.531170 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 212/441] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jun 22 10:18:46 2022] GET /compute/v2.1/servers/73dbd5ab-5688-4de4-9da2-0b89d7cefb11 => generated 1809 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 10:18:46.633368 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.policy [None req-867d7d75-e5a3-4473-8de9-6bcfb1978890 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78fe3fc4334c43d7a5ef6d70f9f57523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad52333bcbec425089c44c3e55df97ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117874) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:18:46.641682 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [None req-867d7d75-e5a3-4473-8de9-6bcfb1978890 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] 10.222.0.43 "GET /compute/v2.1/servers/eb851ab6-0e89-41d2-be52-d76cdc8644d6" status: 200 len: 1724 microversion: 2.1 time: 0.163500 Jun 22 10:18:46.642317 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 230/442] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:18:46 2022] GET /compute/v2.1/servers/eb851ab6-0e89-41d2-be52-d76cdc8644d6 => generated 1724 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:18:47.034365 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-7b052a2f-edd9-4fe0-9a51-50bd11f11b33 tempest-VolumesActionsTest-1453826651 tempest-VolumesActionsTest-1453826651-project] Calling method '>' {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:18:47.035298 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.compute.api [None req-7b052a2f-edd9-4fe0-9a51-50bd11f11b33 tempest-VolumesActionsTest-1453826651 tempest-VolumesActionsTest-1453826651-project] [instance: 884a31e3-235c-4ca6-84e5-3dbdcd403d4d] Fetching instance by UUID {{(pid=117873) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:18:47.041457 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-7b052a2f-edd9-4fe0-9a51-50bd11f11b33 tempest-VolumesActionsTest-1453826651 tempest-VolumesActionsTest-1453826651-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:18:47.041937 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-7b052a2f-edd9-4fe0-9a51-50bd11f11b33 tempest-VolumesActionsTest-1453826651 tempest-VolumesActionsTest-1453826651-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:18:47.042704 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-7b052a2f-edd9-4fe0-9a51-50bd11f11b33 tempest-VolumesActionsTest-1453826651 tempest-VolumesActionsTest-1453826651-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:18:47.043137 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-7b052a2f-edd9-4fe0-9a51-50bd11f11b33 tempest-VolumesActionsTest-1453826651 tempest-VolumesActionsTest-1453826651-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:18:47.080061 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-7b052a2f-edd9-4fe0-9a51-50bd11f11b33 tempest-VolumesActionsTest-1453826651 tempest-VolumesActionsTest-1453826651-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:18:47.080511 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-7b052a2f-edd9-4fe0-9a51-50bd11f11b33 tempest-VolumesActionsTest-1453826651 tempest-VolumesActionsTest-1453826651-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:18:47.080970 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.objects.instance [None req-7b052a2f-edd9-4fe0-9a51-50bd11f11b33 tempest-VolumesActionsTest-1453826651 tempest-VolumesActionsTest-1453826651-project] Lazy-loading 'fault' on Instance uuid 884a31e3-235c-4ca6-84e5-3dbdcd403d4d {{(pid=117873) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 22 10:18:47.124244 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.policy [None req-7b052a2f-edd9-4fe0-9a51-50bd11f11b33 tempest-VolumesActionsTest-1453826651 tempest-VolumesActionsTest-1453826651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9517119110f4ab99bff1379d5f7e241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b75addf2f334d7cb584ccae7779d3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117873) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:18:47.134465 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [None req-7b052a2f-edd9-4fe0-9a51-50bd11f11b33 tempest-VolumesActionsTest-1453826651 tempest-VolumesActionsTest-1453826651-project] 10.222.0.43 "GET /compute/v2.1/servers/884a31e3-235c-4ca6-84e5-3dbdcd403d4d" status: 200 len: 1303 microversion: 2.1 time: 0.104657 Jun 22 10:18:47.135282 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 213/443] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:18:47 2022] GET /compute/v2.1/servers/884a31e3-235c-4ca6-84e5-3dbdcd403d4d => generated 1303 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:18:47.544111 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-c60616a1-c231-45ae-9032-6400a8108fdc tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Calling method '>' {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:18:47.544756 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.compute.api [None req-c60616a1-c231-45ae-9032-6400a8108fdc tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] [instance: 73dbd5ab-5688-4de4-9da2-0b89d7cefb11] Fetching instance by UUID {{(pid=117874) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:18:47.552757 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-c60616a1-c231-45ae-9032-6400a8108fdc tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:18:47.553203 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-c60616a1-c231-45ae-9032-6400a8108fdc tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:18:47.553998 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-c60616a1-c231-45ae-9032-6400a8108fdc tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:18:47.554416 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-c60616a1-c231-45ae-9032-6400a8108fdc tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:18:47.659129 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-b3428847-4243-473b-b63d-dbb77a176a4d tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Calling method '>' {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:18:47.663253 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.compute.api [None req-b3428847-4243-473b-b63d-dbb77a176a4d tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] [instance: eb851ab6-0e89-41d2-be52-d76cdc8644d6] Fetching instance by UUID {{(pid=117873) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:18:47.673258 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-b3428847-4243-473b-b63d-dbb77a176a4d tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:18:47.673783 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-b3428847-4243-473b-b63d-dbb77a176a4d tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:18:47.674663 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-b3428847-4243-473b-b63d-dbb77a176a4d tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:18:47.675087 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-b3428847-4243-473b-b63d-dbb77a176a4d tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:18:47.705328 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.policy [None req-c60616a1-c231-45ae-9032-6400a8108fdc tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75753b29a78640df9622d4e2655baf9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee9d603d9cc4a8797f55d544f189720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117874) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:18:47.715732 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.policy [None req-c60616a1-c231-45ae-9032-6400a8108fdc tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75753b29a78640df9622d4e2655baf9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee9d603d9cc4a8797f55d544f189720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117874) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:18:47.717421 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.policy [None req-c60616a1-c231-45ae-9032-6400a8108fdc tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75753b29a78640df9622d4e2655baf9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee9d603d9cc4a8797f55d544f189720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117874) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:18:47.718629 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [None req-c60616a1-c231-45ae-9032-6400a8108fdc tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] 10.222.0.43 "GET /compute/v2.1/servers/73dbd5ab-5688-4de4-9da2-0b89d7cefb11" status: 200 len: 1809 microversion: 2.20 time: 0.178572 Jun 22 10:18:47.741206 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 231/444] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jun 22 10:18:47 2022] GET /compute/v2.1/servers/73dbd5ab-5688-4de4-9da2-0b89d7cefb11 => generated 1809 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 10:18:47.825521 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.policy [None req-b3428847-4243-473b-b63d-dbb77a176a4d tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78fe3fc4334c43d7a5ef6d70f9f57523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad52333bcbec425089c44c3e55df97ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117873) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:18:47.841997 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [None req-b3428847-4243-473b-b63d-dbb77a176a4d tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] 10.222.0.43 "GET /compute/v2.1/servers/eb851ab6-0e89-41d2-be52-d76cdc8644d6" status: 200 len: 1724 microversion: 2.1 time: 0.186728 Jun 22 10:18:47.850213 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 214/445] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:18:47 2022] GET /compute/v2.1/servers/eb851ab6-0e89-41d2-be52-d76cdc8644d6 => generated 1724 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 10:18:48.152212 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-245de7c3-8caf-45f1-8048-efa29f90efd7 tempest-VolumesActionsTest-1453826651 tempest-VolumesActionsTest-1453826651-project] Calling method '>' {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:18:48.152821 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.compute.api [None req-245de7c3-8caf-45f1-8048-efa29f90efd7 tempest-VolumesActionsTest-1453826651 tempest-VolumesActionsTest-1453826651-project] [instance: 884a31e3-235c-4ca6-84e5-3dbdcd403d4d] Fetching instance by UUID {{(pid=117874) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:18:48.160682 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-245de7c3-8caf-45f1-8048-efa29f90efd7 tempest-VolumesActionsTest-1453826651 tempest-VolumesActionsTest-1453826651-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:18:48.161116 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-245de7c3-8caf-45f1-8048-efa29f90efd7 tempest-VolumesActionsTest-1453826651 tempest-VolumesActionsTest-1453826651-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:18:48.161916 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-245de7c3-8caf-45f1-8048-efa29f90efd7 tempest-VolumesActionsTest-1453826651 tempest-VolumesActionsTest-1453826651-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:18:48.162350 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-245de7c3-8caf-45f1-8048-efa29f90efd7 tempest-VolumesActionsTest-1453826651 tempest-VolumesActionsTest-1453826651-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:18:48.195563 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-245de7c3-8caf-45f1-8048-efa29f90efd7 tempest-VolumesActionsTest-1453826651 tempest-VolumesActionsTest-1453826651-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:18:48.196010 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-245de7c3-8caf-45f1-8048-efa29f90efd7 tempest-VolumesActionsTest-1453826651 tempest-VolumesActionsTest-1453826651-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:18:48.196460 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.objects.instance [None req-245de7c3-8caf-45f1-8048-efa29f90efd7 tempest-VolumesActionsTest-1453826651 tempest-VolumesActionsTest-1453826651-project] Lazy-loading 'fault' on Instance uuid 884a31e3-235c-4ca6-84e5-3dbdcd403d4d {{(pid=117874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 22 10:18:48.240419 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.policy [None req-245de7c3-8caf-45f1-8048-efa29f90efd7 tempest-VolumesActionsTest-1453826651 tempest-VolumesActionsTest-1453826651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9517119110f4ab99bff1379d5f7e241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b75addf2f334d7cb584ccae7779d3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117874) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:18:48.247996 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [None req-245de7c3-8caf-45f1-8048-efa29f90efd7 tempest-VolumesActionsTest-1453826651 tempest-VolumesActionsTest-1453826651-project] 10.222.0.43 "GET /compute/v2.1/servers/884a31e3-235c-4ca6-84e5-3dbdcd403d4d" status: 200 len: 1303 microversion: 2.1 time: 0.099694 Jun 22 10:18:48.248554 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 232/446] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:18:48 2022] GET /compute/v2.1/servers/884a31e3-235c-4ca6-84e5-3dbdcd403d4d => generated 1303 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:18:48.748873 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-f4dec18e-52b0-4bda-897a-8bb46d22d5df tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Calling method '>' {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:18:48.749560 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.compute.api [None req-f4dec18e-52b0-4bda-897a-8bb46d22d5df tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] [instance: 73dbd5ab-5688-4de4-9da2-0b89d7cefb11] Fetching instance by UUID {{(pid=117873) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:18:48.756296 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-f4dec18e-52b0-4bda-897a-8bb46d22d5df tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:18:48.756740 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-f4dec18e-52b0-4bda-897a-8bb46d22d5df tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:18:48.757510 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-f4dec18e-52b0-4bda-897a-8bb46d22d5df tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:18:48.758003 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-f4dec18e-52b0-4bda-897a-8bb46d22d5df tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:18:48.859913 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-f1e65c69-0e86-4b00-b46f-6513dce18f0e tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Calling method '>' {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:18:48.860558 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.compute.api [None req-f1e65c69-0e86-4b00-b46f-6513dce18f0e tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] [instance: eb851ab6-0e89-41d2-be52-d76cdc8644d6] Fetching instance by UUID {{(pid=117874) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:18:48.867829 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-f1e65c69-0e86-4b00-b46f-6513dce18f0e tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:18:48.868285 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-f1e65c69-0e86-4b00-b46f-6513dce18f0e tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:18:48.869070 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-f1e65c69-0e86-4b00-b46f-6513dce18f0e tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:18:48.873682 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-f1e65c69-0e86-4b00-b46f-6513dce18f0e tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:18:48.912329 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.policy [None req-f4dec18e-52b0-4bda-897a-8bb46d22d5df tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75753b29a78640df9622d4e2655baf9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee9d603d9cc4a8797f55d544f189720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117873) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:18:48.922909 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.policy [None req-f4dec18e-52b0-4bda-897a-8bb46d22d5df tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75753b29a78640df9622d4e2655baf9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee9d603d9cc4a8797f55d544f189720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117873) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:18:48.924775 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.policy [None req-f4dec18e-52b0-4bda-897a-8bb46d22d5df tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75753b29a78640df9622d4e2655baf9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee9d603d9cc4a8797f55d544f189720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117873) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:18:48.926250 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [None req-f4dec18e-52b0-4bda-897a-8bb46d22d5df tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] 10.222.0.43 "GET /compute/v2.1/servers/73dbd5ab-5688-4de4-9da2-0b89d7cefb11" status: 200 len: 1809 microversion: 2.20 time: 0.181468 Jun 22 10:18:48.927088 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 215/447] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jun 22 10:18:48 2022] GET /compute/v2.1/servers/73dbd5ab-5688-4de4-9da2-0b89d7cefb11 => generated 1809 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 22 10:18:49.029106 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.policy [None req-f1e65c69-0e86-4b00-b46f-6513dce18f0e tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78fe3fc4334c43d7a5ef6d70f9f57523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad52333bcbec425089c44c3e55df97ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117874) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:18:49.038035 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [None req-f1e65c69-0e86-4b00-b46f-6513dce18f0e tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] 10.222.0.43 "GET /compute/v2.1/servers/eb851ab6-0e89-41d2-be52-d76cdc8644d6" status: 200 len: 1724 microversion: 2.1 time: 0.181749 Jun 22 10:18:49.038813 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 233/448] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:18:48 2022] GET /compute/v2.1/servers/eb851ab6-0e89-41d2-be52-d76cdc8644d6 => generated 1724 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 10:18:49.268412 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-1d616bf7-010b-4eaf-a542-c59f591eca43 tempest-VolumesActionsTest-1453826651 tempest-VolumesActionsTest-1453826651-project] Calling method '>' {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:18:49.269059 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.compute.api [None req-1d616bf7-010b-4eaf-a542-c59f591eca43 tempest-VolumesActionsTest-1453826651 tempest-VolumesActionsTest-1453826651-project] [instance: 884a31e3-235c-4ca6-84e5-3dbdcd403d4d] Fetching instance by UUID {{(pid=117873) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:18:49.275284 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-1d616bf7-010b-4eaf-a542-c59f591eca43 tempest-VolumesActionsTest-1453826651 tempest-VolumesActionsTest-1453826651-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:18:49.275734 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-1d616bf7-010b-4eaf-a542-c59f591eca43 tempest-VolumesActionsTest-1453826651 tempest-VolumesActionsTest-1453826651-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:18:49.276512 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-1d616bf7-010b-4eaf-a542-c59f591eca43 tempest-VolumesActionsTest-1453826651 tempest-VolumesActionsTest-1453826651-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:18:49.276950 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-1d616bf7-010b-4eaf-a542-c59f591eca43 tempest-VolumesActionsTest-1453826651 tempest-VolumesActionsTest-1453826651-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:18:49.308992 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-1d616bf7-010b-4eaf-a542-c59f591eca43 tempest-VolumesActionsTest-1453826651 tempest-VolumesActionsTest-1453826651-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:18:49.309434 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-1d616bf7-010b-4eaf-a542-c59f591eca43 tempest-VolumesActionsTest-1453826651 tempest-VolumesActionsTest-1453826651-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:18:49.309913 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.objects.instance [None req-1d616bf7-010b-4eaf-a542-c59f591eca43 tempest-VolumesActionsTest-1453826651 tempest-VolumesActionsTest-1453826651-project] Lazy-loading 'fault' on Instance uuid 884a31e3-235c-4ca6-84e5-3dbdcd403d4d {{(pid=117873) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 22 10:18:49.350290 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.policy [None req-1d616bf7-010b-4eaf-a542-c59f591eca43 tempest-VolumesActionsTest-1453826651 tempest-VolumesActionsTest-1453826651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9517119110f4ab99bff1379d5f7e241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b75addf2f334d7cb584ccae7779d3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117873) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:18:49.357896 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [None req-1d616bf7-010b-4eaf-a542-c59f591eca43 tempest-VolumesActionsTest-1453826651 tempest-VolumesActionsTest-1453826651-project] 10.222.0.43 "GET /compute/v2.1/servers/884a31e3-235c-4ca6-84e5-3dbdcd403d4d" status: 200 len: 1303 microversion: 2.1 time: 0.094242 Jun 22 10:18:49.358460 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 216/449] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:18:49 2022] GET /compute/v2.1/servers/884a31e3-235c-4ca6-84e5-3dbdcd403d4d => generated 1303 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:18:49.944820 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-de15f834-900e-410a-8188-2e6f9ad06c6b tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Calling method '>' {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:18:49.945410 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.compute.api [None req-de15f834-900e-410a-8188-2e6f9ad06c6b tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] [instance: 73dbd5ab-5688-4de4-9da2-0b89d7cefb11] Fetching instance by UUID {{(pid=117874) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:18:49.951942 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-de15f834-900e-410a-8188-2e6f9ad06c6b tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:18:49.952383 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-de15f834-900e-410a-8188-2e6f9ad06c6b tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:18:49.953386 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-de15f834-900e-410a-8188-2e6f9ad06c6b tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:18:49.953814 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-de15f834-900e-410a-8188-2e6f9ad06c6b tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:18:50.054362 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-990925a2-0fbf-4a02-861c-3e5dc4eea683 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Calling method '>' {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:18:50.054973 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.compute.api [None req-990925a2-0fbf-4a02-861c-3e5dc4eea683 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] [instance: eb851ab6-0e89-41d2-be52-d76cdc8644d6] Fetching instance by UUID {{(pid=117873) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:18:50.061791 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-990925a2-0fbf-4a02-861c-3e5dc4eea683 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:18:50.062242 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-990925a2-0fbf-4a02-861c-3e5dc4eea683 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:18:50.063013 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-990925a2-0fbf-4a02-861c-3e5dc4eea683 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:18:50.063448 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-990925a2-0fbf-4a02-861c-3e5dc4eea683 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:18:50.091447 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.policy [None req-de15f834-900e-410a-8188-2e6f9ad06c6b tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75753b29a78640df9622d4e2655baf9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee9d603d9cc4a8797f55d544f189720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117874) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:18:50.099836 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.policy [None req-de15f834-900e-410a-8188-2e6f9ad06c6b tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75753b29a78640df9622d4e2655baf9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee9d603d9cc4a8797f55d544f189720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117874) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:18:50.101452 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.policy [None req-de15f834-900e-410a-8188-2e6f9ad06c6b tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75753b29a78640df9622d4e2655baf9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee9d603d9cc4a8797f55d544f189720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117874) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:18:50.102748 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [None req-de15f834-900e-410a-8188-2e6f9ad06c6b tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] 10.222.0.43 "GET /compute/v2.1/servers/73dbd5ab-5688-4de4-9da2-0b89d7cefb11" status: 200 len: 1809 microversion: 2.20 time: 0.161817 Jun 22 10:18:50.104004 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 234/450] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jun 22 10:18:49 2022] GET /compute/v2.1/servers/73dbd5ab-5688-4de4-9da2-0b89d7cefb11 => generated 1809 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 10:18:50.195634 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.policy [None req-990925a2-0fbf-4a02-861c-3e5dc4eea683 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78fe3fc4334c43d7a5ef6d70f9f57523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad52333bcbec425089c44c3e55df97ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117873) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:18:50.203958 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [None req-990925a2-0fbf-4a02-861c-3e5dc4eea683 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] 10.222.0.43 "GET /compute/v2.1/servers/eb851ab6-0e89-41d2-be52-d76cdc8644d6" status: 200 len: 1724 microversion: 2.1 time: 0.152928 Jun 22 10:18:50.204518 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 217/451] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:18:50 2022] GET /compute/v2.1/servers/eb851ab6-0e89-41d2-be52-d76cdc8644d6 => generated 1724 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 10:18:50.377267 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-a30f4792-6c11-455c-b5d7-2cee9f044927 tempest-VolumesActionsTest-1453826651 tempest-VolumesActionsTest-1453826651-project] Calling method '>' {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:18:50.377925 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.compute.api [None req-a30f4792-6c11-455c-b5d7-2cee9f044927 tempest-VolumesActionsTest-1453826651 tempest-VolumesActionsTest-1453826651-project] [instance: 884a31e3-235c-4ca6-84e5-3dbdcd403d4d] Fetching instance by UUID {{(pid=117874) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:18:50.384224 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-a30f4792-6c11-455c-b5d7-2cee9f044927 tempest-VolumesActionsTest-1453826651 tempest-VolumesActionsTest-1453826651-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:18:50.384678 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-a30f4792-6c11-455c-b5d7-2cee9f044927 tempest-VolumesActionsTest-1453826651 tempest-VolumesActionsTest-1453826651-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:18:50.385442 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-a30f4792-6c11-455c-b5d7-2cee9f044927 tempest-VolumesActionsTest-1453826651 tempest-VolumesActionsTest-1453826651-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:18:50.385997 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-a30f4792-6c11-455c-b5d7-2cee9f044927 tempest-VolumesActionsTest-1453826651 tempest-VolumesActionsTest-1453826651-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:18:50.421009 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-a30f4792-6c11-455c-b5d7-2cee9f044927 tempest-VolumesActionsTest-1453826651 tempest-VolumesActionsTest-1453826651-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:18:50.421009 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-a30f4792-6c11-455c-b5d7-2cee9f044927 tempest-VolumesActionsTest-1453826651 tempest-VolumesActionsTest-1453826651-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:18:50.421009 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.objects.instance [None req-a30f4792-6c11-455c-b5d7-2cee9f044927 tempest-VolumesActionsTest-1453826651 tempest-VolumesActionsTest-1453826651-project] Lazy-loading 'fault' on Instance uuid 884a31e3-235c-4ca6-84e5-3dbdcd403d4d {{(pid=117874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 22 10:18:50.473255 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.policy [None req-a30f4792-6c11-455c-b5d7-2cee9f044927 tempest-VolumesActionsTest-1453826651 tempest-VolumesActionsTest-1453826651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9517119110f4ab99bff1379d5f7e241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b75addf2f334d7cb584ccae7779d3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117874) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:18:50.481024 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [None req-a30f4792-6c11-455c-b5d7-2cee9f044927 tempest-VolumesActionsTest-1453826651 tempest-VolumesActionsTest-1453826651-project] 10.222.0.43 "GET /compute/v2.1/servers/884a31e3-235c-4ca6-84e5-3dbdcd403d4d" status: 200 len: 1303 microversion: 2.1 time: 0.108323 Jun 22 10:18:50.481590 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 235/452] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:18:50 2022] GET /compute/v2.1/servers/884a31e3-235c-4ca6-84e5-3dbdcd403d4d => generated 1303 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:18:51.122334 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-c3667021-7378-4ff9-b4a1-ab3fd6fec111 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Calling method '>' {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:18:51.123349 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.compute.api [None req-c3667021-7378-4ff9-b4a1-ab3fd6fec111 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] [instance: 73dbd5ab-5688-4de4-9da2-0b89d7cefb11] Fetching instance by UUID {{(pid=117873) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:18:51.130785 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-c3667021-7378-4ff9-b4a1-ab3fd6fec111 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:18:51.131230 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-c3667021-7378-4ff9-b4a1-ab3fd6fec111 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:18:51.131991 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-c3667021-7378-4ff9-b4a1-ab3fd6fec111 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:18:51.132416 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-c3667021-7378-4ff9-b4a1-ab3fd6fec111 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:18:51.220612 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-f08a91cd-d308-4b43-92c9-6e93c19264a6 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Calling method '>' {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:18:51.221850 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.compute.api [None req-f08a91cd-d308-4b43-92c9-6e93c19264a6 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] [instance: eb851ab6-0e89-41d2-be52-d76cdc8644d6] Fetching instance by UUID {{(pid=117874) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:18:51.228701 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-f08a91cd-d308-4b43-92c9-6e93c19264a6 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:18:51.229141 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-f08a91cd-d308-4b43-92c9-6e93c19264a6 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:18:51.229934 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-f08a91cd-d308-4b43-92c9-6e93c19264a6 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:18:51.230360 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-f08a91cd-d308-4b43-92c9-6e93c19264a6 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:18:51.286313 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.policy [None req-c3667021-7378-4ff9-b4a1-ab3fd6fec111 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75753b29a78640df9622d4e2655baf9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee9d603d9cc4a8797f55d544f189720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117873) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:18:51.295000 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.policy [None req-c3667021-7378-4ff9-b4a1-ab3fd6fec111 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75753b29a78640df9622d4e2655baf9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee9d603d9cc4a8797f55d544f189720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117873) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:18:51.296999 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.policy [None req-c3667021-7378-4ff9-b4a1-ab3fd6fec111 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75753b29a78640df9622d4e2655baf9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee9d603d9cc4a8797f55d544f189720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117873) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:18:51.298817 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [None req-c3667021-7378-4ff9-b4a1-ab3fd6fec111 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] 10.222.0.43 "GET /compute/v2.1/servers/73dbd5ab-5688-4de4-9da2-0b89d7cefb11" status: 200 len: 1809 microversion: 2.20 time: 0.180133 Jun 22 10:18:51.299590 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 218/453] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jun 22 10:18:51 2022] GET /compute/v2.1/servers/73dbd5ab-5688-4de4-9da2-0b89d7cefb11 => generated 1809 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 10:18:51.374900 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.policy [None req-f08a91cd-d308-4b43-92c9-6e93c19264a6 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78fe3fc4334c43d7a5ef6d70f9f57523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad52333bcbec425089c44c3e55df97ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117874) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:18:51.383782 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [None req-f08a91cd-d308-4b43-92c9-6e93c19264a6 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] 10.222.0.43 "GET /compute/v2.1/servers/eb851ab6-0e89-41d2-be52-d76cdc8644d6" status: 200 len: 1701 microversion: 2.1 time: 0.167226 Jun 22 10:18:51.384350 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 236/454] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:18:51 2022] GET /compute/v2.1/servers/eb851ab6-0e89-41d2-be52-d76cdc8644d6 => generated 1701 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 10:18:51.400377 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-38f5fc6a-50a5-4613-955e-094de0488461 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:18:51.406971 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-38f5fc6a-50a5-4613-955e-094de0488461 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:18:51.407502 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-38f5fc6a-50a5-4613-955e-094de0488461 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:18:51.468564 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.compute.api [None req-38f5fc6a-50a5-4613-955e-094de0488461 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] [instance: eb851ab6-0e89-41d2-be52-d76cdc8644d6] Going to try to start instance {{(pid=117873) start /opt/stack/nova/nova/compute/api.py:2730}} Jun 22 10:18:51.497826 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-79f32c5f-f149-4e36-9f32-ebf4f881ad98 tempest-VolumesActionsTest-1453826651 tempest-VolumesActionsTest-1453826651-project] Calling method '>' {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:18:51.498395 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.compute.api [None req-79f32c5f-f149-4e36-9f32-ebf4f881ad98 tempest-VolumesActionsTest-1453826651 tempest-VolumesActionsTest-1453826651-project] [instance: 884a31e3-235c-4ca6-84e5-3dbdcd403d4d] Fetching instance by UUID {{(pid=117874) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:18:51.504492 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-79f32c5f-f149-4e36-9f32-ebf4f881ad98 tempest-VolumesActionsTest-1453826651 tempest-VolumesActionsTest-1453826651-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:18:51.504921 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-79f32c5f-f149-4e36-9f32-ebf4f881ad98 tempest-VolumesActionsTest-1453826651 tempest-VolumesActionsTest-1453826651-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:18:51.505944 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-79f32c5f-f149-4e36-9f32-ebf4f881ad98 tempest-VolumesActionsTest-1453826651 tempest-VolumesActionsTest-1453826651-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:18:51.506591 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-79f32c5f-f149-4e36-9f32-ebf4f881ad98 tempest-VolumesActionsTest-1453826651 tempest-VolumesActionsTest-1453826651-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:18:51.515765 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [None req-38f5fc6a-50a5-4613-955e-094de0488461 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] 10.222.0.43 "POST /compute/v2.1/servers/eb851ab6-0e89-41d2-be52-d76cdc8644d6/action" status: 202 len: 0 microversion: 2.1 time: 0.118849 Jun 22 10:18:51.516828 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 219/455] 10.222.0.43 () {60 vars in 1277 bytes} [Wed Jun 22 10:18:51 2022] POST /compute/v2.1/servers/eb851ab6-0e89-41d2-be52-d76cdc8644d6/action => generated 0 bytes in 121 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 22 10:18:51.522296 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.wsgi [None req-79f32c5f-f149-4e36-9f32-ebf4f881ad98 tempest-VolumesActionsTest-1453826651 tempest-VolumesActionsTest-1453826651-project] HTTP exception thrown: Instance 884a31e3-235c-4ca6-84e5-3dbdcd403d4d could not be found. Jun 22 10:18:51.523952 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-79f32c5f-f149-4e36-9f32-ebf4f881ad98 tempest-VolumesActionsTest-1453826651 tempest-VolumesActionsTest-1453826651-project] Request method failure captured: Jun 22 10:18:51.523952 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: request: GET /compute/v2.1/servers/884a31e3-235c-4ca6-84e5-3dbdcd403d4d HTTP/1.1 Jun 22 10:18:51.523952 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: Accept: application/json Jun 22 10:18:51.523952 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: Accept-Encoding: identity Jun 22 10:18:51.523952 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: Connection: close Jun 22 10:18:51.523952 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: Content-Length: 0 Jun 22 10:18:51.523952 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: Content-Type: application/json Jun 22 10:18:51.523952 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: Host: 10.222.0.43 Jun 22 10:18:51.523952 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: Openstack-System-Scope: None Jun 22 10:18:51.523952 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: User-Agent: python-urllib3/1.26.9 Jun 22 10:18:51.523952 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-Auth-Token: gAAAAABisuxlVfrEPuFBAFjfVWtRjaGYmJ--bCDznHtcCeASAV9_4-ELxOAFjzIn37BKLecL9xsozUIYd1oFsZAczxbwKbDvzGTQadzNfNrn_KH50oKaPb3aPeS5JEs_N4ZeQwDvLlsKtrkqWWbOwdGMRGc5Emolvz8xr3XZ_0Ud3L-RpMzqpLQ Jun 22 10:18:51.523952 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-Domain-Id: None Jun 22 10:18:51.523952 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-Domain-Name: None Jun 22 10:18:51.523952 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-Identity-Status: Confirmed Jun 22 10:18:51.523952 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-Is-Admin-Project: True Jun 22 10:18:51.523952 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-Project-Domain-Id: default Jun 22 10:18:51.523952 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-Project-Domain-Name: Default Jun 22 10:18:51.523952 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-Project-Id: 0b75addf2f334d7cb584ccae7779d3f1 Jun 22 10:18:51.523952 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-Project-Name: tempest-VolumesActionsTest-1453826651 Jun 22 10:18:51.523952 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-Role: reader,member Jun 22 10:18:51.523952 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-Roles: reader,member Jun 22 10:18:51.525227 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/0b75addf2f334d7cb584ccae7779d3f1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/0b75addf2f334d7cb584ccae7779d3f1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_0b75addf2f334d7cb584ccae7779d3f1", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/0b75addf2f334d7cb584ccae7779d3f1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}] Jun 22 10:18:51.525227 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-Tenant: tempest-VolumesActionsTest-1453826651 Jun 22 10:18:51.525227 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-Tenant-Id: 0b75addf2f334d7cb584ccae7779d3f1 Jun 22 10:18:51.525227 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-Tenant-Name: tempest-VolumesActionsTest-1453826651 Jun 22 10:18:51.525227 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-User: tempest-VolumesActionsTest-1453826651-project Jun 22 10:18:51.525227 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-User-Domain-Id: default Jun 22 10:18:51.525227 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-User-Domain-Name: Default Jun 22 10:18:51.525227 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-User-Id: f9517119110f4ab99bff1379d5f7e241 Jun 22 10:18:51.525227 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-User-Name: tempest-VolumesActionsTest-1453826651-project Jun 22 10:18:51.525227 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: method: > Jun 22 10:18:51.525227 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: exception: Instance 884a31e3-235c-4ca6-84e5-3dbdcd403d4d could not be found. Jun 22 10:18:51.525227 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: action_args: {'id': '884a31e3-235c-4ca6-84e5-3dbdcd403d4d'} Jun 22 10:18:51.526045 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 10:18:51.526045 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:18:51.526045 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 22 10:18:51.526045 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 22 10:18:51.526045 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 22 10:18:51.526045 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 22 10:18:51.526045 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 22 10:18:51.526045 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 22 10:18:51.526045 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 22 10:18:51.526045 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 22 10:18:51.526045 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 884a31e3-235c-4ca6-84e5-3dbdcd403d4d could not be found. Jun 22 10:18:51.526045 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi Jun 22 10:18:51.526045 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 10:18:51.526045 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi Jun 22 10:18:51.526045 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:18:51.526045 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 10:18:51.526045 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 10:18:51.526045 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 10:18:51.526045 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 10:18:51.526045 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 10:18:51.527581 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 10:18:51.527581 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 22 10:18:51.527581 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 22 10:18:51.527581 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 22 10:18:51.527581 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 22 10:18:51.527581 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 22 10:18:51.527581 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 22 10:18:51.527581 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 884a31e3-235c-4ca6-84e5-3dbdcd403d4d could not be found. Jun 22 10:18:51.527581 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi Jun 22 10:18:51.527581 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 10:18:51.527581 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi Jun 22 10:18:51.527581 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:18:51.527581 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 10:18:51.527581 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 10:18:51.527581 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 10:18:51.527581 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 10:18:51.527581 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 884a31e3-235c-4ca6-84e5-3dbdcd403d4d could not be found. Jun 22 10:18:51.527581 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi Jun 22 10:18:51.529832 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-79f32c5f-f149-4e36-9f32-ebf4f881ad98 tempest-VolumesActionsTest-1453826651 tempest-VolumesActionsTest-1453826651-project] Returning 404 to user: Instance 884a31e3-235c-4ca6-84e5-3dbdcd403d4d could not be found. {{(pid=117874) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 10:18:51.529917 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-a86d7472-7d35-41c5-b310-0496e528b275 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Calling method '>' {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:18:51.529917 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.compute.api [None req-a86d7472-7d35-41c5-b310-0496e528b275 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] [instance: eb851ab6-0e89-41d2-be52-d76cdc8644d6] Fetching instance by UUID {{(pid=117873) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:18:51.530383 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [None req-79f32c5f-f149-4e36-9f32-ebf4f881ad98 tempest-VolumesActionsTest-1453826651 tempest-VolumesActionsTest-1453826651-project] 10.222.0.43 "GET /compute/v2.1/servers/884a31e3-235c-4ca6-84e5-3dbdcd403d4d" status: 404 len: 111 microversion: 2.1 time: 0.032015 Jun 22 10:18:51.530383 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 237/456] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:18:51 2022] GET /compute/v2.1/servers/884a31e3-235c-4ca6-84e5-3dbdcd403d4d => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 22 10:18:51.536257 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-a86d7472-7d35-41c5-b310-0496e528b275 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:18:51.536703 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-a86d7472-7d35-41c5-b310-0496e528b275 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:18:51.538124 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-a86d7472-7d35-41c5-b310-0496e528b275 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:18:51.538565 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-a86d7472-7d35-41c5-b310-0496e528b275 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:18:51.656419 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-88435b32-dd56-4c6a-ac0b-1217042dba8e tempest-VolumesActionsTest-1453826651 tempest-VolumesActionsTest-1453826651-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-381737703", "imageRef": "22d2c064-5bf7-438e-bbb7-47259e4bdab5", "flavorRef": "452", "networks": [{"uuid": "e3bd5741-bd96-458e-92f1-363af9f36a6d"}]}} {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:18:51.692192 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.policy [None req-a86d7472-7d35-41c5-b310-0496e528b275 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78fe3fc4334c43d7a5ef6d70f9f57523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad52333bcbec425089c44c3e55df97ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117873) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:18:51.705782 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [None req-a86d7472-7d35-41c5-b310-0496e528b275 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] 10.222.0.43 "GET /compute/v2.1/servers/eb851ab6-0e89-41d2-be52-d76cdc8644d6" status: 200 len: 1710 microversion: 2.1 time: 0.184870 Jun 22 10:18:51.706551 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 220/457] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:18:51 2022] GET /compute/v2.1/servers/eb851ab6-0e89-41d2-be52-d76cdc8644d6 => generated 1710 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 10:18:51.714848 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.network.neutron [None req-88435b32-dd56-4c6a-ac0b-1217042dba8e tempest-VolumesActionsTest-1453826651 tempest-VolumesActionsTest-1453826651-project] validate_networks() for [('e3bd5741-bd96-458e-92f1-363af9f36a6d', None, None, None, None, None)] {{(pid=117874) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 22 10:18:52.061615 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.virt.hardware [None req-88435b32-dd56-4c6a-ac0b-1217042dba8e tempest-VolumesActionsTest-1453826651 tempest-VolumesActionsTest-1453826651-project] Flavor limits 0:0:0 {{(pid=117874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 22 10:18:52.062094 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.virt.hardware [None req-88435b32-dd56-4c6a-ac0b-1217042dba8e tempest-VolumesActionsTest-1453826651 tempest-VolumesActionsTest-1453826651-project] Image limits 0:0:0 {{(pid=117874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 22 10:18:52.062676 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.virt.hardware [None req-88435b32-dd56-4c6a-ac0b-1217042dba8e tempest-VolumesActionsTest-1453826651 tempest-VolumesActionsTest-1453826651-project] Flavor pref 0:0:0 {{(pid=117874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 22 10:18:52.063207 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.virt.hardware [None req-88435b32-dd56-4c6a-ac0b-1217042dba8e tempest-VolumesActionsTest-1453826651 tempest-VolumesActionsTest-1453826651-project] Image pref 0:0:0 {{(pid=117874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 22 10:18:52.063518 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.virt.hardware [None req-88435b32-dd56-4c6a-ac0b-1217042dba8e tempest-VolumesActionsTest-1453826651 tempest-VolumesActionsTest-1453826651-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 22 10:18:52.072352 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-88435b32-dd56-4c6a-ac0b-1217042dba8e tempest-VolumesActionsTest-1453826651 tempest-VolumesActionsTest-1453826651-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:18:52.072789 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-88435b32-dd56-4c6a-ac0b-1217042dba8e tempest-VolumesActionsTest-1453826651 tempest-VolumesActionsTest-1453826651-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:18:52.073577 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-88435b32-dd56-4c6a-ac0b-1217042dba8e tempest-VolumesActionsTest-1453826651 tempest-VolumesActionsTest-1453826651-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:18:52.074040 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-88435b32-dd56-4c6a-ac0b-1217042dba8e tempest-VolumesActionsTest-1453826651 tempest-VolumesActionsTest-1453826651-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:18:52.094871 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.quota [None req-88435b32-dd56-4c6a-ac0b-1217042dba8e tempest-VolumesActionsTest-1453826651 tempest-VolumesActionsTest-1453826651-project] Getting quotas for project 0b75addf2f334d7cb584ccae7779d3f1. Resources: {'instances', 'cores', 'ram'} {{(pid=117874) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 22 10:18:52.099452 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.quota [None req-88435b32-dd56-4c6a-ac0b-1217042dba8e tempest-VolumesActionsTest-1453826651 tempest-VolumesActionsTest-1453826651-project] Getting quotas for user f9517119110f4ab99bff1379d5f7e241 and project 0b75addf2f334d7cb584ccae7779d3f1. Resources: {'instances', 'cores', 'ram'} {{(pid=117874) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 22 10:18:52.113416 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.compute.api [None req-88435b32-dd56-4c6a-ac0b-1217042dba8e tempest-VolumesActionsTest-1453826651 tempest-VolumesActionsTest-1453826651-project] Going to run 1 instances... {{(pid=117874) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 22 10:18:52.115878 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.compute.api [None req-88435b32-dd56-4c6a-ac0b-1217042dba8e tempest-VolumesActionsTest-1453826651 tempest-VolumesActionsTest-1453826651-project] [instance: 6b2ba0b0-be2d-4a81-9abd-f7cc17b57602] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='22d2c064-5bf7-438e-bbb7-47259e4bdab5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117874) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 22 10:18:52.162654 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [None req-88435b32-dd56-4c6a-ac0b-1217042dba8e tempest-VolumesActionsTest-1453826651 tempest-VolumesActionsTest-1453826651-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.510474 Jun 22 10:18:52.163153 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 238/458] 10.222.0.43 () {60 vars in 1146 bytes} [Wed Jun 22 10:18:51 2022] POST /compute/v2.1/servers => generated 380 bytes in 512 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 22 10:18:52.173170 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-d86074c8-b627-48a7-81ef-5562560d460c tempest-VolumesActionsTest-1453826651 tempest-VolumesActionsTest-1453826651-project] Calling method '>' {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:18:52.173899 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.compute.api [None req-d86074c8-b627-48a7-81ef-5562560d460c tempest-VolumesActionsTest-1453826651 tempest-VolumesActionsTest-1453826651-project] [instance: 6b2ba0b0-be2d-4a81-9abd-f7cc17b57602] Fetching instance by UUID {{(pid=117873) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:18:52.232498 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.policy [None req-d86074c8-b627-48a7-81ef-5562560d460c tempest-VolumesActionsTest-1453826651 tempest-VolumesActionsTest-1453826651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9517119110f4ab99bff1379d5f7e241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b75addf2f334d7cb584ccae7779d3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117873) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:18:52.240935 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [None req-d86074c8-b627-48a7-81ef-5562560d460c tempest-VolumesActionsTest-1453826651 tempest-VolumesActionsTest-1453826651-project] 10.222.0.43 "GET /compute/v2.1/servers/6b2ba0b0-be2d-4a81-9abd-f7cc17b57602" status: 200 len: 1213 microversion: 2.1 time: 0.071864 Jun 22 10:18:52.242399 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 221/459] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:18:52 2022] GET /compute/v2.1/servers/6b2ba0b0-be2d-4a81-9abd-f7cc17b57602 => generated 1213 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:18:52.327148 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-da6124eb-8ac2-4d0b-9fd9-77a39466b33b tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Calling method '>' {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:18:52.329007 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.compute.api [None req-da6124eb-8ac2-4d0b-9fd9-77a39466b33b tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] [instance: 73dbd5ab-5688-4de4-9da2-0b89d7cefb11] Fetching instance by UUID {{(pid=117874) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:18:52.339860 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-da6124eb-8ac2-4d0b-9fd9-77a39466b33b tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:18:52.340523 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-da6124eb-8ac2-4d0b-9fd9-77a39466b33b tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:18:52.341463 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-da6124eb-8ac2-4d0b-9fd9-77a39466b33b tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:18:52.342087 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-da6124eb-8ac2-4d0b-9fd9-77a39466b33b tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:18:52.487107 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.policy [None req-da6124eb-8ac2-4d0b-9fd9-77a39466b33b tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75753b29a78640df9622d4e2655baf9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee9d603d9cc4a8797f55d544f189720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117874) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:18:52.497606 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.policy [None req-da6124eb-8ac2-4d0b-9fd9-77a39466b33b tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75753b29a78640df9622d4e2655baf9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee9d603d9cc4a8797f55d544f189720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117874) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:18:52.512131 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.policy [None req-da6124eb-8ac2-4d0b-9fd9-77a39466b33b tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75753b29a78640df9622d4e2655baf9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee9d603d9cc4a8797f55d544f189720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117874) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:18:52.512131 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [None req-da6124eb-8ac2-4d0b-9fd9-77a39466b33b tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] 10.222.0.43 "GET /compute/v2.1/servers/73dbd5ab-5688-4de4-9da2-0b89d7cefb11" status: 200 len: 1809 microversion: 2.20 time: 0.184163 Jun 22 10:18:52.512131 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 239/460] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jun 22 10:18:52 2022] GET /compute/v2.1/servers/73dbd5ab-5688-4de4-9da2-0b89d7cefb11 => generated 1809 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 10:18:52.724203 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-66d67634-099a-4c34-8c10-4901321bc712 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Calling method '>' {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:18:52.724910 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.compute.api [None req-66d67634-099a-4c34-8c10-4901321bc712 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] [instance: eb851ab6-0e89-41d2-be52-d76cdc8644d6] Fetching instance by UUID {{(pid=117873) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:18:52.732268 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-66d67634-099a-4c34-8c10-4901321bc712 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:18:52.732716 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-66d67634-099a-4c34-8c10-4901321bc712 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:18:52.733481 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-66d67634-099a-4c34-8c10-4901321bc712 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:18:52.734043 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-66d67634-099a-4c34-8c10-4901321bc712 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:18:52.872349 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.policy [None req-66d67634-099a-4c34-8c10-4901321bc712 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78fe3fc4334c43d7a5ef6d70f9f57523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad52333bcbec425089c44c3e55df97ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117873) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:18:52.880380 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [None req-66d67634-099a-4c34-8c10-4901321bc712 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] 10.222.0.43 "GET /compute/v2.1/servers/eb851ab6-0e89-41d2-be52-d76cdc8644d6" status: 200 len: 1710 microversion: 2.1 time: 0.161134 Jun 22 10:18:52.880937 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 222/461] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:18:52 2022] GET /compute/v2.1/servers/eb851ab6-0e89-41d2-be52-d76cdc8644d6 => generated 1710 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:18:53.258358 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-a94bd2d4-ad73-4edf-8212-06d125ceded6 tempest-VolumesActionsTest-1453826651 tempest-VolumesActionsTest-1453826651-project] Calling method '>' {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:18:53.258878 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.compute.api [None req-a94bd2d4-ad73-4edf-8212-06d125ceded6 tempest-VolumesActionsTest-1453826651 tempest-VolumesActionsTest-1453826651-project] [instance: 6b2ba0b0-be2d-4a81-9abd-f7cc17b57602] Fetching instance by UUID {{(pid=117874) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:18:53.264830 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-a94bd2d4-ad73-4edf-8212-06d125ceded6 tempest-VolumesActionsTest-1453826651 tempest-VolumesActionsTest-1453826651-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:18:53.265275 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-a94bd2d4-ad73-4edf-8212-06d125ceded6 tempest-VolumesActionsTest-1453826651 tempest-VolumesActionsTest-1453826651-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:18:53.266813 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-a94bd2d4-ad73-4edf-8212-06d125ceded6 tempest-VolumesActionsTest-1453826651 tempest-VolumesActionsTest-1453826651-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:18:53.267252 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-a94bd2d4-ad73-4edf-8212-06d125ceded6 tempest-VolumesActionsTest-1453826651 tempest-VolumesActionsTest-1453826651-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:18:53.328260 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.policy [None req-a94bd2d4-ad73-4edf-8212-06d125ceded6 tempest-VolumesActionsTest-1453826651 tempest-VolumesActionsTest-1453826651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9517119110f4ab99bff1379d5f7e241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b75addf2f334d7cb584ccae7779d3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117874) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:18:53.336542 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [None req-a94bd2d4-ad73-4edf-8212-06d125ceded6 tempest-VolumesActionsTest-1453826651 tempest-VolumesActionsTest-1453826651-project] 10.222.0.43 "GET /compute/v2.1/servers/6b2ba0b0-be2d-4a81-9abd-f7cc17b57602" status: 200 len: 1265 microversion: 2.1 time: 0.081978 Jun 22 10:18:53.337120 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 240/462] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:18:53 2022] GET /compute/v2.1/servers/6b2ba0b0-be2d-4a81-9abd-f7cc17b57602 => generated 1265 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:18:53.521584 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-a4b33367-4b17-41c9-b161-d14e9bb57315 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Calling method '>' {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:18:53.522158 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.compute.api [None req-a4b33367-4b17-41c9-b161-d14e9bb57315 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] [instance: 73dbd5ab-5688-4de4-9da2-0b89d7cefb11] Fetching instance by UUID {{(pid=117873) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:18:53.528703 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-a4b33367-4b17-41c9-b161-d14e9bb57315 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:18:53.529143 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-a4b33367-4b17-41c9-b161-d14e9bb57315 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:18:53.529992 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-a4b33367-4b17-41c9-b161-d14e9bb57315 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:18:53.530423 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-a4b33367-4b17-41c9-b161-d14e9bb57315 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:18:53.666305 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.policy [None req-a4b33367-4b17-41c9-b161-d14e9bb57315 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75753b29a78640df9622d4e2655baf9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee9d603d9cc4a8797f55d544f189720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117873) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:18:53.675112 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.policy [None req-a4b33367-4b17-41c9-b161-d14e9bb57315 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75753b29a78640df9622d4e2655baf9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee9d603d9cc4a8797f55d544f189720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117873) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:18:53.676651 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.policy [None req-a4b33367-4b17-41c9-b161-d14e9bb57315 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75753b29a78640df9622d4e2655baf9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee9d603d9cc4a8797f55d544f189720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117873) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:18:53.677854 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [None req-a4b33367-4b17-41c9-b161-d14e9bb57315 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] 10.222.0.43 "GET /compute/v2.1/servers/73dbd5ab-5688-4de4-9da2-0b89d7cefb11" status: 200 len: 1809 microversion: 2.20 time: 0.160150 Jun 22 10:18:53.678417 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 223/463] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jun 22 10:18:53 2022] GET /compute/v2.1/servers/73dbd5ab-5688-4de4-9da2-0b89d7cefb11 => generated 1809 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 10:18:53.897314 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-7656a46f-9eb1-4635-848a-26e644eb2ccf tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Calling method '>' {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:18:53.897872 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.compute.api [None req-7656a46f-9eb1-4635-848a-26e644eb2ccf tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] [instance: eb851ab6-0e89-41d2-be52-d76cdc8644d6] Fetching instance by UUID {{(pid=117874) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:18:53.903900 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-7656a46f-9eb1-4635-848a-26e644eb2ccf tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:18:53.904348 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-7656a46f-9eb1-4635-848a-26e644eb2ccf tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:18:53.905097 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-7656a46f-9eb1-4635-848a-26e644eb2ccf tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:18:53.905529 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-7656a46f-9eb1-4635-848a-26e644eb2ccf tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:18:54.038587 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.policy [None req-7656a46f-9eb1-4635-848a-26e644eb2ccf tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78fe3fc4334c43d7a5ef6d70f9f57523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad52333bcbec425089c44c3e55df97ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117874) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:18:54.042055 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG dbcounter [-] [117874] Writing DB stats nova_cell1:SELECT=100 {{(pid=117874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:18:54.047743 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [None req-7656a46f-9eb1-4635-848a-26e644eb2ccf tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] 10.222.0.43 "GET /compute/v2.1/servers/eb851ab6-0e89-41d2-be52-d76cdc8644d6" status: 200 len: 1714 microversion: 2.1 time: 0.154232 Jun 22 10:18:54.048328 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 241/464] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:18:53 2022] GET /compute/v2.1/servers/eb851ab6-0e89-41d2-be52-d76cdc8644d6 => generated 1714 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:18:54.357623 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-de83b349-14c9-4bd1-aad0-c48f87826373 tempest-VolumesActionsTest-1453826651 tempest-VolumesActionsTest-1453826651-project] Calling method '>' {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:18:54.358194 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.compute.api [None req-de83b349-14c9-4bd1-aad0-c48f87826373 tempest-VolumesActionsTest-1453826651 tempest-VolumesActionsTest-1453826651-project] [instance: 6b2ba0b0-be2d-4a81-9abd-f7cc17b57602] Fetching instance by UUID {{(pid=117873) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:18:54.364470 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-de83b349-14c9-4bd1-aad0-c48f87826373 tempest-VolumesActionsTest-1453826651 tempest-VolumesActionsTest-1453826651-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:18:54.364912 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-de83b349-14c9-4bd1-aad0-c48f87826373 tempest-VolumesActionsTest-1453826651 tempest-VolumesActionsTest-1453826651-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:18:54.365660 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-de83b349-14c9-4bd1-aad0-c48f87826373 tempest-VolumesActionsTest-1453826651 tempest-VolumesActionsTest-1453826651-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:18:54.366110 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-de83b349-14c9-4bd1-aad0-c48f87826373 tempest-VolumesActionsTest-1453826651 tempest-VolumesActionsTest-1453826651-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:18:54.429661 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.policy [None req-de83b349-14c9-4bd1-aad0-c48f87826373 tempest-VolumesActionsTest-1453826651 tempest-VolumesActionsTest-1453826651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9517119110f4ab99bff1379d5f7e241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b75addf2f334d7cb584ccae7779d3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117873) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:18:54.431969 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG dbcounter [-] [117873] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:18:54.438955 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [None req-de83b349-14c9-4bd1-aad0-c48f87826373 tempest-VolumesActionsTest-1453826651 tempest-VolumesActionsTest-1453826651-project] 10.222.0.43 "GET /compute/v2.1/servers/6b2ba0b0-be2d-4a81-9abd-f7cc17b57602" status: 200 len: 1271 microversion: 2.1 time: 0.085682 Jun 22 10:18:54.439362 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 224/465] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:18:54 2022] GET /compute/v2.1/servers/6b2ba0b0-be2d-4a81-9abd-f7cc17b57602 => generated 1271 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:18:54.696400 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-be69594d-d547-4c81-806e-cbc09b984042 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Calling method '>' {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:18:54.697005 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.compute.api [None req-be69594d-d547-4c81-806e-cbc09b984042 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] [instance: 73dbd5ab-5688-4de4-9da2-0b89d7cefb11] Fetching instance by UUID {{(pid=117874) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:18:54.704016 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-be69594d-d547-4c81-806e-cbc09b984042 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:18:54.704166 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-be69594d-d547-4c81-806e-cbc09b984042 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:18:54.704908 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-be69594d-d547-4c81-806e-cbc09b984042 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:18:54.705288 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-be69594d-d547-4c81-806e-cbc09b984042 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:18:54.839616 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.policy [None req-be69594d-d547-4c81-806e-cbc09b984042 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75753b29a78640df9622d4e2655baf9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee9d603d9cc4a8797f55d544f189720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117874) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:18:54.849585 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.policy [None req-be69594d-d547-4c81-806e-cbc09b984042 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75753b29a78640df9622d4e2655baf9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee9d603d9cc4a8797f55d544f189720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117874) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:18:54.851112 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.policy [None req-be69594d-d547-4c81-806e-cbc09b984042 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75753b29a78640df9622d4e2655baf9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee9d603d9cc4a8797f55d544f189720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117874) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:18:54.852263 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [None req-be69594d-d547-4c81-806e-cbc09b984042 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] 10.222.0.43 "GET /compute/v2.1/servers/73dbd5ab-5688-4de4-9da2-0b89d7cefb11" status: 200 len: 1809 microversion: 2.20 time: 0.159850 Jun 22 10:18:54.853040 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 242/466] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jun 22 10:18:54 2022] GET /compute/v2.1/servers/73dbd5ab-5688-4de4-9da2-0b89d7cefb11 => generated 1809 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 10:18:55.368347 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [req-f607baee-5681-4ae6-992e-fdb688c400b9 req-b143b4a8-0c40-4344-ba1c-33ba4fb14b37 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6b2ba0b0-be2d-4a81-9abd-f7cc17b57602", "tag": "d82309d3-6edc-4d2b-ba67-2d5c0226c1fc"}]} {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:18:55.379424 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [req-f607baee-5681-4ae6-992e-fdb688c400b9 req-b143b4a8-0c40-4344-ba1c-33ba4fb14b37 service nova] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:18:55.380289 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [req-f607baee-5681-4ae6-992e-fdb688c400b9 req-b143b4a8-0c40-4344-ba1c-33ba4fb14b37 service nova] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:18:55.399530 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.compute.server_external_events [req-f607baee-5681-4ae6-992e-fdb688c400b9 req-b143b4a8-0c40-4344-ba1c-33ba4fb14b37 service nova] Creating event network-changed:d82309d3-6edc-4d2b-ba67-2d5c0226c1fc for instance 6b2ba0b0-be2d-4a81-9abd-f7cc17b57602 on hv-cinder-84713 Jun 22 10:18:55.404442 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [req-f607baee-5681-4ae6-992e-fdb688c400b9 req-b143b4a8-0c40-4344-ba1c-33ba4fb14b37 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039705 Jun 22 10:18:55.405204 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 225/467] 10.222.0.43 () {64 vars in 1317 bytes} [Wed Jun 22 10:18:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 10:18:55.456343 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-46349a9d-e403-493f-9917-54ce7ef1ba29 tempest-VolumesActionsTest-1453826651 tempest-VolumesActionsTest-1453826651-project] Calling method '>' {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:18:55.456961 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.compute.api [None req-46349a9d-e403-493f-9917-54ce7ef1ba29 tempest-VolumesActionsTest-1453826651 tempest-VolumesActionsTest-1453826651-project] [instance: 6b2ba0b0-be2d-4a81-9abd-f7cc17b57602] Fetching instance by UUID {{(pid=117874) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:18:55.463463 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-46349a9d-e403-493f-9917-54ce7ef1ba29 tempest-VolumesActionsTest-1453826651 tempest-VolumesActionsTest-1453826651-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:18:55.463911 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-46349a9d-e403-493f-9917-54ce7ef1ba29 tempest-VolumesActionsTest-1453826651 tempest-VolumesActionsTest-1453826651-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:18:55.464675 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-46349a9d-e403-493f-9917-54ce7ef1ba29 tempest-VolumesActionsTest-1453826651 tempest-VolumesActionsTest-1453826651-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:18:55.465142 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-46349a9d-e403-493f-9917-54ce7ef1ba29 tempest-VolumesActionsTest-1453826651 tempest-VolumesActionsTest-1453826651-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:18:55.596724 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.policy [None req-46349a9d-e403-493f-9917-54ce7ef1ba29 tempest-VolumesActionsTest-1453826651 tempest-VolumesActionsTest-1453826651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9517119110f4ab99bff1379d5f7e241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b75addf2f334d7cb584ccae7779d3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117874) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:18:55.604411 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [None req-46349a9d-e403-493f-9917-54ce7ef1ba29 tempest-VolumesActionsTest-1453826651 tempest-VolumesActionsTest-1453826651-project] 10.222.0.43 "GET /compute/v2.1/servers/6b2ba0b0-be2d-4a81-9abd-f7cc17b57602" status: 200 len: 1313 microversion: 2.1 time: 0.152668 Jun 22 10:18:55.604986 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 243/468] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:18:55 2022] GET /compute/v2.1/servers/6b2ba0b0-be2d-4a81-9abd-f7cc17b57602 => generated 1313 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:18:55.871434 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-8571b6bd-aa6e-44bc-b524-dd7564febb2f tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Calling method '>' {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:18:55.872029 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.compute.api [None req-8571b6bd-aa6e-44bc-b524-dd7564febb2f tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] [instance: 73dbd5ab-5688-4de4-9da2-0b89d7cefb11] Fetching instance by UUID {{(pid=117873) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:18:55.878466 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-8571b6bd-aa6e-44bc-b524-dd7564febb2f tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:18:55.878905 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-8571b6bd-aa6e-44bc-b524-dd7564febb2f tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:18:55.879655 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-8571b6bd-aa6e-44bc-b524-dd7564febb2f tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:18:55.880110 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-8571b6bd-aa6e-44bc-b524-dd7564febb2f tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:18:56.027447 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.policy [None req-8571b6bd-aa6e-44bc-b524-dd7564febb2f tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75753b29a78640df9622d4e2655baf9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee9d603d9cc4a8797f55d544f189720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117873) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:18:56.037497 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.policy [None req-8571b6bd-aa6e-44bc-b524-dd7564febb2f tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75753b29a78640df9622d4e2655baf9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee9d603d9cc4a8797f55d544f189720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117873) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:18:56.039033 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.policy [None req-8571b6bd-aa6e-44bc-b524-dd7564febb2f tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75753b29a78640df9622d4e2655baf9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee9d603d9cc4a8797f55d544f189720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117873) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:18:56.040189 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [None req-8571b6bd-aa6e-44bc-b524-dd7564febb2f tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] 10.222.0.43 "GET /compute/v2.1/servers/73dbd5ab-5688-4de4-9da2-0b89d7cefb11" status: 200 len: 1809 microversion: 2.20 time: 0.173089 Jun 22 10:18:56.040752 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 226/469] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jun 22 10:18:55 2022] GET /compute/v2.1/servers/73dbd5ab-5688-4de4-9da2-0b89d7cefb11 => generated 1809 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 22 10:18:56.620942 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-3b83296a-7a0e-4a2a-b551-ecba95af6f1d tempest-VolumesActionsTest-1453826651 tempest-VolumesActionsTest-1453826651-project] Calling method '>' {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:18:56.621465 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.compute.api [None req-3b83296a-7a0e-4a2a-b551-ecba95af6f1d tempest-VolumesActionsTest-1453826651 tempest-VolumesActionsTest-1453826651-project] [instance: 6b2ba0b0-be2d-4a81-9abd-f7cc17b57602] Fetching instance by UUID {{(pid=117874) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:18:56.629042 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-3b83296a-7a0e-4a2a-b551-ecba95af6f1d tempest-VolumesActionsTest-1453826651 tempest-VolumesActionsTest-1453826651-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:18:56.629483 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-3b83296a-7a0e-4a2a-b551-ecba95af6f1d tempest-VolumesActionsTest-1453826651 tempest-VolumesActionsTest-1453826651-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:18:56.630266 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-3b83296a-7a0e-4a2a-b551-ecba95af6f1d tempest-VolumesActionsTest-1453826651 tempest-VolumesActionsTest-1453826651-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:18:56.630695 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-3b83296a-7a0e-4a2a-b551-ecba95af6f1d tempest-VolumesActionsTest-1453826651 tempest-VolumesActionsTest-1453826651-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:18:56.760627 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.policy [None req-3b83296a-7a0e-4a2a-b551-ecba95af6f1d tempest-VolumesActionsTest-1453826651 tempest-VolumesActionsTest-1453826651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9517119110f4ab99bff1379d5f7e241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b75addf2f334d7cb584ccae7779d3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117874) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:18:56.768665 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [None req-3b83296a-7a0e-4a2a-b551-ecba95af6f1d tempest-VolumesActionsTest-1453826651 tempest-VolumesActionsTest-1453826651-project] 10.222.0.43 "GET /compute/v2.1/servers/6b2ba0b0-be2d-4a81-9abd-f7cc17b57602" status: 200 len: 1313 microversion: 2.1 time: 0.151587 Jun 22 10:18:56.769218 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 244/470] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:18:56 2022] GET /compute/v2.1/servers/6b2ba0b0-be2d-4a81-9abd-f7cc17b57602 => generated 1313 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:18:57.059114 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-347f4bdd-46e6-47ef-8f1d-a5be354b180b tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Calling method '>' {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:18:57.059712 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.compute.api [None req-347f4bdd-46e6-47ef-8f1d-a5be354b180b tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] [instance: 73dbd5ab-5688-4de4-9da2-0b89d7cefb11] Fetching instance by UUID {{(pid=117873) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:18:57.067115 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-347f4bdd-46e6-47ef-8f1d-a5be354b180b tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:18:57.067554 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-347f4bdd-46e6-47ef-8f1d-a5be354b180b tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:18:57.068371 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-347f4bdd-46e6-47ef-8f1d-a5be354b180b tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:18:57.068812 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-347f4bdd-46e6-47ef-8f1d-a5be354b180b tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:18:57.197173 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.policy [None req-347f4bdd-46e6-47ef-8f1d-a5be354b180b tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75753b29a78640df9622d4e2655baf9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee9d603d9cc4a8797f55d544f189720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117873) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:18:57.205663 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.policy [None req-347f4bdd-46e6-47ef-8f1d-a5be354b180b tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75753b29a78640df9622d4e2655baf9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee9d603d9cc4a8797f55d544f189720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117873) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:18:57.207164 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.policy [None req-347f4bdd-46e6-47ef-8f1d-a5be354b180b tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75753b29a78640df9622d4e2655baf9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee9d603d9cc4a8797f55d544f189720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117873) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:18:57.208294 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [None req-347f4bdd-46e6-47ef-8f1d-a5be354b180b tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] 10.222.0.43 "GET /compute/v2.1/servers/73dbd5ab-5688-4de4-9da2-0b89d7cefb11" status: 200 len: 1809 microversion: 2.20 time: 0.153054 Jun 22 10:18:57.208848 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 227/471] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jun 22 10:18:57 2022] GET /compute/v2.1/servers/73dbd5ab-5688-4de4-9da2-0b89d7cefb11 => generated 1809 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 10:18:57.786269 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-cfc83ff0-de0f-4a06-b91d-c7181b7a4c9a tempest-VolumesActionsTest-1453826651 tempest-VolumesActionsTest-1453826651-project] Calling method '>' {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:18:57.786908 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.compute.api [None req-cfc83ff0-de0f-4a06-b91d-c7181b7a4c9a tempest-VolumesActionsTest-1453826651 tempest-VolumesActionsTest-1453826651-project] [instance: 6b2ba0b0-be2d-4a81-9abd-f7cc17b57602] Fetching instance by UUID {{(pid=117874) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:18:57.793373 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-cfc83ff0-de0f-4a06-b91d-c7181b7a4c9a tempest-VolumesActionsTest-1453826651 tempest-VolumesActionsTest-1453826651-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:18:57.793859 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-cfc83ff0-de0f-4a06-b91d-c7181b7a4c9a tempest-VolumesActionsTest-1453826651 tempest-VolumesActionsTest-1453826651-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:18:57.794619 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-cfc83ff0-de0f-4a06-b91d-c7181b7a4c9a tempest-VolumesActionsTest-1453826651 tempest-VolumesActionsTest-1453826651-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:18:57.795055 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-cfc83ff0-de0f-4a06-b91d-c7181b7a4c9a tempest-VolumesActionsTest-1453826651 tempest-VolumesActionsTest-1453826651-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:18:57.931524 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.policy [None req-cfc83ff0-de0f-4a06-b91d-c7181b7a4c9a tempest-VolumesActionsTest-1453826651 tempest-VolumesActionsTest-1453826651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9517119110f4ab99bff1379d5f7e241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b75addf2f334d7cb584ccae7779d3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117874) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:18:57.939426 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [None req-cfc83ff0-de0f-4a06-b91d-c7181b7a4c9a tempest-VolumesActionsTest-1453826651 tempest-VolumesActionsTest-1453826651-project] 10.222.0.43 "GET /compute/v2.1/servers/6b2ba0b0-be2d-4a81-9abd-f7cc17b57602" status: 200 len: 1313 microversion: 2.1 time: 0.158048 Jun 22 10:18:57.940002 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 245/472] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:18:57 2022] GET /compute/v2.1/servers/6b2ba0b0-be2d-4a81-9abd-f7cc17b57602 => generated 1313 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:18:58.227446 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-f8c1eb19-9f93-441b-b88d-abbd135d81ae tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Calling method '>' {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:18:58.228069 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.compute.api [None req-f8c1eb19-9f93-441b-b88d-abbd135d81ae tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] [instance: 73dbd5ab-5688-4de4-9da2-0b89d7cefb11] Fetching instance by UUID {{(pid=117873) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:18:58.235785 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-f8c1eb19-9f93-441b-b88d-abbd135d81ae tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:18:58.236215 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-f8c1eb19-9f93-441b-b88d-abbd135d81ae tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:18:58.236980 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-f8c1eb19-9f93-441b-b88d-abbd135d81ae tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:18:58.237409 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-f8c1eb19-9f93-441b-b88d-abbd135d81ae tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:18:58.386929 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.policy [None req-f8c1eb19-9f93-441b-b88d-abbd135d81ae tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75753b29a78640df9622d4e2655baf9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee9d603d9cc4a8797f55d544f189720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117873) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:18:58.395965 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.policy [None req-f8c1eb19-9f93-441b-b88d-abbd135d81ae tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75753b29a78640df9622d4e2655baf9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee9d603d9cc4a8797f55d544f189720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117873) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:18:58.397438 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.policy [None req-f8c1eb19-9f93-441b-b88d-abbd135d81ae tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75753b29a78640df9622d4e2655baf9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee9d603d9cc4a8797f55d544f189720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117873) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:18:58.398607 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [None req-f8c1eb19-9f93-441b-b88d-abbd135d81ae tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] 10.222.0.43 "GET /compute/v2.1/servers/73dbd5ab-5688-4de4-9da2-0b89d7cefb11" status: 200 len: 1809 microversion: 2.20 time: 0.175191 Jun 22 10:18:58.399168 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 228/473] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jun 22 10:18:58 2022] GET /compute/v2.1/servers/73dbd5ab-5688-4de4-9da2-0b89d7cefb11 => generated 1809 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 10:18:58.956804 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-a36ebd9a-4e29-4cd3-9e53-1ce97ecf02dc tempest-VolumesActionsTest-1453826651 tempest-VolumesActionsTest-1453826651-project] Calling method '>' {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:18:58.957437 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.compute.api [None req-a36ebd9a-4e29-4cd3-9e53-1ce97ecf02dc tempest-VolumesActionsTest-1453826651 tempest-VolumesActionsTest-1453826651-project] [instance: 6b2ba0b0-be2d-4a81-9abd-f7cc17b57602] Fetching instance by UUID {{(pid=117874) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:18:58.963957 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-a36ebd9a-4e29-4cd3-9e53-1ce97ecf02dc tempest-VolumesActionsTest-1453826651 tempest-VolumesActionsTest-1453826651-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:18:58.964534 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-a36ebd9a-4e29-4cd3-9e53-1ce97ecf02dc tempest-VolumesActionsTest-1453826651 tempest-VolumesActionsTest-1453826651-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:18:58.965286 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-a36ebd9a-4e29-4cd3-9e53-1ce97ecf02dc tempest-VolumesActionsTest-1453826651 tempest-VolumesActionsTest-1453826651-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:18:58.965735 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-a36ebd9a-4e29-4cd3-9e53-1ce97ecf02dc tempest-VolumesActionsTest-1453826651 tempest-VolumesActionsTest-1453826651-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:18:59.095739 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.policy [None req-a36ebd9a-4e29-4cd3-9e53-1ce97ecf02dc tempest-VolumesActionsTest-1453826651 tempest-VolumesActionsTest-1453826651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9517119110f4ab99bff1379d5f7e241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b75addf2f334d7cb584ccae7779d3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117874) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:18:59.104288 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [None req-a36ebd9a-4e29-4cd3-9e53-1ce97ecf02dc tempest-VolumesActionsTest-1453826651 tempest-VolumesActionsTest-1453826651-project] 10.222.0.43 "GET /compute/v2.1/servers/6b2ba0b0-be2d-4a81-9abd-f7cc17b57602" status: 200 len: 1313 microversion: 2.1 time: 0.152135 Jun 22 10:18:59.107548 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 246/474] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:18:58 2022] GET /compute/v2.1/servers/6b2ba0b0-be2d-4a81-9abd-f7cc17b57602 => generated 1313 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:18:59.417194 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-f56d7301-4d15-4778-b3db-c63e767dcb7b tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Calling method '>' {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:18:59.417824 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.compute.api [None req-f56d7301-4d15-4778-b3db-c63e767dcb7b tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] [instance: 73dbd5ab-5688-4de4-9da2-0b89d7cefb11] Fetching instance by UUID {{(pid=117873) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:18:59.424967 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-f56d7301-4d15-4778-b3db-c63e767dcb7b tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:18:59.425410 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-f56d7301-4d15-4778-b3db-c63e767dcb7b tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:18:59.426201 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-f56d7301-4d15-4778-b3db-c63e767dcb7b tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:18:59.426664 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-f56d7301-4d15-4778-b3db-c63e767dcb7b tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:18:59.556309 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.policy [None req-f56d7301-4d15-4778-b3db-c63e767dcb7b tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75753b29a78640df9622d4e2655baf9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee9d603d9cc4a8797f55d544f189720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117873) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:18:59.565366 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.policy [None req-f56d7301-4d15-4778-b3db-c63e767dcb7b tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75753b29a78640df9622d4e2655baf9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee9d603d9cc4a8797f55d544f189720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117873) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:18:59.566894 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.policy [None req-f56d7301-4d15-4778-b3db-c63e767dcb7b tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75753b29a78640df9622d4e2655baf9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee9d603d9cc4a8797f55d544f189720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117873) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:18:59.568036 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [None req-f56d7301-4d15-4778-b3db-c63e767dcb7b tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] 10.222.0.43 "GET /compute/v2.1/servers/73dbd5ab-5688-4de4-9da2-0b89d7cefb11" status: 200 len: 1809 microversion: 2.20 time: 0.154739 Jun 22 10:18:59.568602 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 229/475] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jun 22 10:18:59 2022] GET /compute/v2.1/servers/73dbd5ab-5688-4de4-9da2-0b89d7cefb11 => generated 1809 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 10:19:00.121924 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-3d22da3d-d6f3-461a-8cd7-e676a5664b57 tempest-VolumesActionsTest-1453826651 tempest-VolumesActionsTest-1453826651-project] Calling method '>' {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:19:00.122533 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.compute.api [None req-3d22da3d-d6f3-461a-8cd7-e676a5664b57 tempest-VolumesActionsTest-1453826651 tempest-VolumesActionsTest-1453826651-project] [instance: 6b2ba0b0-be2d-4a81-9abd-f7cc17b57602] Fetching instance by UUID {{(pid=117874) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:19:00.130207 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-3d22da3d-d6f3-461a-8cd7-e676a5664b57 tempest-VolumesActionsTest-1453826651 tempest-VolumesActionsTest-1453826651-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:00.130673 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-3d22da3d-d6f3-461a-8cd7-e676a5664b57 tempest-VolumesActionsTest-1453826651 tempest-VolumesActionsTest-1453826651-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:00.131487 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-3d22da3d-d6f3-461a-8cd7-e676a5664b57 tempest-VolumesActionsTest-1453826651 tempest-VolumesActionsTest-1453826651-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:00.131915 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-3d22da3d-d6f3-461a-8cd7-e676a5664b57 tempest-VolumesActionsTest-1453826651 tempest-VolumesActionsTest-1453826651-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:00.259687 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.policy [None req-3d22da3d-d6f3-461a-8cd7-e676a5664b57 tempest-VolumesActionsTest-1453826651 tempest-VolumesActionsTest-1453826651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9517119110f4ab99bff1379d5f7e241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b75addf2f334d7cb584ccae7779d3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117874) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:19:00.267313 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [None req-3d22da3d-d6f3-461a-8cd7-e676a5664b57 tempest-VolumesActionsTest-1453826651 tempest-VolumesActionsTest-1453826651-project] 10.222.0.43 "GET /compute/v2.1/servers/6b2ba0b0-be2d-4a81-9abd-f7cc17b57602" status: 200 len: 1313 microversion: 2.1 time: 0.149412 Jun 22 10:19:00.267880 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 247/476] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:19:00 2022] GET /compute/v2.1/servers/6b2ba0b0-be2d-4a81-9abd-f7cc17b57602 => generated 1313 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:19:00.587099 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-f7379508-d69f-4a6d-86ea-ec2454fadbc3 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Calling method '>' {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:19:00.587702 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.compute.api [None req-f7379508-d69f-4a6d-86ea-ec2454fadbc3 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] [instance: 73dbd5ab-5688-4de4-9da2-0b89d7cefb11] Fetching instance by UUID {{(pid=117873) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:19:00.595189 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-f7379508-d69f-4a6d-86ea-ec2454fadbc3 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:00.595635 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-f7379508-d69f-4a6d-86ea-ec2454fadbc3 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:00.596401 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-f7379508-d69f-4a6d-86ea-ec2454fadbc3 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:00.596846 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-f7379508-d69f-4a6d-86ea-ec2454fadbc3 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:00.727279 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.policy [None req-f7379508-d69f-4a6d-86ea-ec2454fadbc3 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75753b29a78640df9622d4e2655baf9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee9d603d9cc4a8797f55d544f189720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117873) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:19:00.736853 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.policy [None req-f7379508-d69f-4a6d-86ea-ec2454fadbc3 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75753b29a78640df9622d4e2655baf9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee9d603d9cc4a8797f55d544f189720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117873) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:19:00.738386 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.policy [None req-f7379508-d69f-4a6d-86ea-ec2454fadbc3 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75753b29a78640df9622d4e2655baf9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee9d603d9cc4a8797f55d544f189720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117873) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:19:00.739536 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [None req-f7379508-d69f-4a6d-86ea-ec2454fadbc3 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] 10.222.0.43 "GET /compute/v2.1/servers/73dbd5ab-5688-4de4-9da2-0b89d7cefb11" status: 200 len: 1809 microversion: 2.20 time: 0.156350 Jun 22 10:19:00.740091 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 230/477] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jun 22 10:19:00 2022] GET /compute/v2.1/servers/73dbd5ab-5688-4de4-9da2-0b89d7cefb11 => generated 1809 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 10:19:00.967197 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [req-0fac0048-d948-43d2-9c7b-ab499448d211 req-e4faefeb-f2c4-45e9-9414-bdb456e5522c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "73dbd5ab-5688-4de4-9da2-0b89d7cefb11", "name": "network-vif-plugged", "status": "completed", "tag": "468a7090-7d3f-43e5-8303-b6f8870ced56"}]} {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:19:00.975761 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [req-0fac0048-d948-43d2-9c7b-ab499448d211 req-e4faefeb-f2c4-45e9-9414-bdb456e5522c service nova] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:00.976269 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [req-0fac0048-d948-43d2-9c7b-ab499448d211 req-e4faefeb-f2c4-45e9-9414-bdb456e5522c service nova] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:00.989465 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.compute.server_external_events [req-0fac0048-d948-43d2-9c7b-ab499448d211 req-e4faefeb-f2c4-45e9-9414-bdb456e5522c service nova] Creating event network-vif-plugged:468a7090-7d3f-43e5-8303-b6f8870ced56 for instance 73dbd5ab-5688-4de4-9da2-0b89d7cefb11 on hv-cinder-84713 Jun 22 10:19:00.995033 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [req-0fac0048-d948-43d2-9c7b-ab499448d211 req-e4faefeb-f2c4-45e9-9414-bdb456e5522c service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031457 Jun 22 10:19:00.995810 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 248/478] 10.222.0.43 () {64 vars in 1317 bytes} [Wed Jun 22 10:19:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 10:19:01.283978 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-41f70764-f98f-4bed-87a9-e5e091ddcdd8 tempest-VolumesActionsTest-1453826651 tempest-VolumesActionsTest-1453826651-project] Calling method '>' {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:19:01.284609 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.compute.api [None req-41f70764-f98f-4bed-87a9-e5e091ddcdd8 tempest-VolumesActionsTest-1453826651 tempest-VolumesActionsTest-1453826651-project] [instance: 6b2ba0b0-be2d-4a81-9abd-f7cc17b57602] Fetching instance by UUID {{(pid=117873) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:19:01.290818 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-41f70764-f98f-4bed-87a9-e5e091ddcdd8 tempest-VolumesActionsTest-1453826651 tempest-VolumesActionsTest-1453826651-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:01.291266 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-41f70764-f98f-4bed-87a9-e5e091ddcdd8 tempest-VolumesActionsTest-1453826651 tempest-VolumesActionsTest-1453826651-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:01.292015 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-41f70764-f98f-4bed-87a9-e5e091ddcdd8 tempest-VolumesActionsTest-1453826651 tempest-VolumesActionsTest-1453826651-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:01.292445 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-41f70764-f98f-4bed-87a9-e5e091ddcdd8 tempest-VolumesActionsTest-1453826651 tempest-VolumesActionsTest-1453826651-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:01.429529 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.policy [None req-41f70764-f98f-4bed-87a9-e5e091ddcdd8 tempest-VolumesActionsTest-1453826651 tempest-VolumesActionsTest-1453826651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9517119110f4ab99bff1379d5f7e241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b75addf2f334d7cb584ccae7779d3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117873) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:19:01.437457 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [None req-41f70764-f98f-4bed-87a9-e5e091ddcdd8 tempest-VolumesActionsTest-1453826651 tempest-VolumesActionsTest-1453826651-project] 10.222.0.43 "GET /compute/v2.1/servers/6b2ba0b0-be2d-4a81-9abd-f7cc17b57602" status: 200 len: 1313 microversion: 2.1 time: 0.157658 Jun 22 10:19:01.438415 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 231/479] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:19:01 2022] GET /compute/v2.1/servers/6b2ba0b0-be2d-4a81-9abd-f7cc17b57602 => generated 1313 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:19:01.758996 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-27407a97-02b6-4d62-9458-c810b86fa614 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Calling method '>' {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:19:01.759690 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.compute.api [None req-27407a97-02b6-4d62-9458-c810b86fa614 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] [instance: 73dbd5ab-5688-4de4-9da2-0b89d7cefb11] Fetching instance by UUID {{(pid=117874) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:19:01.767865 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-27407a97-02b6-4d62-9458-c810b86fa614 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:01.768310 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-27407a97-02b6-4d62-9458-c810b86fa614 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:01.769066 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-27407a97-02b6-4d62-9458-c810b86fa614 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:01.769496 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-27407a97-02b6-4d62-9458-c810b86fa614 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:01.902840 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.policy [None req-27407a97-02b6-4d62-9458-c810b86fa614 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75753b29a78640df9622d4e2655baf9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee9d603d9cc4a8797f55d544f189720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117874) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:19:01.911342 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.policy [None req-27407a97-02b6-4d62-9458-c810b86fa614 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75753b29a78640df9622d4e2655baf9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee9d603d9cc4a8797f55d544f189720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117874) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:19:01.912817 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.policy [None req-27407a97-02b6-4d62-9458-c810b86fa614 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75753b29a78640df9622d4e2655baf9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee9d603d9cc4a8797f55d544f189720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117874) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:19:01.913975 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [None req-27407a97-02b6-4d62-9458-c810b86fa614 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] 10.222.0.43 "GET /compute/v2.1/servers/73dbd5ab-5688-4de4-9da2-0b89d7cefb11" status: 200 len: 1809 microversion: 2.20 time: 0.159383 Jun 22 10:19:01.914527 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 249/480] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jun 22 10:19:01 2022] GET /compute/v2.1/servers/73dbd5ab-5688-4de4-9da2-0b89d7cefb11 => generated 1809 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 10:19:02.455078 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-2d54c14d-e8e5-4190-b2aa-b3e278cef255 tempest-VolumesActionsTest-1453826651 tempest-VolumesActionsTest-1453826651-project] Calling method '>' {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:19:02.455685 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.compute.api [None req-2d54c14d-e8e5-4190-b2aa-b3e278cef255 tempest-VolumesActionsTest-1453826651 tempest-VolumesActionsTest-1453826651-project] [instance: 6b2ba0b0-be2d-4a81-9abd-f7cc17b57602] Fetching instance by UUID {{(pid=117873) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:19:02.458150 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG dbcounter [-] [117873] Writing DB stats nova_cell0:SELECT=2 {{(pid=117873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:19:02.463705 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-2d54c14d-e8e5-4190-b2aa-b3e278cef255 tempest-VolumesActionsTest-1453826651 tempest-VolumesActionsTest-1453826651-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:02.464151 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-2d54c14d-e8e5-4190-b2aa-b3e278cef255 tempest-VolumesActionsTest-1453826651 tempest-VolumesActionsTest-1453826651-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:02.464967 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-2d54c14d-e8e5-4190-b2aa-b3e278cef255 tempest-VolumesActionsTest-1453826651 tempest-VolumesActionsTest-1453826651-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:02.465394 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-2d54c14d-e8e5-4190-b2aa-b3e278cef255 tempest-VolumesActionsTest-1453826651 tempest-VolumesActionsTest-1453826651-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:02.595183 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.policy [None req-2d54c14d-e8e5-4190-b2aa-b3e278cef255 tempest-VolumesActionsTest-1453826651 tempest-VolumesActionsTest-1453826651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9517119110f4ab99bff1379d5f7e241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b75addf2f334d7cb584ccae7779d3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117873) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:19:02.602546 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [None req-2d54c14d-e8e5-4190-b2aa-b3e278cef255 tempest-VolumesActionsTest-1453826651 tempest-VolumesActionsTest-1453826651-project] 10.222.0.43 "GET /compute/v2.1/servers/6b2ba0b0-be2d-4a81-9abd-f7cc17b57602" status: 200 len: 1313 microversion: 2.1 time: 0.151787 Jun 22 10:19:02.603111 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 232/481] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:19:02 2022] GET /compute/v2.1/servers/6b2ba0b0-be2d-4a81-9abd-f7cc17b57602 => generated 1313 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:19:02.932753 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-c202e683-9899-4686-985c-6d5adca59e07 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Calling method '>' {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:19:02.933357 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.compute.api [None req-c202e683-9899-4686-985c-6d5adca59e07 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] [instance: 73dbd5ab-5688-4de4-9da2-0b89d7cefb11] Fetching instance by UUID {{(pid=117874) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:19:02.936351 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG dbcounter [-] [117874] Writing DB stats nova_cell0:SELECT=2 {{(pid=117874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:19:02.937272 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG dbcounter [-] [117874] Writing DB stats nova_cell0:SELECT=6 {{(pid=117874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:19:02.944569 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-c202e683-9899-4686-985c-6d5adca59e07 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:02.945010 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-c202e683-9899-4686-985c-6d5adca59e07 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:02.945799 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-c202e683-9899-4686-985c-6d5adca59e07 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:02.946229 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-c202e683-9899-4686-985c-6d5adca59e07 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:03.032284 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [req-25a953d1-ec9a-4e2d-ab45-adf224e8b5aa req-9d83ce33-c10e-4336-ba85-4bc81074b9f9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6b2ba0b0-be2d-4a81-9abd-f7cc17b57602", "name": "network-vif-plugged", "status": "completed", "tag": "d82309d3-6edc-4d2b-ba67-2d5c0226c1fc"}]} {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:19:03.039913 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [req-25a953d1-ec9a-4e2d-ab45-adf224e8b5aa req-9d83ce33-c10e-4336-ba85-4bc81074b9f9 service nova] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:03.040348 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [req-25a953d1-ec9a-4e2d-ab45-adf224e8b5aa req-9d83ce33-c10e-4336-ba85-4bc81074b9f9 service nova] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:03.051003 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.compute.server_external_events [req-25a953d1-ec9a-4e2d-ab45-adf224e8b5aa req-9d83ce33-c10e-4336-ba85-4bc81074b9f9 service nova] Creating event network-vif-plugged:d82309d3-6edc-4d2b-ba67-2d5c0226c1fc for instance 6b2ba0b0-be2d-4a81-9abd-f7cc17b57602 on hv-cinder-84713 Jun 22 10:19:03.056204 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [req-25a953d1-ec9a-4e2d-ab45-adf224e8b5aa req-9d83ce33-c10e-4336-ba85-4bc81074b9f9 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028670 Jun 22 10:19:03.056781 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 233/482] 10.222.0.43 () {64 vars in 1317 bytes} [Wed Jun 22 10:19:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 22 10:19:03.077733 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.policy [None req-c202e683-9899-4686-985c-6d5adca59e07 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75753b29a78640df9622d4e2655baf9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee9d603d9cc4a8797f55d544f189720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117874) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:19:03.086684 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.policy [None req-c202e683-9899-4686-985c-6d5adca59e07 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75753b29a78640df9622d4e2655baf9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee9d603d9cc4a8797f55d544f189720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117874) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:19:03.088171 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.policy [None req-c202e683-9899-4686-985c-6d5adca59e07 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75753b29a78640df9622d4e2655baf9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee9d603d9cc4a8797f55d544f189720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117874) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:19:03.089314 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [None req-c202e683-9899-4686-985c-6d5adca59e07 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] 10.222.0.43 "GET /compute/v2.1/servers/73dbd5ab-5688-4de4-9da2-0b89d7cefb11" status: 200 len: 1809 microversion: 2.20 time: 0.160718 Jun 22 10:19:03.089902 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 250/483] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jun 22 10:19:02 2022] GET /compute/v2.1/servers/73dbd5ab-5688-4de4-9da2-0b89d7cefb11 => generated 1809 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 10:19:03.619691 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-badcb495-0ee0-43f8-ad2e-953c59c0b8f8 tempest-VolumesActionsTest-1453826651 tempest-VolumesActionsTest-1453826651-project] Calling method '>' {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:19:03.620382 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.compute.api [None req-badcb495-0ee0-43f8-ad2e-953c59c0b8f8 tempest-VolumesActionsTest-1453826651 tempest-VolumesActionsTest-1453826651-project] [instance: 6b2ba0b0-be2d-4a81-9abd-f7cc17b57602] Fetching instance by UUID {{(pid=117873) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:19:03.627908 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-badcb495-0ee0-43f8-ad2e-953c59c0b8f8 tempest-VolumesActionsTest-1453826651 tempest-VolumesActionsTest-1453826651-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:03.628630 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-badcb495-0ee0-43f8-ad2e-953c59c0b8f8 tempest-VolumesActionsTest-1453826651 tempest-VolumesActionsTest-1453826651-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:03.629388 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-badcb495-0ee0-43f8-ad2e-953c59c0b8f8 tempest-VolumesActionsTest-1453826651 tempest-VolumesActionsTest-1453826651-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:03.630078 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-badcb495-0ee0-43f8-ad2e-953c59c0b8f8 tempest-VolumesActionsTest-1453826651 tempest-VolumesActionsTest-1453826651-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:03.771670 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.policy [None req-badcb495-0ee0-43f8-ad2e-953c59c0b8f8 tempest-VolumesActionsTest-1453826651 tempest-VolumesActionsTest-1453826651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9517119110f4ab99bff1379d5f7e241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b75addf2f334d7cb584ccae7779d3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117873) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:19:03.780025 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [None req-badcb495-0ee0-43f8-ad2e-953c59c0b8f8 tempest-VolumesActionsTest-1453826651 tempest-VolumesActionsTest-1453826651-project] 10.222.0.43 "GET /compute/v2.1/servers/6b2ba0b0-be2d-4a81-9abd-f7cc17b57602" status: 200 len: 1313 microversion: 2.1 time: 0.164350 Jun 22 10:19:03.780676 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 234/484] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:19:03 2022] GET /compute/v2.1/servers/6b2ba0b0-be2d-4a81-9abd-f7cc17b57602 => generated 1313 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:19:04.109182 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-6ec60f2f-d515-4cc8-b2db-53bd59269b77 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Calling method '>' {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:19:04.110096 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.compute.api [None req-6ec60f2f-d515-4cc8-b2db-53bd59269b77 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] [instance: 73dbd5ab-5688-4de4-9da2-0b89d7cefb11] Fetching instance by UUID {{(pid=117874) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:19:04.117039 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-6ec60f2f-d515-4cc8-b2db-53bd59269b77 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:04.117498 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-6ec60f2f-d515-4cc8-b2db-53bd59269b77 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:04.118297 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-6ec60f2f-d515-4cc8-b2db-53bd59269b77 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:04.118735 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-6ec60f2f-d515-4cc8-b2db-53bd59269b77 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:04.252414 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.policy [None req-6ec60f2f-d515-4cc8-b2db-53bd59269b77 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75753b29a78640df9622d4e2655baf9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee9d603d9cc4a8797f55d544f189720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117874) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:19:04.261094 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.policy [None req-6ec60f2f-d515-4cc8-b2db-53bd59269b77 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75753b29a78640df9622d4e2655baf9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee9d603d9cc4a8797f55d544f189720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117874) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:19:04.262597 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.policy [None req-6ec60f2f-d515-4cc8-b2db-53bd59269b77 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75753b29a78640df9622d4e2655baf9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee9d603d9cc4a8797f55d544f189720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117874) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:19:04.263768 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [None req-6ec60f2f-d515-4cc8-b2db-53bd59269b77 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] 10.222.0.43 "GET /compute/v2.1/servers/73dbd5ab-5688-4de4-9da2-0b89d7cefb11" status: 200 len: 1809 microversion: 2.20 time: 0.158991 Jun 22 10:19:04.264315 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 251/485] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jun 22 10:19:04 2022] GET /compute/v2.1/servers/73dbd5ab-5688-4de4-9da2-0b89d7cefb11 => generated 1809 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 10:19:04.797988 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-8322f328-bf7e-4e3d-be1e-59a2fa711d75 tempest-VolumesActionsTest-1453826651 tempest-VolumesActionsTest-1453826651-project] Calling method '>' {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:19:04.798662 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.compute.api [None req-8322f328-bf7e-4e3d-be1e-59a2fa711d75 tempest-VolumesActionsTest-1453826651 tempest-VolumesActionsTest-1453826651-project] [instance: 6b2ba0b0-be2d-4a81-9abd-f7cc17b57602] Fetching instance by UUID {{(pid=117873) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:19:04.805377 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-8322f328-bf7e-4e3d-be1e-59a2fa711d75 tempest-VolumesActionsTest-1453826651 tempest-VolumesActionsTest-1453826651-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:04.805842 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-8322f328-bf7e-4e3d-be1e-59a2fa711d75 tempest-VolumesActionsTest-1453826651 tempest-VolumesActionsTest-1453826651-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:04.806590 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-8322f328-bf7e-4e3d-be1e-59a2fa711d75 tempest-VolumesActionsTest-1453826651 tempest-VolumesActionsTest-1453826651-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:04.807018 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-8322f328-bf7e-4e3d-be1e-59a2fa711d75 tempest-VolumesActionsTest-1453826651 tempest-VolumesActionsTest-1453826651-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:04.942246 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.policy [None req-8322f328-bf7e-4e3d-be1e-59a2fa711d75 tempest-VolumesActionsTest-1453826651 tempest-VolumesActionsTest-1453826651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9517119110f4ab99bff1379d5f7e241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b75addf2f334d7cb584ccae7779d3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117873) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:19:04.949551 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [None req-8322f328-bf7e-4e3d-be1e-59a2fa711d75 tempest-VolumesActionsTest-1453826651 tempest-VolumesActionsTest-1453826651-project] 10.222.0.43 "GET /compute/v2.1/servers/6b2ba0b0-be2d-4a81-9abd-f7cc17b57602" status: 200 len: 1313 microversion: 2.1 time: 0.156863 Jun 22 10:19:04.950146 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 235/486] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:19:04 2022] GET /compute/v2.1/servers/6b2ba0b0-be2d-4a81-9abd-f7cc17b57602 => generated 1313 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:19:05.283120 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-0228de9e-9cab-442f-9475-38b7a1ed8f79 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Calling method '>' {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:19:05.283731 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.compute.api [None req-0228de9e-9cab-442f-9475-38b7a1ed8f79 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] [instance: 73dbd5ab-5688-4de4-9da2-0b89d7cefb11] Fetching instance by UUID {{(pid=117874) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:19:05.290174 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-0228de9e-9cab-442f-9475-38b7a1ed8f79 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:05.290617 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-0228de9e-9cab-442f-9475-38b7a1ed8f79 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:05.291373 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-0228de9e-9cab-442f-9475-38b7a1ed8f79 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:05.291806 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-0228de9e-9cab-442f-9475-38b7a1ed8f79 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:05.423953 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.policy [None req-0228de9e-9cab-442f-9475-38b7a1ed8f79 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75753b29a78640df9622d4e2655baf9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee9d603d9cc4a8797f55d544f189720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117874) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:19:05.432770 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.policy [None req-0228de9e-9cab-442f-9475-38b7a1ed8f79 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75753b29a78640df9622d4e2655baf9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee9d603d9cc4a8797f55d544f189720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117874) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:19:05.434390 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.policy [None req-0228de9e-9cab-442f-9475-38b7a1ed8f79 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75753b29a78640df9622d4e2655baf9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee9d603d9cc4a8797f55d544f189720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117874) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:19:05.435558 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [None req-0228de9e-9cab-442f-9475-38b7a1ed8f79 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] 10.222.0.43 "GET /compute/v2.1/servers/73dbd5ab-5688-4de4-9da2-0b89d7cefb11" status: 200 len: 1796 microversion: 2.20 time: 0.156933 Jun 22 10:19:05.436157 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 252/487] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jun 22 10:19:05 2022] GET /compute/v2.1/servers/73dbd5ab-5688-4de4-9da2-0b89d7cefb11 => generated 1796 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 10:19:05.966216 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-ccbf837f-2d8b-417e-a67f-95e039f59990 tempest-VolumesActionsTest-1453826651 tempest-VolumesActionsTest-1453826651-project] Calling method '>' {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:19:05.966818 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.compute.api [None req-ccbf837f-2d8b-417e-a67f-95e039f59990 tempest-VolumesActionsTest-1453826651 tempest-VolumesActionsTest-1453826651-project] [instance: 6b2ba0b0-be2d-4a81-9abd-f7cc17b57602] Fetching instance by UUID {{(pid=117873) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:19:05.974528 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-ccbf837f-2d8b-417e-a67f-95e039f59990 tempest-VolumesActionsTest-1453826651 tempest-VolumesActionsTest-1453826651-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:05.974972 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-ccbf837f-2d8b-417e-a67f-95e039f59990 tempest-VolumesActionsTest-1453826651 tempest-VolumesActionsTest-1453826651-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:05.975763 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-ccbf837f-2d8b-417e-a67f-95e039f59990 tempest-VolumesActionsTest-1453826651 tempest-VolumesActionsTest-1453826651-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:05.976190 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-ccbf837f-2d8b-417e-a67f-95e039f59990 tempest-VolumesActionsTest-1453826651 tempest-VolumesActionsTest-1453826651-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:06.105747 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.policy [None req-ccbf837f-2d8b-417e-a67f-95e039f59990 tempest-VolumesActionsTest-1453826651 tempest-VolumesActionsTest-1453826651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9517119110f4ab99bff1379d5f7e241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b75addf2f334d7cb584ccae7779d3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117873) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:19:06.113888 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [None req-ccbf837f-2d8b-417e-a67f-95e039f59990 tempest-VolumesActionsTest-1453826651 tempest-VolumesActionsTest-1453826651-project] 10.222.0.43 "GET /compute/v2.1/servers/6b2ba0b0-be2d-4a81-9abd-f7cc17b57602" status: 200 len: 1497 microversion: 2.1 time: 0.151463 Jun 22 10:19:06.114448 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 236/488] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:19:05 2022] GET /compute/v2.1/servers/6b2ba0b0-be2d-4a81-9abd-f7cc17b57602 => generated 1497 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:19:06.627404 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-b157ae04-ee37-4f05-90e2-84546198b648 tempest-VolumesActionsTest-1453826651 tempest-VolumesActionsTest-1453826651-project] Calling method '>' {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:19:06.627893 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.compute.api [None req-b157ae04-ee37-4f05-90e2-84546198b648 tempest-VolumesActionsTest-1453826651 tempest-VolumesActionsTest-1453826651-project] [instance: 6b2ba0b0-be2d-4a81-9abd-f7cc17b57602] Fetching instance by UUID {{(pid=117874) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:19:06.634499 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-b157ae04-ee37-4f05-90e2-84546198b648 tempest-VolumesActionsTest-1453826651 tempest-VolumesActionsTest-1453826651-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:06.634943 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-b157ae04-ee37-4f05-90e2-84546198b648 tempest-VolumesActionsTest-1453826651 tempest-VolumesActionsTest-1453826651-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:06.635695 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-b157ae04-ee37-4f05-90e2-84546198b648 tempest-VolumesActionsTest-1453826651 tempest-VolumesActionsTest-1453826651-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:06.636127 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-b157ae04-ee37-4f05-90e2-84546198b648 tempest-VolumesActionsTest-1453826651 tempest-VolumesActionsTest-1453826651-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:06.661582 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.compute.api [None req-b157ae04-ee37-4f05-90e2-84546198b648 tempest-VolumesActionsTest-1453826651 tempest-VolumesActionsTest-1453826651-project] [instance: 6b2ba0b0-be2d-4a81-9abd-f7cc17b57602] Going to try to terminate instance {{(pid=117874) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 22 10:19:06.732419 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG dbcounter [-] [117874] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=117874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:19:06.741808 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [None req-b157ae04-ee37-4f05-90e2-84546198b648 tempest-VolumesActionsTest-1453826651 tempest-VolumesActionsTest-1453826651-project] 10.222.0.43 "DELETE /compute/v2.1/servers/6b2ba0b0-be2d-4a81-9abd-f7cc17b57602" status: 204 len: 0 microversion: 2.1 time: 0.118517 Jun 22 10:19:06.743194 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 253/489] 10.222.0.43 () {58 vars in 1238 bytes} [Wed Jun 22 10:19:06 2022] DELETE /compute/v2.1/servers/6b2ba0b0-be2d-4a81-9abd-f7cc17b57602 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 22 10:19:06.751583 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-4bf6365d-ccfe-4a24-a32e-e41a3855d166 tempest-VolumesActionsTest-1453826651 tempest-VolumesActionsTest-1453826651-project] Calling method '>' {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:19:06.752189 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.compute.api [None req-4bf6365d-ccfe-4a24-a32e-e41a3855d166 tempest-VolumesActionsTest-1453826651 tempest-VolumesActionsTest-1453826651-project] [instance: 6b2ba0b0-be2d-4a81-9abd-f7cc17b57602] Fetching instance by UUID {{(pid=117873) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:19:06.758316 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-4bf6365d-ccfe-4a24-a32e-e41a3855d166 tempest-VolumesActionsTest-1453826651 tempest-VolumesActionsTest-1453826651-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:06.758775 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-4bf6365d-ccfe-4a24-a32e-e41a3855d166 tempest-VolumesActionsTest-1453826651 tempest-VolumesActionsTest-1453826651-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:06.759652 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-4bf6365d-ccfe-4a24-a32e-e41a3855d166 tempest-VolumesActionsTest-1453826651 tempest-VolumesActionsTest-1453826651-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:06.759979 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-4bf6365d-ccfe-4a24-a32e-e41a3855d166 tempest-VolumesActionsTest-1453826651 tempest-VolumesActionsTest-1453826651-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:06.837019 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-6a8a91b8-1a5b-46af-a381-7ddd677ebf62 tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Calling method '>' {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:19:06.837544 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.compute.api [None req-6a8a91b8-1a5b-46af-a381-7ddd677ebf62 tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] [instance: 0b2e66bb-efd5-4ff0-8163-5973db8e0db7] Fetching instance by UUID {{(pid=117874) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:19:06.844079 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-6a8a91b8-1a5b-46af-a381-7ddd677ebf62 tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:06.845223 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-6a8a91b8-1a5b-46af-a381-7ddd677ebf62 tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:06.846031 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-6a8a91b8-1a5b-46af-a381-7ddd677ebf62 tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:06.846464 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-6a8a91b8-1a5b-46af-a381-7ddd677ebf62 tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:06.870227 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [None req-6a8a91b8-1a5b-46af-a381-7ddd677ebf62 tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] 10.222.0.43 "GET /compute/v2.1/servers/0b2e66bb-efd5-4ff0-8163-5973db8e0db7/ips" status: 200 len: 148 microversion: 2.1 time: 0.037644 Jun 22 10:19:06.870798 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 254/490] 10.222.0.43 () {58 vars in 1247 bytes} [Wed Jun 22 10:19:06 2022] GET /compute/v2.1/servers/0b2e66bb-efd5-4ff0-8163-5973db8e0db7/ips => generated 148 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 22 10:19:06.881193 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-363ddbd7-e9b2-42a0-91a6-e365bb825fc1 tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8e895d50-268e-428c-a673-cadd98bdb03f"}} {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:19:06.882290 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.compute.api [None req-363ddbd7-e9b2-42a0-91a6-e365bb825fc1 tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] [instance: 0b2e66bb-efd5-4ff0-8163-5973db8e0db7] Fetching instance by UUID {{(pid=117874) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:19:06.888435 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-363ddbd7-e9b2-42a0-91a6-e365bb825fc1 tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:06.888868 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-363ddbd7-e9b2-42a0-91a6-e365bb825fc1 tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:06.889673 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-363ddbd7-e9b2-42a0-91a6-e365bb825fc1 tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:06.890130 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-363ddbd7-e9b2-42a0-91a6-e365bb825fc1 tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:06.894985 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.policy [None req-4bf6365d-ccfe-4a24-a32e-e41a3855d166 tempest-VolumesActionsTest-1453826651 tempest-VolumesActionsTest-1453826651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9517119110f4ab99bff1379d5f7e241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b75addf2f334d7cb584ccae7779d3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117873) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:19:06.902493 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [None req-4bf6365d-ccfe-4a24-a32e-e41a3855d166 tempest-VolumesActionsTest-1453826651 tempest-VolumesActionsTest-1453826651-project] 10.222.0.43 "GET /compute/v2.1/servers/6b2ba0b0-be2d-4a81-9abd-f7cc17b57602" status: 200 len: 1503 microversion: 2.1 time: 0.154922 Jun 22 10:19:06.903066 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 237/491] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:19:06 2022] GET /compute/v2.1/servers/6b2ba0b0-be2d-4a81-9abd-f7cc17b57602 => generated 1503 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:19:06.968617 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.wsgi [None req-363ddbd7-e9b2-42a0-91a6-e365bb825fc1 tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] HTTP exception thrown: Invalid volume: volume 8e895d50-268e-428c-a673-cadd98bdb03f is already attached to instances: 5828c9dc-3439-4da7-a94c-f81cbbfdcb99 Jun 22 10:19:06.970965 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-363ddbd7-e9b2-42a0-91a6-e365bb825fc1 tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Request method failure captured: Jun 22 10:19:06.970965 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: request: POST /compute/v2.1/servers/0b2e66bb-efd5-4ff0-8163-5973db8e0db7/os-volume_attachments HTTP/1.1 Jun 22 10:19:06.970965 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: Accept: application/json Jun 22 10:19:06.970965 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: Accept-Encoding: identity Jun 22 10:19:06.970965 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: Connection: close Jun 22 10:19:06.970965 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: Content-Length: 74 Jun 22 10:19:06.970965 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: Content-Type: application/json Jun 22 10:19:06.970965 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: Host: 10.222.0.43 Jun 22 10:19:06.970965 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: Openstack-System-Scope: None Jun 22 10:19:06.970965 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: User-Agent: python-urllib3/1.26.9 Jun 22 10:19:06.970965 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-Auth-Token: gAAAAABisuvUpGkoSsQ9d1KNFPX834O5Ed4reiDCWeVnTPicJ3T1CXVLNJjI8u1aloRBXjMgN_RPq4rTUmL5P2islljUOvvHIwLebG3DYtPiBpBpjPn3C8o_VLQB3yNvqrLTJBaPVXC7QVZTOTIWPKqjtW_CrQ0ZdCwS1UGZXZ6Doixu1TJW9Cg Jun 22 10:19:06.970965 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-Domain-Id: None Jun 22 10:19:06.970965 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-Domain-Name: None Jun 22 10:19:06.970965 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-Identity-Status: Confirmed Jun 22 10:19:06.970965 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-Is-Admin-Project: True Jun 22 10:19:06.970965 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-Project-Domain-Id: default Jun 22 10:19:06.970965 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-Project-Domain-Name: Default Jun 22 10:19:06.970965 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-Project-Id: 78629282e2b74418a2c1cdac32576ef1 Jun 22 10:19:06.970965 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-Project-Name: tempest-AttachVolumeNegativeTest-73508829 Jun 22 10:19:06.970965 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-Role: reader,member Jun 22 10:19:06.970965 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-Roles: reader,member Jun 22 10:19:06.972331 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/78629282e2b74418a2c1cdac32576ef1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/78629282e2b74418a2c1cdac32576ef1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_78629282e2b74418a2c1cdac32576ef1", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/78629282e2b74418a2c1cdac32576ef1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}] Jun 22 10:19:06.972331 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-Tenant: tempest-AttachVolumeNegativeTest-73508829 Jun 22 10:19:06.972331 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-Tenant-Id: 78629282e2b74418a2c1cdac32576ef1 Jun 22 10:19:06.972331 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-73508829 Jun 22 10:19:06.972331 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-User: tempest-AttachVolumeNegativeTest-73508829-project Jun 22 10:19:06.972331 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-User-Domain-Id: default Jun 22 10:19:06.972331 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-User-Domain-Name: Default Jun 22 10:19:06.972331 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-User-Id: 7be3d844dcee4d19966fc7944463a0bc Jun 22 10:19:06.972331 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-User-Name: tempest-AttachVolumeNegativeTest-73508829-project Jun 22 10:19:06.972331 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: Jun 22 10:19:06.972331 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: {"volumeAttachment": {"volumeId": "8e895d50-268e-428c-a673-cadd98bdb03f"}} Jun 22 10:19:06.972331 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: method: > Jun 22 10:19:06.973328 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: exception: Invalid volume: volume 8e895d50-268e-428c-a673-cadd98bdb03f is already attached to instances: 5828c9dc-3439-4da7-a94c-f81cbbfdcb99 Jun 22 10:19:06.973328 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: action_args: {'server_id': '0b2e66bb-efd5-4ff0-8163-5973db8e0db7', 'body': {'volumeAttachment': {'volumeId': '8e895d50-268e-428c-a673-cadd98bdb03f'}}} Jun 22 10:19:06.973328 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 10:19:06.973328 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:19:06.973328 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jun 22 10:19:06.973328 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jun 22 10:19:06.973328 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 22 10:19:06.973328 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 22 10:19:06.973328 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jun 22 10:19:06.973328 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 22 10:19:06.973328 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jun 22 10:19:06.973328 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jun 22 10:19:06.973328 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jun 22 10:19:06.973328 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jun 22 10:19:06.973328 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 8e895d50-268e-428c-a673-cadd98bdb03f is already attached to instances: 5828c9dc-3439-4da7-a94c-f81cbbfdcb99 Jun 22 10:19:06.973328 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi Jun 22 10:19:06.973328 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 10:19:06.973328 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi Jun 22 10:19:06.973328 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:19:06.974536 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 10:19:06.974536 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 10:19:06.974536 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 10:19:06.974536 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 10:19:06.974536 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 10:19:06.974536 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 10:19:06.974536 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 22 10:19:06.974536 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 22 10:19:06.974536 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 22 10:19:06.974536 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 22 10:19:06.974536 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 22 10:19:06.974536 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 22 10:19:06.974536 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jun 22 10:19:06.974536 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jun 22 10:19:06.974536 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 8e895d50-268e-428c-a673-cadd98bdb03f is already attached to instances: 5828c9dc-3439-4da7-a94c-f81cbbfdcb99 Jun 22 10:19:06.974536 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi Jun 22 10:19:06.974536 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 10:19:06.974536 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi Jun 22 10:19:06.974536 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:19:06.974536 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 10:19:06.975705 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 10:19:06.975705 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 10:19:06.975705 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 10:19:06.975705 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 8e895d50-268e-428c-a673-cadd98bdb03f is already attached to instances: 5828c9dc-3439-4da7-a94c-f81cbbfdcb99 Jun 22 10:19:06.975705 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi Jun 22 10:19:06.975705 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-363ddbd7-e9b2-42a0-91a6-e365bb825fc1 tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Returning 400 to user: Invalid volume: volume 8e895d50-268e-428c-a673-cadd98bdb03f is already attached to instances: 5828c9dc-3439-4da7-a94c-f81cbbfdcb99 {{(pid=117874) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 10:19:06.975705 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [None req-363ddbd7-e9b2-42a0-91a6-e365bb825fc1 tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] 10.222.0.43 "POST /compute/v2.1/servers/0b2e66bb-efd5-4ff0-8163-5973db8e0db7/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.095005 Jun 22 10:19:06.975705 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 255/492] 10.222.0.43 () {60 vars in 1322 bytes} [Wed Jun 22 10:19:06 2022] POST /compute/v2.1/servers/0b2e66bb-efd5-4ff0-8163-5973db8e0db7/os-volume_attachments => generated 174 bytes in 96 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jun 22 10:19:06.981494 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-2060c5f9-86f9-40b6-b519-f505acd714c7 tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Calling method '>' {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:19:06.982021 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.compute.api [None req-2060c5f9-86f9-40b6-b519-f505acd714c7 tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] [instance: 0b2e66bb-efd5-4ff0-8163-5973db8e0db7] Fetching instance by UUID {{(pid=117873) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:19:06.988630 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-2060c5f9-86f9-40b6-b519-f505acd714c7 tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:06.989078 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-2060c5f9-86f9-40b6-b519-f505acd714c7 tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:06.989876 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-2060c5f9-86f9-40b6-b519-f505acd714c7 tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:06.990312 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-2060c5f9-86f9-40b6-b519-f505acd714c7 tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:07.015950 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.compute.api [None req-2060c5f9-86f9-40b6-b519-f505acd714c7 tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] [instance: 0b2e66bb-efd5-4ff0-8163-5973db8e0db7] Going to try to terminate instance {{(pid=117873) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 22 10:19:07.092645 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [None req-2060c5f9-86f9-40b6-b519-f505acd714c7 tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] 10.222.0.43 "DELETE /compute/v2.1/servers/0b2e66bb-efd5-4ff0-8163-5973db8e0db7" status: 204 len: 0 microversion: 2.1 time: 0.114802 Jun 22 10:19:07.093182 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 238/493] 10.222.0.43 () {58 vars in 1238 bytes} [Wed Jun 22 10:19:06 2022] DELETE /compute/v2.1/servers/0b2e66bb-efd5-4ff0-8163-5973db8e0db7 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 22 10:19:07.101320 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-f5bdbd2a-a318-4dad-9a88-c91570b370da tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Calling method '>' {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:19:07.101973 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.compute.api [None req-f5bdbd2a-a318-4dad-9a88-c91570b370da tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] [instance: 0b2e66bb-efd5-4ff0-8163-5973db8e0db7] Fetching instance by UUID {{(pid=117874) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:19:07.108306 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-f5bdbd2a-a318-4dad-9a88-c91570b370da tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:07.108738 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-f5bdbd2a-a318-4dad-9a88-c91570b370da tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:07.109484 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-f5bdbd2a-a318-4dad-9a88-c91570b370da tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:07.109970 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-f5bdbd2a-a318-4dad-9a88-c91570b370da tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:07.242696 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.policy [None req-f5bdbd2a-a318-4dad-9a88-c91570b370da tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7be3d844dcee4d19966fc7944463a0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78629282e2b74418a2c1cdac32576ef1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117874) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:19:07.250296 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [None req-f5bdbd2a-a318-4dad-9a88-c91570b370da tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] 10.222.0.43 "GET /compute/v2.1/servers/0b2e66bb-efd5-4ff0-8163-5973db8e0db7" status: 200 len: 1680 microversion: 2.1 time: 0.152804 Jun 22 10:19:07.251410 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 256/494] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:19:07 2022] GET /compute/v2.1/servers/0b2e66bb-efd5-4ff0-8163-5973db8e0db7 => generated 1680 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:19:07.920878 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-d768508a-0531-449d-8898-4ccb39453a20 tempest-VolumesActionsTest-1453826651 tempest-VolumesActionsTest-1453826651-project] Calling method '>' {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:19:07.921561 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.compute.api [None req-d768508a-0531-449d-8898-4ccb39453a20 tempest-VolumesActionsTest-1453826651 tempest-VolumesActionsTest-1453826651-project] [instance: 6b2ba0b0-be2d-4a81-9abd-f7cc17b57602] Fetching instance by UUID {{(pid=117873) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:19:07.928517 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-d768508a-0531-449d-8898-4ccb39453a20 tempest-VolumesActionsTest-1453826651 tempest-VolumesActionsTest-1453826651-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:07.928955 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-d768508a-0531-449d-8898-4ccb39453a20 tempest-VolumesActionsTest-1453826651 tempest-VolumesActionsTest-1453826651-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:07.929781 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-d768508a-0531-449d-8898-4ccb39453a20 tempest-VolumesActionsTest-1453826651 tempest-VolumesActionsTest-1453826651-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:07.930213 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-d768508a-0531-449d-8898-4ccb39453a20 tempest-VolumesActionsTest-1453826651 tempest-VolumesActionsTest-1453826651-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:08.062967 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.policy [None req-d768508a-0531-449d-8898-4ccb39453a20 tempest-VolumesActionsTest-1453826651 tempest-VolumesActionsTest-1453826651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9517119110f4ab99bff1379d5f7e241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b75addf2f334d7cb584ccae7779d3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117873) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:19:08.072732 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [None req-d768508a-0531-449d-8898-4ccb39453a20 tempest-VolumesActionsTest-1453826651 tempest-VolumesActionsTest-1453826651-project] 10.222.0.43 "GET /compute/v2.1/servers/6b2ba0b0-be2d-4a81-9abd-f7cc17b57602" status: 200 len: 1503 microversion: 2.1 time: 0.155845 Jun 22 10:19:08.073580 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 239/495] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:19:07 2022] GET /compute/v2.1/servers/6b2ba0b0-be2d-4a81-9abd-f7cc17b57602 => generated 1503 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:19:08.269541 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-8cbc18b8-6483-4826-974c-924f9e997a11 tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Calling method '>' {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:19:08.270143 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.compute.api [None req-8cbc18b8-6483-4826-974c-924f9e997a11 tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] [instance: 0b2e66bb-efd5-4ff0-8163-5973db8e0db7] Fetching instance by UUID {{(pid=117874) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:19:08.276534 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-8cbc18b8-6483-4826-974c-924f9e997a11 tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:08.276982 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-8cbc18b8-6483-4826-974c-924f9e997a11 tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:08.277755 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-8cbc18b8-6483-4826-974c-924f9e997a11 tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:08.278193 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-8cbc18b8-6483-4826-974c-924f9e997a11 tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:08.408092 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.policy [None req-8cbc18b8-6483-4826-974c-924f9e997a11 tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7be3d844dcee4d19966fc7944463a0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78629282e2b74418a2c1cdac32576ef1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117874) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:19:08.411066 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG dbcounter [-] [117874] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:19:08.415781 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [None req-8cbc18b8-6483-4826-974c-924f9e997a11 tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] 10.222.0.43 "GET /compute/v2.1/servers/0b2e66bb-efd5-4ff0-8163-5973db8e0db7" status: 200 len: 1680 microversion: 2.1 time: 0.151265 Jun 22 10:19:08.416344 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 257/496] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:19:08 2022] GET /compute/v2.1/servers/0b2e66bb-efd5-4ff0-8163-5973db8e0db7 => generated 1680 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:19:09.089875 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-e3324a6b-cd99-45ac-8b96-33f7a145202f tempest-VolumesActionsTest-1453826651 tempest-VolumesActionsTest-1453826651-project] Calling method '>' {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:19:09.090479 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.compute.api [None req-e3324a6b-cd99-45ac-8b96-33f7a145202f tempest-VolumesActionsTest-1453826651 tempest-VolumesActionsTest-1453826651-project] [instance: 6b2ba0b0-be2d-4a81-9abd-f7cc17b57602] Fetching instance by UUID {{(pid=117873) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:19:09.097059 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-e3324a6b-cd99-45ac-8b96-33f7a145202f tempest-VolumesActionsTest-1453826651 tempest-VolumesActionsTest-1453826651-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:09.097498 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-e3324a6b-cd99-45ac-8b96-33f7a145202f tempest-VolumesActionsTest-1453826651 tempest-VolumesActionsTest-1453826651-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:09.098283 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-e3324a6b-cd99-45ac-8b96-33f7a145202f tempest-VolumesActionsTest-1453826651 tempest-VolumesActionsTest-1453826651-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:09.098706 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-e3324a6b-cd99-45ac-8b96-33f7a145202f tempest-VolumesActionsTest-1453826651 tempest-VolumesActionsTest-1453826651-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:09.232005 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.policy [None req-e3324a6b-cd99-45ac-8b96-33f7a145202f tempest-VolumesActionsTest-1453826651 tempest-VolumesActionsTest-1453826651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9517119110f4ab99bff1379d5f7e241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b75addf2f334d7cb584ccae7779d3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117873) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:19:09.239996 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [None req-e3324a6b-cd99-45ac-8b96-33f7a145202f tempest-VolumesActionsTest-1453826651 tempest-VolumesActionsTest-1453826651-project] 10.222.0.43 "GET /compute/v2.1/servers/6b2ba0b0-be2d-4a81-9abd-f7cc17b57602" status: 200 len: 1503 microversion: 2.1 time: 0.153947 Jun 22 10:19:09.240564 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 240/497] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:19:09 2022] GET /compute/v2.1/servers/6b2ba0b0-be2d-4a81-9abd-f7cc17b57602 => generated 1503 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:19:09.433040 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-dd5b5d13-2a6d-49a9-8aa6-625b5f5b43bf tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Calling method '>' {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:19:09.433646 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.compute.api [None req-dd5b5d13-2a6d-49a9-8aa6-625b5f5b43bf tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] [instance: 0b2e66bb-efd5-4ff0-8163-5973db8e0db7] Fetching instance by UUID {{(pid=117874) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:19:09.441586 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-dd5b5d13-2a6d-49a9-8aa6-625b5f5b43bf tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:09.442057 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-dd5b5d13-2a6d-49a9-8aa6-625b5f5b43bf tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:09.442815 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-dd5b5d13-2a6d-49a9-8aa6-625b5f5b43bf tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:09.443249 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-dd5b5d13-2a6d-49a9-8aa6-625b5f5b43bf tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:09.571628 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.policy [None req-dd5b5d13-2a6d-49a9-8aa6-625b5f5b43bf tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7be3d844dcee4d19966fc7944463a0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78629282e2b74418a2c1cdac32576ef1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117874) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:19:09.579714 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [None req-dd5b5d13-2a6d-49a9-8aa6-625b5f5b43bf tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] 10.222.0.43 "GET /compute/v2.1/servers/0b2e66bb-efd5-4ff0-8163-5973db8e0db7" status: 200 len: 1680 microversion: 2.1 time: 0.151134 Jun 22 10:19:09.580273 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 258/498] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:19:09 2022] GET /compute/v2.1/servers/0b2e66bb-efd5-4ff0-8163-5973db8e0db7 => generated 1680 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:19:09.585946 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 22 10:19:09.586107 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: Wed Jun 22 10:19:09 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 22 10:19:10.256955 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-ac8f4705-67b5-4535-860e-290c29d57ec1 tempest-VolumesActionsTest-1453826651 tempest-VolumesActionsTest-1453826651-project] Calling method '>' {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:19:10.257551 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.compute.api [None req-ac8f4705-67b5-4535-860e-290c29d57ec1 tempest-VolumesActionsTest-1453826651 tempest-VolumesActionsTest-1453826651-project] [instance: 6b2ba0b0-be2d-4a81-9abd-f7cc17b57602] Fetching instance by UUID {{(pid=117873) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:19:10.263913 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-ac8f4705-67b5-4535-860e-290c29d57ec1 tempest-VolumesActionsTest-1453826651 tempest-VolumesActionsTest-1453826651-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:10.264355 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-ac8f4705-67b5-4535-860e-290c29d57ec1 tempest-VolumesActionsTest-1453826651 tempest-VolumesActionsTest-1453826651-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:10.265102 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-ac8f4705-67b5-4535-860e-290c29d57ec1 tempest-VolumesActionsTest-1453826651 tempest-VolumesActionsTest-1453826651-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:10.265524 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-ac8f4705-67b5-4535-860e-290c29d57ec1 tempest-VolumesActionsTest-1453826651 tempest-VolumesActionsTest-1453826651-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:10.271195 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG dbcounter [-] [117873] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:19:10.400301 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.policy [None req-ac8f4705-67b5-4535-860e-290c29d57ec1 tempest-VolumesActionsTest-1453826651 tempest-VolumesActionsTest-1453826651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9517119110f4ab99bff1379d5f7e241', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b75addf2f334d7cb584ccae7779d3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117873) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:19:10.409539 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [None req-ac8f4705-67b5-4535-860e-290c29d57ec1 tempest-VolumesActionsTest-1453826651 tempest-VolumesActionsTest-1453826651-project] 10.222.0.43 "GET /compute/v2.1/servers/6b2ba0b0-be2d-4a81-9abd-f7cc17b57602" status: 200 len: 1503 microversion: 2.1 time: 0.156158 Jun 22 10:19:10.410546 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 241/499] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:19:10 2022] GET /compute/v2.1/servers/6b2ba0b0-be2d-4a81-9abd-f7cc17b57602 => generated 1503 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:19:10.597120 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-2bd6247e-7762-4aea-91b8-a09087773d5c tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Calling method '>' {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:19:10.597757 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.compute.api [None req-2bd6247e-7762-4aea-91b8-a09087773d5c tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] [instance: 0b2e66bb-efd5-4ff0-8163-5973db8e0db7] Fetching instance by UUID {{(pid=117874) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:19:10.604734 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-2bd6247e-7762-4aea-91b8-a09087773d5c tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:10.605187 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-2bd6247e-7762-4aea-91b8-a09087773d5c tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:10.605970 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-2bd6247e-7762-4aea-91b8-a09087773d5c tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:10.606405 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-2bd6247e-7762-4aea-91b8-a09087773d5c tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:10.751084 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.policy [None req-2bd6247e-7762-4aea-91b8-a09087773d5c tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7be3d844dcee4d19966fc7944463a0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78629282e2b74418a2c1cdac32576ef1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117874) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:19:10.759019 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [None req-2bd6247e-7762-4aea-91b8-a09087773d5c tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] 10.222.0.43 "GET /compute/v2.1/servers/0b2e66bb-efd5-4ff0-8163-5973db8e0db7" status: 200 len: 1680 microversion: 2.1 time: 0.166379 Jun 22 10:19:10.759590 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 259/500] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:19:10 2022] GET /compute/v2.1/servers/0b2e66bb-efd5-4ff0-8163-5973db8e0db7 => generated 1680 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:19:10.783525 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [req-dc7b0653-19dd-43e5-97d5-75478f7cf677 req-f6f98182-3c1b-40e7-8617-04ae531b443d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6b2ba0b0-be2d-4a81-9abd-f7cc17b57602", "name": "network-vif-deleted", "tag": "d82309d3-6edc-4d2b-ba67-2d5c0226c1fc"}]} {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:19:10.791881 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [req-dc7b0653-19dd-43e5-97d5-75478f7cf677 req-f6f98182-3c1b-40e7-8617-04ae531b443d service nova] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:10.792317 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [req-dc7b0653-19dd-43e5-97d5-75478f7cf677 req-f6f98182-3c1b-40e7-8617-04ae531b443d service nova] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:10.804962 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.compute.server_external_events [req-dc7b0653-19dd-43e5-97d5-75478f7cf677 req-f6f98182-3c1b-40e7-8617-04ae531b443d service nova] Creating event network-vif-deleted:d82309d3-6edc-4d2b-ba67-2d5c0226c1fc for instance 6b2ba0b0-be2d-4a81-9abd-f7cc17b57602 on hv-cinder-84713 Jun 22 10:19:10.810265 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [req-dc7b0653-19dd-43e5-97d5-75478f7cf677 req-f6f98182-3c1b-40e7-8617-04ae531b443d service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031293 Jun 22 10:19:10.810929 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 242/501] 10.222.0.43 () {64 vars in 1317 bytes} [Wed Jun 22 10:19:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 10:19:11.429297 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-85bc4ef3-7ae8-465c-b2d0-aa212f1ddda3 tempest-VolumesActionsTest-1453826651 tempest-VolumesActionsTest-1453826651-project] Calling method '>' {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:19:11.429978 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.compute.api [None req-85bc4ef3-7ae8-465c-b2d0-aa212f1ddda3 tempest-VolumesActionsTest-1453826651 tempest-VolumesActionsTest-1453826651-project] [instance: 6b2ba0b0-be2d-4a81-9abd-f7cc17b57602] Fetching instance by UUID {{(pid=117874) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:19:11.438813 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-85bc4ef3-7ae8-465c-b2d0-aa212f1ddda3 tempest-VolumesActionsTest-1453826651 tempest-VolumesActionsTest-1453826651-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:11.439523 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-85bc4ef3-7ae8-465c-b2d0-aa212f1ddda3 tempest-VolumesActionsTest-1453826651 tempest-VolumesActionsTest-1453826651-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:11.440973 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-85bc4ef3-7ae8-465c-b2d0-aa212f1ddda3 tempest-VolumesActionsTest-1453826651 tempest-VolumesActionsTest-1453826651-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:11.441627 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-85bc4ef3-7ae8-465c-b2d0-aa212f1ddda3 tempest-VolumesActionsTest-1453826651 tempest-VolumesActionsTest-1453826651-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:11.461844 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.wsgi [None req-85bc4ef3-7ae8-465c-b2d0-aa212f1ddda3 tempest-VolumesActionsTest-1453826651 tempest-VolumesActionsTest-1453826651-project] HTTP exception thrown: Instance 6b2ba0b0-be2d-4a81-9abd-f7cc17b57602 could not be found. Jun 22 10:19:11.464385 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-85bc4ef3-7ae8-465c-b2d0-aa212f1ddda3 tempest-VolumesActionsTest-1453826651 tempest-VolumesActionsTest-1453826651-project] Request method failure captured: Jun 22 10:19:11.464385 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: request: GET /compute/v2.1/servers/6b2ba0b0-be2d-4a81-9abd-f7cc17b57602 HTTP/1.1 Jun 22 10:19:11.464385 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: Accept: application/json Jun 22 10:19:11.464385 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: Accept-Encoding: identity Jun 22 10:19:11.464385 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: Connection: close Jun 22 10:19:11.464385 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: Content-Length: 0 Jun 22 10:19:11.464385 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: Content-Type: application/json Jun 22 10:19:11.464385 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: Host: 10.222.0.43 Jun 22 10:19:11.464385 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: Openstack-System-Scope: None Jun 22 10:19:11.464385 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: User-Agent: python-urllib3/1.26.9 Jun 22 10:19:11.464385 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-Auth-Token: gAAAAABisuxlVfrEPuFBAFjfVWtRjaGYmJ--bCDznHtcCeASAV9_4-ELxOAFjzIn37BKLecL9xsozUIYd1oFsZAczxbwKbDvzGTQadzNfNrn_KH50oKaPb3aPeS5JEs_N4ZeQwDvLlsKtrkqWWbOwdGMRGc5Emolvz8xr3XZ_0Ud3L-RpMzqpLQ Jun 22 10:19:11.464385 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-Domain-Id: None Jun 22 10:19:11.464385 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-Domain-Name: None Jun 22 10:19:11.464385 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-Identity-Status: Confirmed Jun 22 10:19:11.464385 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-Is-Admin-Project: True Jun 22 10:19:11.464385 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-Project-Domain-Id: default Jun 22 10:19:11.464385 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-Project-Domain-Name: Default Jun 22 10:19:11.464385 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-Project-Id: 0b75addf2f334d7cb584ccae7779d3f1 Jun 22 10:19:11.464385 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-Project-Name: tempest-VolumesActionsTest-1453826651 Jun 22 10:19:11.464385 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-Role: reader,member Jun 22 10:19:11.464385 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-Roles: reader,member Jun 22 10:19:11.465924 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/0b75addf2f334d7cb584ccae7779d3f1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/0b75addf2f334d7cb584ccae7779d3f1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_0b75addf2f334d7cb584ccae7779d3f1", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/0b75addf2f334d7cb584ccae7779d3f1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}] Jun 22 10:19:11.465924 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-Tenant: tempest-VolumesActionsTest-1453826651 Jun 22 10:19:11.465924 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-Tenant-Id: 0b75addf2f334d7cb584ccae7779d3f1 Jun 22 10:19:11.465924 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-Tenant-Name: tempest-VolumesActionsTest-1453826651 Jun 22 10:19:11.465924 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-User: tempest-VolumesActionsTest-1453826651-project Jun 22 10:19:11.465924 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-User-Domain-Id: default Jun 22 10:19:11.465924 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-User-Domain-Name: Default Jun 22 10:19:11.465924 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-User-Id: f9517119110f4ab99bff1379d5f7e241 Jun 22 10:19:11.465924 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-User-Name: tempest-VolumesActionsTest-1453826651-project Jun 22 10:19:11.465924 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: method: > Jun 22 10:19:11.465924 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: exception: Instance 6b2ba0b0-be2d-4a81-9abd-f7cc17b57602 could not be found. Jun 22 10:19:11.465924 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: action_args: {'id': '6b2ba0b0-be2d-4a81-9abd-f7cc17b57602'} Jun 22 10:19:11.466717 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 10:19:11.466717 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:19:11.466717 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 22 10:19:11.466717 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 22 10:19:11.466717 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 22 10:19:11.466717 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 22 10:19:11.466717 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 22 10:19:11.466717 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 22 10:19:11.466717 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 22 10:19:11.466717 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 22 10:19:11.466717 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6b2ba0b0-be2d-4a81-9abd-f7cc17b57602 could not be found. Jun 22 10:19:11.466717 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi Jun 22 10:19:11.466717 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 10:19:11.466717 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi Jun 22 10:19:11.466717 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:19:11.466717 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 10:19:11.466717 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 10:19:11.466717 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 10:19:11.466717 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 10:19:11.466717 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 10:19:11.468129 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 10:19:11.468129 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 22 10:19:11.468129 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 22 10:19:11.468129 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 22 10:19:11.468129 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 22 10:19:11.468129 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 22 10:19:11.468129 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 22 10:19:11.468129 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6b2ba0b0-be2d-4a81-9abd-f7cc17b57602 could not be found. Jun 22 10:19:11.468129 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi Jun 22 10:19:11.468129 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 10:19:11.468129 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi Jun 22 10:19:11.468129 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:19:11.468129 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 10:19:11.468129 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 10:19:11.468129 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 10:19:11.468129 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 10:19:11.468129 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6b2ba0b0-be2d-4a81-9abd-f7cc17b57602 could not be found. Jun 22 10:19:11.468129 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi Jun 22 10:19:11.470064 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-85bc4ef3-7ae8-465c-b2d0-aa212f1ddda3 tempest-VolumesActionsTest-1453826651 tempest-VolumesActionsTest-1453826651-project] Returning 404 to user: Instance 6b2ba0b0-be2d-4a81-9abd-f7cc17b57602 could not be found. {{(pid=117874) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 10:19:11.470064 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [None req-85bc4ef3-7ae8-465c-b2d0-aa212f1ddda3 tempest-VolumesActionsTest-1453826651 tempest-VolumesActionsTest-1453826651-project] 10.222.0.43 "GET /compute/v2.1/servers/6b2ba0b0-be2d-4a81-9abd-f7cc17b57602" status: 404 len: 111 microversion: 2.1 time: 0.041542 Jun 22 10:19:11.470064 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 260/502] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:19:11 2022] GET /compute/v2.1/servers/6b2ba0b0-be2d-4a81-9abd-f7cc17b57602 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 22 10:19:11.777458 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-b8668d10-7f22-41bb-8bbf-4bb1b3953754 tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Calling method '>' {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:19:11.778843 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.compute.api [None req-b8668d10-7f22-41bb-8bbf-4bb1b3953754 tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] [instance: 0b2e66bb-efd5-4ff0-8163-5973db8e0db7] Fetching instance by UUID {{(pid=117873) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:19:11.786008 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-b8668d10-7f22-41bb-8bbf-4bb1b3953754 tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:11.786907 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-b8668d10-7f22-41bb-8bbf-4bb1b3953754 tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:11.787865 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-b8668d10-7f22-41bb-8bbf-4bb1b3953754 tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:11.789008 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-b8668d10-7f22-41bb-8bbf-4bb1b3953754 tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:11.854352 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-b8668d10-7f22-41bb-8bbf-4bb1b3953754 tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:11.855182 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-b8668d10-7f22-41bb-8bbf-4bb1b3953754 tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:11.855788 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.objects.instance [None req-b8668d10-7f22-41bb-8bbf-4bb1b3953754 tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Lazy-loading 'fault' on Instance uuid 0b2e66bb-efd5-4ff0-8163-5973db8e0db7 {{(pid=117873) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 22 10:19:11.919870 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.policy [None req-b8668d10-7f22-41bb-8bbf-4bb1b3953754 tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7be3d844dcee4d19966fc7944463a0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78629282e2b74418a2c1cdac32576ef1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117873) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:19:11.929287 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [None req-b8668d10-7f22-41bb-8bbf-4bb1b3953754 tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] 10.222.0.43 "GET /compute/v2.1/servers/0b2e66bb-efd5-4ff0-8163-5973db8e0db7" status: 200 len: 1332 microversion: 2.1 time: 0.156353 Jun 22 10:19:11.939655 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 243/503] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:19:11 2022] GET /compute/v2.1/servers/0b2e66bb-efd5-4ff0-8163-5973db8e0db7 => generated 1332 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:19:12.825898 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [req-3cc36bd9-1f76-433b-a806-b1c1a34da2c3 req-7f951c5d-365a-43b6-ae48-47ef9c8c79d9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0b2e66bb-efd5-4ff0-8163-5973db8e0db7", "name": "network-vif-deleted", "tag": "96fa324f-1235-4750-a242-7810d3d32273"}]} {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:19:12.835547 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [req-3cc36bd9-1f76-433b-a806-b1c1a34da2c3 req-7f951c5d-365a-43b6-ae48-47ef9c8c79d9 service nova] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:12.835988 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [req-3cc36bd9-1f76-433b-a806-b1c1a34da2c3 req-7f951c5d-365a-43b6-ae48-47ef9c8c79d9 service nova] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:12.849452 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.compute.server_external_events [req-3cc36bd9-1f76-433b-a806-b1c1a34da2c3 req-7f951c5d-365a-43b6-ae48-47ef9c8c79d9 service nova] Creating event network-vif-deleted:96fa324f-1235-4750-a242-7810d3d32273 for instance 0b2e66bb-efd5-4ff0-8163-5973db8e0db7 on hv-cinder-84713 Jun 22 10:19:12.854884 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [req-3cc36bd9-1f76-433b-a806-b1c1a34da2c3 req-7f951c5d-365a-43b6-ae48-47ef9c8c79d9 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032645 Jun 22 10:19:12.855480 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 261/504] 10.222.0.43 () {64 vars in 1317 bytes} [Wed Jun 22 10:19:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 10:19:12.945931 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-acb17fe6-9250-43c8-aa21-0896b2a4b87e tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Calling method '>' {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:19:12.946546 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.compute.api [None req-acb17fe6-9250-43c8-aa21-0896b2a4b87e tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] [instance: 0b2e66bb-efd5-4ff0-8163-5973db8e0db7] Fetching instance by UUID {{(pid=117873) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:19:12.949056 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG dbcounter [-] [117873] Writing DB stats nova_api:SELECT=89,nova_api:UPDATE=1 {{(pid=117873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:19:12.955873 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-acb17fe6-9250-43c8-aa21-0896b2a4b87e tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:12.956326 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-acb17fe6-9250-43c8-aa21-0896b2a4b87e tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:12.957086 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-acb17fe6-9250-43c8-aa21-0896b2a4b87e tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:12.957515 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-acb17fe6-9250-43c8-aa21-0896b2a4b87e tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:12.972539 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.wsgi [None req-acb17fe6-9250-43c8-aa21-0896b2a4b87e tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] HTTP exception thrown: Instance 0b2e66bb-efd5-4ff0-8163-5973db8e0db7 could not be found. Jun 22 10:19:12.974190 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-acb17fe6-9250-43c8-aa21-0896b2a4b87e tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Request method failure captured: Jun 22 10:19:12.974190 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: request: GET /compute/v2.1/servers/0b2e66bb-efd5-4ff0-8163-5973db8e0db7 HTTP/1.1 Jun 22 10:19:12.974190 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: Accept: application/json Jun 22 10:19:12.974190 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: Accept-Encoding: identity Jun 22 10:19:12.974190 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: Connection: close Jun 22 10:19:12.974190 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: Content-Length: 0 Jun 22 10:19:12.974190 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: Content-Type: application/json Jun 22 10:19:12.974190 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: Host: 10.222.0.43 Jun 22 10:19:12.974190 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: Openstack-System-Scope: None Jun 22 10:19:12.974190 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: User-Agent: python-urllib3/1.26.9 Jun 22 10:19:12.974190 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-Auth-Token: gAAAAABisuvUpGkoSsQ9d1KNFPX834O5Ed4reiDCWeVnTPicJ3T1CXVLNJjI8u1aloRBXjMgN_RPq4rTUmL5P2islljUOvvHIwLebG3DYtPiBpBpjPn3C8o_VLQB3yNvqrLTJBaPVXC7QVZTOTIWPKqjtW_CrQ0ZdCwS1UGZXZ6Doixu1TJW9Cg Jun 22 10:19:12.974190 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-Domain-Id: None Jun 22 10:19:12.974190 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-Domain-Name: None Jun 22 10:19:12.974190 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-Identity-Status: Confirmed Jun 22 10:19:12.974190 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-Is-Admin-Project: True Jun 22 10:19:12.974190 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-Project-Domain-Id: default Jun 22 10:19:12.974190 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-Project-Domain-Name: Default Jun 22 10:19:12.974190 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-Project-Id: 78629282e2b74418a2c1cdac32576ef1 Jun 22 10:19:12.974190 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-Project-Name: tempest-AttachVolumeNegativeTest-73508829 Jun 22 10:19:12.974190 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-Role: reader,member Jun 22 10:19:12.974190 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-Roles: reader,member Jun 22 10:19:12.975496 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/78629282e2b74418a2c1cdac32576ef1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/78629282e2b74418a2c1cdac32576ef1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_78629282e2b74418a2c1cdac32576ef1", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/78629282e2b74418a2c1cdac32576ef1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}] Jun 22 10:19:12.975496 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-Tenant: tempest-AttachVolumeNegativeTest-73508829 Jun 22 10:19:12.975496 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-Tenant-Id: 78629282e2b74418a2c1cdac32576ef1 Jun 22 10:19:12.975496 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-73508829 Jun 22 10:19:12.975496 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-User: tempest-AttachVolumeNegativeTest-73508829-project Jun 22 10:19:12.975496 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-User-Domain-Id: default Jun 22 10:19:12.975496 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-User-Domain-Name: Default Jun 22 10:19:12.975496 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-User-Id: 7be3d844dcee4d19966fc7944463a0bc Jun 22 10:19:12.975496 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-User-Name: tempest-AttachVolumeNegativeTest-73508829-project Jun 22 10:19:12.975496 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: method: > Jun 22 10:19:12.975496 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: exception: Instance 0b2e66bb-efd5-4ff0-8163-5973db8e0db7 could not be found. Jun 22 10:19:12.975496 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: action_args: {'id': '0b2e66bb-efd5-4ff0-8163-5973db8e0db7'} Jun 22 10:19:12.976185 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 10:19:12.976185 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:19:12.976185 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 22 10:19:12.976185 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 22 10:19:12.976185 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 22 10:19:12.976185 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 22 10:19:12.976185 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 22 10:19:12.976185 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 22 10:19:12.976185 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 22 10:19:12.976185 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 22 10:19:12.976185 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0b2e66bb-efd5-4ff0-8163-5973db8e0db7 could not be found. Jun 22 10:19:12.976185 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi Jun 22 10:19:12.976185 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 10:19:12.976185 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi Jun 22 10:19:12.976185 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:19:12.976185 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 10:19:12.976185 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 10:19:12.976185 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 10:19:12.976185 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 10:19:12.976185 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 10:19:12.977457 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 10:19:12.977457 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 22 10:19:12.977457 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 22 10:19:12.977457 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 22 10:19:12.977457 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 22 10:19:12.977457 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 22 10:19:12.977457 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 22 10:19:12.977457 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0b2e66bb-efd5-4ff0-8163-5973db8e0db7 could not be found. Jun 22 10:19:12.977457 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi Jun 22 10:19:12.977457 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 10:19:12.977457 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi Jun 22 10:19:12.977457 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:19:12.977457 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 10:19:12.977457 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 10:19:12.977457 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 10:19:12.977457 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 10:19:12.977457 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0b2e66bb-efd5-4ff0-8163-5973db8e0db7 could not be found. Jun 22 10:19:12.977457 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi Jun 22 10:19:12.979114 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-acb17fe6-9250-43c8-aa21-0896b2a4b87e tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Returning 404 to user: Instance 0b2e66bb-efd5-4ff0-8163-5973db8e0db7 could not be found. {{(pid=117873) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 10:19:12.979114 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [None req-acb17fe6-9250-43c8-aa21-0896b2a4b87e tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] 10.222.0.43 "GET /compute/v2.1/servers/0b2e66bb-efd5-4ff0-8163-5973db8e0db7" status: 404 len: 111 microversion: 2.1 time: 0.033505 Jun 22 10:19:12.979114 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 244/505] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:19:12 2022] GET /compute/v2.1/servers/0b2e66bb-efd5-4ff0-8163-5973db8e0db7 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 22 10:19:12.985147 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-3544b884-868d-4bad-addb-db8f8deb021b tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Calling method '.version_select at 0x7f36bdd3c5e0>' {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:19:13.006895 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [None req-3544b884-868d-4bad-addb-db8f8deb021b tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] 10.222.0.43 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1497354139" status: 202 len: 0 microversion: 2.1 time: 0.025847 Jun 22 10:19:13.007446 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 262/506] 10.222.0.43 () {58 vars in 1220 bytes} [Wed Jun 22 10:19:12 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1497354139 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 22 10:19:13.930721 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-24104067-fd81-441a-85bf-63fd2dc9cd9d tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Calling method '>' {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:19:13.931209 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.compute.api [None req-24104067-fd81-441a-85bf-63fd2dc9cd9d tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] [instance: 5828c9dc-3439-4da7-a94c-f81cbbfdcb99] Fetching instance by UUID {{(pid=117873) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:19:13.937261 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-24104067-fd81-441a-85bf-63fd2dc9cd9d tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:13.937701 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-24104067-fd81-441a-85bf-63fd2dc9cd9d tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:13.939013 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-24104067-fd81-441a-85bf-63fd2dc9cd9d tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:13.939436 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-24104067-fd81-441a-85bf-63fd2dc9cd9d tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:14.062271 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.objects.instance [None req-24104067-fd81-441a-85bf-63fd2dc9cd9d tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Lazy-loading 'services' on Instance uuid 5828c9dc-3439-4da7-a94c-f81cbbfdcb99 {{(pid=117873) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 22 10:19:14.181475 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [None req-24104067-fd81-441a-85bf-63fd2dc9cd9d tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] 10.222.0.43 "DELETE /compute/v2.1/servers/5828c9dc-3439-4da7-a94c-f81cbbfdcb99/os-volume_attachments/8e895d50-268e-428c-a673-cadd98bdb03f" status: 202 len: 0 microversion: 2.1 time: 0.254476 Jun 22 10:19:14.182096 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 245/507] 10.222.0.43 () {58 vars in 1415 bytes} [Wed Jun 22 10:19:13 2022] DELETE /compute/v2.1/servers/5828c9dc-3439-4da7-a94c-f81cbbfdcb99/os-volume_attachments/8e895d50-268e-428c-a673-cadd98bdb03f => generated 0 bytes in 256 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 22 10:19:14.191332 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-90f30b08-86a3-49f1-99e8-6c3a12f0de4a tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Calling method '>' {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:19:14.192410 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.compute.api [None req-90f30b08-86a3-49f1-99e8-6c3a12f0de4a tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] [instance: 5828c9dc-3439-4da7-a94c-f81cbbfdcb99] Fetching instance by UUID {{(pid=117874) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:19:14.199849 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-90f30b08-86a3-49f1-99e8-6c3a12f0de4a tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:14.200432 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-90f30b08-86a3-49f1-99e8-6c3a12f0de4a tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:14.201302 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-90f30b08-86a3-49f1-99e8-6c3a12f0de4a tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:14.202008 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-90f30b08-86a3-49f1-99e8-6c3a12f0de4a tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:14.231909 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [None req-90f30b08-86a3-49f1-99e8-6c3a12f0de4a tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] 10.222.0.43 "GET /compute/v2.1/servers/5828c9dc-3439-4da7-a94c-f81cbbfdcb99/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045258 Jun 22 10:19:14.232475 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 263/508] 10.222.0.43 () {58 vars in 1301 bytes} [Wed Jun 22 10:19:14 2022] GET /compute/v2.1/servers/5828c9dc-3439-4da7-a94c-f81cbbfdcb99/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 10:19:15.245149 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-355f8e2e-fbb7-4408-9b25-ea029600837f tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Calling method '>' {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:19:15.246217 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.compute.api [None req-355f8e2e-fbb7-4408-9b25-ea029600837f tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] [instance: 5828c9dc-3439-4da7-a94c-f81cbbfdcb99] Fetching instance by UUID {{(pid=117873) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:19:15.253168 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-355f8e2e-fbb7-4408-9b25-ea029600837f tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:15.253618 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-355f8e2e-fbb7-4408-9b25-ea029600837f tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:15.254394 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-355f8e2e-fbb7-4408-9b25-ea029600837f tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:15.254831 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-355f8e2e-fbb7-4408-9b25-ea029600837f tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:15.285639 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [None req-355f8e2e-fbb7-4408-9b25-ea029600837f tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] 10.222.0.43 "GET /compute/v2.1/servers/5828c9dc-3439-4da7-a94c-f81cbbfdcb99/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045254 Jun 22 10:19:15.286213 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 246/509] 10.222.0.43 () {58 vars in 1301 bytes} [Wed Jun 22 10:19:15 2022] GET /compute/v2.1/servers/5828c9dc-3439-4da7-a94c-f81cbbfdcb99/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 10:19:16.296698 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-25a7d13d-7a92-4831-8066-1bf7f1350a01 tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Calling method '>' {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:19:16.298995 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.compute.api [None req-25a7d13d-7a92-4831-8066-1bf7f1350a01 tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] [instance: 5828c9dc-3439-4da7-a94c-f81cbbfdcb99] Fetching instance by UUID {{(pid=117874) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:19:16.305337 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-25a7d13d-7a92-4831-8066-1bf7f1350a01 tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:16.305842 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-25a7d13d-7a92-4831-8066-1bf7f1350a01 tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:16.306842 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-25a7d13d-7a92-4831-8066-1bf7f1350a01 tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:16.307393 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-25a7d13d-7a92-4831-8066-1bf7f1350a01 tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:16.338314 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [None req-25a7d13d-7a92-4831-8066-1bf7f1350a01 tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] 10.222.0.43 "GET /compute/v2.1/servers/5828c9dc-3439-4da7-a94c-f81cbbfdcb99/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045544 Jun 22 10:19:16.338877 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 264/510] 10.222.0.43 () {58 vars in 1301 bytes} [Wed Jun 22 10:19:16 2022] GET /compute/v2.1/servers/5828c9dc-3439-4da7-a94c-f81cbbfdcb99/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jun 22 10:19:16.419378 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-89d99f1c-b042-48db-97c3-9419fca07d81 tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Calling method '>' {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:19:16.431322 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.compute.api [None req-89d99f1c-b042-48db-97c3-9419fca07d81 tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] [instance: 5828c9dc-3439-4da7-a94c-f81cbbfdcb99] Fetching instance by UUID {{(pid=117873) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:19:16.439019 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-89d99f1c-b042-48db-97c3-9419fca07d81 tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:16.439472 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-89d99f1c-b042-48db-97c3-9419fca07d81 tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:16.440251 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-89d99f1c-b042-48db-97c3-9419fca07d81 tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:16.440688 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-89d99f1c-b042-48db-97c3-9419fca07d81 tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:16.471993 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.compute.api [None req-89d99f1c-b042-48db-97c3-9419fca07d81 tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] [instance: 5828c9dc-3439-4da7-a94c-f81cbbfdcb99] Going to try to terminate instance {{(pid=117873) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 22 10:19:16.561524 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [None req-89d99f1c-b042-48db-97c3-9419fca07d81 tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] 10.222.0.43 "DELETE /compute/v2.1/servers/5828c9dc-3439-4da7-a94c-f81cbbfdcb99" status: 204 len: 0 microversion: 2.1 time: 0.147406 Jun 22 10:19:16.562644 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 247/511] 10.222.0.43 () {58 vars in 1238 bytes} [Wed Jun 22 10:19:16 2022] DELETE /compute/v2.1/servers/5828c9dc-3439-4da7-a94c-f81cbbfdcb99 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 22 10:19:16.572276 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-83ce44d6-b3b2-4ae1-b35b-bc8756ea9dd4 tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Calling method '>' {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:19:16.572886 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.compute.api [None req-83ce44d6-b3b2-4ae1-b35b-bc8756ea9dd4 tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] [instance: 5828c9dc-3439-4da7-a94c-f81cbbfdcb99] Fetching instance by UUID {{(pid=117874) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:19:16.579640 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-83ce44d6-b3b2-4ae1-b35b-bc8756ea9dd4 tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:16.580088 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-83ce44d6-b3b2-4ae1-b35b-bc8756ea9dd4 tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:16.581076 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-83ce44d6-b3b2-4ae1-b35b-bc8756ea9dd4 tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:16.581518 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-83ce44d6-b3b2-4ae1-b35b-bc8756ea9dd4 tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:16.723401 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.policy [None req-83ce44d6-b3b2-4ae1-b35b-bc8756ea9dd4 tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7be3d844dcee4d19966fc7944463a0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78629282e2b74418a2c1cdac32576ef1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117874) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:19:16.731905 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [None req-83ce44d6-b3b2-4ae1-b35b-bc8756ea9dd4 tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] 10.222.0.43 "GET /compute/v2.1/servers/5828c9dc-3439-4da7-a94c-f81cbbfdcb99" status: 200 len: 1679 microversion: 2.1 time: 0.164444 Jun 22 10:19:16.732472 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 265/512] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:19:16 2022] GET /compute/v2.1/servers/5828c9dc-3439-4da7-a94c-f81cbbfdcb99 => generated 1679 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:19:17.750033 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-5ab9466b-6128-476d-a021-9f729d7c276a tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Calling method '>' {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:19:17.750843 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.compute.api [None req-5ab9466b-6128-476d-a021-9f729d7c276a tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] [instance: 5828c9dc-3439-4da7-a94c-f81cbbfdcb99] Fetching instance by UUID {{(pid=117873) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:19:17.757601 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-5ab9466b-6128-476d-a021-9f729d7c276a tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:17.758139 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-5ab9466b-6128-476d-a021-9f729d7c276a tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:17.758964 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-5ab9466b-6128-476d-a021-9f729d7c276a tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:17.759646 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-5ab9466b-6128-476d-a021-9f729d7c276a tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:17.908725 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.policy [None req-5ab9466b-6128-476d-a021-9f729d7c276a tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7be3d844dcee4d19966fc7944463a0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78629282e2b74418a2c1cdac32576ef1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117873) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:19:17.916838 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [None req-5ab9466b-6128-476d-a021-9f729d7c276a tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] 10.222.0.43 "GET /compute/v2.1/servers/5828c9dc-3439-4da7-a94c-f81cbbfdcb99" status: 200 len: 1679 microversion: 2.1 time: 0.171040 Jun 22 10:19:17.917435 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 248/513] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:19:17 2022] GET /compute/v2.1/servers/5828c9dc-3439-4da7-a94c-f81cbbfdcb99 => generated 1679 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:19:18.934408 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-c6f56fbc-8c0c-4706-98ad-5f5686981d5b tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Calling method '>' {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:19:18.935983 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.compute.api [None req-c6f56fbc-8c0c-4706-98ad-5f5686981d5b tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] [instance: 5828c9dc-3439-4da7-a94c-f81cbbfdcb99] Fetching instance by UUID {{(pid=117874) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:19:18.944295 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-c6f56fbc-8c0c-4706-98ad-5f5686981d5b tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:18.945140 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-c6f56fbc-8c0c-4706-98ad-5f5686981d5b tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:18.946323 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-c6f56fbc-8c0c-4706-98ad-5f5686981d5b tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:18.947002 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-c6f56fbc-8c0c-4706-98ad-5f5686981d5b tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:19.121564 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.policy [None req-c6f56fbc-8c0c-4706-98ad-5f5686981d5b tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7be3d844dcee4d19966fc7944463a0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78629282e2b74418a2c1cdac32576ef1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117874) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:19:19.146607 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [None req-c6f56fbc-8c0c-4706-98ad-5f5686981d5b tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] 10.222.0.43 "GET /compute/v2.1/servers/5828c9dc-3439-4da7-a94c-f81cbbfdcb99" status: 200 len: 1679 microversion: 2.1 time: 0.216204 Jun 22 10:19:19.147188 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 266/514] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:19:18 2022] GET /compute/v2.1/servers/5828c9dc-3439-4da7-a94c-f81cbbfdcb99 => generated 1679 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:19:19.499016 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [req-36b4c3ba-a568-4e56-9009-82edbefa0199 req-d70f9e3c-37a4-4b39-bd92-b48aeed406f8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5828c9dc-3439-4da7-a94c-f81cbbfdcb99", "name": "network-vif-deleted", "tag": "f9ce6858-55e5-4d8b-b5fe-2cff5d9c4f08"}]} {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:19:19.525085 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [req-36b4c3ba-a568-4e56-9009-82edbefa0199 req-d70f9e3c-37a4-4b39-bd92-b48aeed406f8 service nova] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:19.525528 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [req-36b4c3ba-a568-4e56-9009-82edbefa0199 req-d70f9e3c-37a4-4b39-bd92-b48aeed406f8 service nova] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:19.545621 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.compute.server_external_events [req-36b4c3ba-a568-4e56-9009-82edbefa0199 req-d70f9e3c-37a4-4b39-bd92-b48aeed406f8 service nova] Creating event network-vif-deleted:f9ce6858-55e5-4d8b-b5fe-2cff5d9c4f08 for instance 5828c9dc-3439-4da7-a94c-f81cbbfdcb99 on hv-cinder-84713 Jun 22 10:19:19.556554 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [req-36b4c3ba-a568-4e56-9009-82edbefa0199 req-d70f9e3c-37a4-4b39-bd92-b48aeed406f8 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061021 Jun 22 10:19:19.557478 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 249/515] 10.222.0.43 () {64 vars in 1317 bytes} [Wed Jun 22 10:19:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 10:19:20.163904 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-a11b50a5-8c51-49eb-bcca-84b5b67cb2c5 tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Calling method '>' {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:19:20.164702 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.compute.api [None req-a11b50a5-8c51-49eb-bcca-84b5b67cb2c5 tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] [instance: 5828c9dc-3439-4da7-a94c-f81cbbfdcb99] Fetching instance by UUID {{(pid=117874) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:19:20.172438 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-a11b50a5-8c51-49eb-bcca-84b5b67cb2c5 tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:20.173075 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-a11b50a5-8c51-49eb-bcca-84b5b67cb2c5 tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:20.174259 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-a11b50a5-8c51-49eb-bcca-84b5b67cb2c5 tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:20.174901 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-a11b50a5-8c51-49eb-bcca-84b5b67cb2c5 tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:20.190105 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.wsgi [None req-a11b50a5-8c51-49eb-bcca-84b5b67cb2c5 tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] HTTP exception thrown: Instance 5828c9dc-3439-4da7-a94c-f81cbbfdcb99 could not be found. Jun 22 10:19:20.192090 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-a11b50a5-8c51-49eb-bcca-84b5b67cb2c5 tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Request method failure captured: Jun 22 10:19:20.192090 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: request: GET /compute/v2.1/servers/5828c9dc-3439-4da7-a94c-f81cbbfdcb99 HTTP/1.1 Jun 22 10:19:20.192090 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: Accept: application/json Jun 22 10:19:20.192090 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: Accept-Encoding: identity Jun 22 10:19:20.192090 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: Connection: close Jun 22 10:19:20.192090 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: Content-Length: 0 Jun 22 10:19:20.192090 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: Content-Type: application/json Jun 22 10:19:20.192090 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: Host: 10.222.0.43 Jun 22 10:19:20.192090 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: Openstack-System-Scope: None Jun 22 10:19:20.192090 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: User-Agent: python-urllib3/1.26.9 Jun 22 10:19:20.192090 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-Auth-Token: gAAAAABisuvUpGkoSsQ9d1KNFPX834O5Ed4reiDCWeVnTPicJ3T1CXVLNJjI8u1aloRBXjMgN_RPq4rTUmL5P2islljUOvvHIwLebG3DYtPiBpBpjPn3C8o_VLQB3yNvqrLTJBaPVXC7QVZTOTIWPKqjtW_CrQ0ZdCwS1UGZXZ6Doixu1TJW9Cg Jun 22 10:19:20.192090 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-Domain-Id: None Jun 22 10:19:20.192090 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-Domain-Name: None Jun 22 10:19:20.192090 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-Identity-Status: Confirmed Jun 22 10:19:20.192090 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-Is-Admin-Project: True Jun 22 10:19:20.192090 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-Project-Domain-Id: default Jun 22 10:19:20.192090 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-Project-Domain-Name: Default Jun 22 10:19:20.192090 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-Project-Id: 78629282e2b74418a2c1cdac32576ef1 Jun 22 10:19:20.192090 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-Project-Name: tempest-AttachVolumeNegativeTest-73508829 Jun 22 10:19:20.192090 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-Role: reader,member Jun 22 10:19:20.192090 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-Roles: reader,member Jun 22 10:19:20.193732 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/78629282e2b74418a2c1cdac32576ef1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/78629282e2b74418a2c1cdac32576ef1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_78629282e2b74418a2c1cdac32576ef1", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/78629282e2b74418a2c1cdac32576ef1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}] Jun 22 10:19:20.193732 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-Tenant: tempest-AttachVolumeNegativeTest-73508829 Jun 22 10:19:20.193732 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-Tenant-Id: 78629282e2b74418a2c1cdac32576ef1 Jun 22 10:19:20.193732 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-73508829 Jun 22 10:19:20.193732 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-User: tempest-AttachVolumeNegativeTest-73508829-project Jun 22 10:19:20.193732 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-User-Domain-Id: default Jun 22 10:19:20.193732 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-User-Domain-Name: Default Jun 22 10:19:20.193732 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-User-Id: 7be3d844dcee4d19966fc7944463a0bc Jun 22 10:19:20.193732 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-User-Name: tempest-AttachVolumeNegativeTest-73508829-project Jun 22 10:19:20.193732 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: method: > Jun 22 10:19:20.193732 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: exception: Instance 5828c9dc-3439-4da7-a94c-f81cbbfdcb99 could not be found. Jun 22 10:19:20.193732 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: action_args: {'id': '5828c9dc-3439-4da7-a94c-f81cbbfdcb99'} Jun 22 10:19:20.194652 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 10:19:20.194652 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:19:20.194652 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 22 10:19:20.194652 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 22 10:19:20.194652 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 22 10:19:20.194652 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 22 10:19:20.194652 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 22 10:19:20.194652 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 22 10:19:20.194652 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 22 10:19:20.194652 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 22 10:19:20.194652 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5828c9dc-3439-4da7-a94c-f81cbbfdcb99 could not be found. Jun 22 10:19:20.194652 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi Jun 22 10:19:20.194652 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 10:19:20.194652 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi Jun 22 10:19:20.194652 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:19:20.194652 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 10:19:20.194652 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 10:19:20.194652 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 10:19:20.194652 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 10:19:20.194652 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 10:19:20.196391 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 10:19:20.196391 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 22 10:19:20.196391 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 22 10:19:20.196391 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 22 10:19:20.196391 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 22 10:19:20.196391 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 22 10:19:20.196391 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 22 10:19:20.196391 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5828c9dc-3439-4da7-a94c-f81cbbfdcb99 could not be found. Jun 22 10:19:20.196391 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi Jun 22 10:19:20.196391 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 10:19:20.196391 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi Jun 22 10:19:20.196391 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:19:20.196391 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 10:19:20.196391 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 10:19:20.196391 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 10:19:20.196391 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 10:19:20.196391 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5828c9dc-3439-4da7-a94c-f81cbbfdcb99 could not be found. Jun 22 10:19:20.196391 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi Jun 22 10:19:20.198627 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-a11b50a5-8c51-49eb-bcca-84b5b67cb2c5 tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Returning 404 to user: Instance 5828c9dc-3439-4da7-a94c-f81cbbfdcb99 could not be found. {{(pid=117874) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 10:19:20.199664 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [None req-a11b50a5-8c51-49eb-bcca-84b5b67cb2c5 tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] 10.222.0.43 "GET /compute/v2.1/servers/5828c9dc-3439-4da7-a94c-f81cbbfdcb99" status: 404 len: 111 microversion: 2.1 time: 0.039847 Jun 22 10:19:20.200229 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 267/516] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:19:20 2022] GET /compute/v2.1/servers/5828c9dc-3439-4da7-a94c-f81cbbfdcb99 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 22 10:19:20.211054 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-36219177-ea48-4f19-a2cc-6fda4a5cc25c tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Calling method '.version_select at 0x7f36be5dc8b0>' {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:19:20.233550 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [None req-36219177-ea48-4f19-a2cc-6fda4a5cc25c tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] 10.222.0.43 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-817100034" status: 202 len: 0 microversion: 2.1 time: 0.027205 Jun 22 10:19:20.234310 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 250/517] 10.222.0.43 () {58 vars in 1217 bytes} [Wed Jun 22 10:19:20 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-817100034 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 22 10:19:21.099202 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-ad25ad9d-9c68-4288-a0a7-9429b22b0006 tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Action: 'create', calling method: .version_select at 0x7f36bdd59a60>, body: {"keypair": {"name": "tempest-keypair-34517634", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO4XJNK8AXH68HZBlFeigPbSiGFFRnrEKU4WnH9vT+fQlaLeKwU1vkBHWPOG6eWyxGtMWzGN7v3SYHiMC4SBsm+wJbb9qWUj2CEzTxhCRsub33yruS00k858wd7OS2FSzw=="}} {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:19:21.120174 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.quota [None req-ad25ad9d-9c68-4288-a0a7-9429b22b0006 tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Getting quotas for project 78629282e2b74418a2c1cdac32576ef1. Resources: {'key_pairs'} {{(pid=117874) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 22 10:19:21.126566 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.quota [None req-ad25ad9d-9c68-4288-a0a7-9429b22b0006 tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Getting quotas for user 7be3d844dcee4d19966fc7944463a0bc and project 78629282e2b74418a2c1cdac32576ef1. Resources: {'key_pairs'} {{(pid=117874) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 22 10:19:21.151759 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [None req-ad25ad9d-9c68-4288-a0a7-9429b22b0006 tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 200 len: 384 microversion: 2.1 time: 0.059511 Jun 22 10:19:21.152368 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 268/518] 10.222.0.43 () {60 vars in 1158 bytes} [Wed Jun 22 10:19:21 2022] POST /compute/v2.1/os-keypairs => generated 384 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 10:19:22.719800 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-36416b3e-00f7-4d14-9449-b197232987e8 tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1018394028", "imageRef": "22d2c064-5bf7-438e-bbb7-47259e4bdab5", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "8bc94bec-5b18-4b15-a531-8b4a0778b280"}], "security_groups": [{"name": "tempest-securitygroup--235039544"}], "key_name": "tempest-keypair-34517634", "user_data": "}} {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:19:22.832268 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.network.neutron [None req-36416b3e-00f7-4d14-9449-b197232987e8 tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] validate_networks() for [('8bc94bec-5b18-4b15-a531-8b4a0778b280', None, None, None, None, None)] {{(pid=117873) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 22 10:19:23.078861 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-d6f4e0fd-75b5-4a5f-9a14-430f861456f0 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b6734bf6-cc80-4200-81e5-88d794ca04e8"}} {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:19:23.080021 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.compute.api [None req-d6f4e0fd-75b5-4a5f-9a14-430f861456f0 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] [instance: 86a421a6-9b8c-40a9-ab7e-30b74c7bd0f3] Fetching instance by UUID {{(pid=117874) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:19:23.094944 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-d6f4e0fd-75b5-4a5f-9a14-430f861456f0 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:23.095401 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-d6f4e0fd-75b5-4a5f-9a14-430f861456f0 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:23.096196 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-d6f4e0fd-75b5-4a5f-9a14-430f861456f0 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:23.096636 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-d6f4e0fd-75b5-4a5f-9a14-430f861456f0 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:23.369635 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.virt.hardware [None req-36416b3e-00f7-4d14-9449-b197232987e8 tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Flavor limits 0:0:0 {{(pid=117873) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 22 10:19:23.370659 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.virt.hardware [None req-36416b3e-00f7-4d14-9449-b197232987e8 tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Image limits 0:0:0 {{(pid=117873) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 22 10:19:23.371384 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.virt.hardware [None req-36416b3e-00f7-4d14-9449-b197232987e8 tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Flavor pref 0:0:0 {{(pid=117873) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 22 10:19:23.371942 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.virt.hardware [None req-36416b3e-00f7-4d14-9449-b197232987e8 tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Image pref 0:0:0 {{(pid=117873) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 22 10:19:23.372452 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.virt.hardware [None req-36416b3e-00f7-4d14-9449-b197232987e8 tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117873) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 22 10:19:23.384486 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-36416b3e-00f7-4d14-9449-b197232987e8 tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:23.385169 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-36416b3e-00f7-4d14-9449-b197232987e8 tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:23.386166 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-36416b3e-00f7-4d14-9449-b197232987e8 tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:23.386763 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-36416b3e-00f7-4d14-9449-b197232987e8 tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:23.408009 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.quota [None req-36416b3e-00f7-4d14-9449-b197232987e8 tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Getting quotas for project 78629282e2b74418a2c1cdac32576ef1. Resources: {'instances', 'cores', 'ram'} {{(pid=117873) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 22 10:19:23.413052 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.quota [None req-36416b3e-00f7-4d14-9449-b197232987e8 tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Getting quotas for user 7be3d844dcee4d19966fc7944463a0bc and project 78629282e2b74418a2c1cdac32576ef1. Resources: {'instances', 'cores', 'ram'} {{(pid=117873) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 22 10:19:23.426371 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.compute.api [None req-36416b3e-00f7-4d14-9449-b197232987e8 tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Going to run 1 instances... {{(pid=117873) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 22 10:19:23.428724 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.compute.api [None req-36416b3e-00f7-4d14-9449-b197232987e8 tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] [instance: a5d1635b-71e2-4f7c-9fcc-b6d2e9803c09] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='22d2c064-5bf7-438e-bbb7-47259e4bdab5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117873) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 22 10:19:23.490656 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [None req-d6f4e0fd-75b5-4a5f-9a14-430f861456f0 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] 10.222.0.43 "POST /compute/v2.1/servers/86a421a6-9b8c-40a9-ab7e-30b74c7bd0f3/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.415483 Jun 22 10:19:23.491610 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 269/519] 10.222.0.43 () {60 vars in 1322 bytes} [Wed Jun 22 10:19:23 2022] POST /compute/v2.1/servers/86a421a6-9b8c-40a9-ab7e-30b74c7bd0f3/os-volume_attachments => generated 194 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 10:19:23.509157 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [None req-36416b3e-00f7-4d14-9449-b197232987e8 tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.795638 Jun 22 10:19:23.514790 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 251/520] 10.222.0.43 () {60 vars in 1146 bytes} [Wed Jun 22 10:19:22 2022] POST /compute/v2.1/servers => generated 401 bytes in 797 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 22 10:19:23.536247 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-7616d67d-a57c-4c5b-a505-b42b229df805 tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Calling method '>' {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:19:23.540946 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.compute.api [None req-7616d67d-a57c-4c5b-a505-b42b229df805 tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] [instance: a5d1635b-71e2-4f7c-9fcc-b6d2e9803c09] Fetching instance by UUID {{(pid=117874) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:19:23.660565 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.policy [None req-7616d67d-a57c-4c5b-a505-b42b229df805 tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7be3d844dcee4d19966fc7944463a0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78629282e2b74418a2c1cdac32576ef1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117874) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:19:23.667875 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [None req-7616d67d-a57c-4c5b-a505-b42b229df805 tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] 10.222.0.43 "GET /compute/v2.1/servers/a5d1635b-71e2-4f7c-9fcc-b6d2e9803c09" status: 200 len: 1240 microversion: 2.1 time: 0.140975 Jun 22 10:19:23.668605 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 270/521] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:19:23 2022] GET /compute/v2.1/servers/a5d1635b-71e2-4f7c-9fcc-b6d2e9803c09 => generated 1240 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:19:24.687653 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-8dd83afe-fe87-499c-ae05-25d0d0c0b729 tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Calling method '>' {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:19:24.688950 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.compute.api [None req-8dd83afe-fe87-499c-ae05-25d0d0c0b729 tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] [instance: a5d1635b-71e2-4f7c-9fcc-b6d2e9803c09] Fetching instance by UUID {{(pid=117873) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:19:24.700790 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-8dd83afe-fe87-499c-ae05-25d0d0c0b729 tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:24.701562 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-8dd83afe-fe87-499c-ae05-25d0d0c0b729 tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:24.708641 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-8dd83afe-fe87-499c-ae05-25d0d0c0b729 tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:24.709120 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-8dd83afe-fe87-499c-ae05-25d0d0c0b729 tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:24.808781 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.policy [None req-8dd83afe-fe87-499c-ae05-25d0d0c0b729 tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7be3d844dcee4d19966fc7944463a0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78629282e2b74418a2c1cdac32576ef1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117873) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:19:24.819409 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [None req-8dd83afe-fe87-499c-ae05-25d0d0c0b729 tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] 10.222.0.43 "GET /compute/v2.1/servers/a5d1635b-71e2-4f7c-9fcc-b6d2e9803c09" status: 200 len: 1292 microversion: 2.1 time: 0.136723 Jun 22 10:19:24.820899 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 252/522] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:19:24 2022] GET /compute/v2.1/servers/a5d1635b-71e2-4f7c-9fcc-b6d2e9803c09 => generated 1292 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:19:25.836665 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-91b5003a-b1c1-4f71-9be0-85057d304ca5 tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Calling method '>' {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:19:25.837476 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.compute.api [None req-91b5003a-b1c1-4f71-9be0-85057d304ca5 tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] [instance: a5d1635b-71e2-4f7c-9fcc-b6d2e9803c09] Fetching instance by UUID {{(pid=117874) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:19:25.847995 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-91b5003a-b1c1-4f71-9be0-85057d304ca5 tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:25.848795 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-91b5003a-b1c1-4f71-9be0-85057d304ca5 tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:25.849911 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-91b5003a-b1c1-4f71-9be0-85057d304ca5 tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:25.850459 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-91b5003a-b1c1-4f71-9be0-85057d304ca5 tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:26.014024 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.policy [None req-91b5003a-b1c1-4f71-9be0-85057d304ca5 tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7be3d844dcee4d19966fc7944463a0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78629282e2b74418a2c1cdac32576ef1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117874) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:19:26.023977 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [None req-91b5003a-b1c1-4f71-9be0-85057d304ca5 tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] 10.222.0.43 "GET /compute/v2.1/servers/a5d1635b-71e2-4f7c-9fcc-b6d2e9803c09" status: 200 len: 1365 microversion: 2.1 time: 0.190122 Jun 22 10:19:26.038947 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 271/523] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:19:25 2022] GET /compute/v2.1/servers/a5d1635b-71e2-4f7c-9fcc-b6d2e9803c09 => generated 1365 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 10:19:26.466212 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [req-93a044bd-99ab-4986-997d-0731f618c098 req-d064726a-b882-46c0-8ea8-8a6861dc5cc4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a5d1635b-71e2-4f7c-9fcc-b6d2e9803c09", "tag": "ae353570-1e3f-4fc2-8d0b-cfa07619e042"}]} {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:19:26.493091 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [req-93a044bd-99ab-4986-997d-0731f618c098 req-d064726a-b882-46c0-8ea8-8a6861dc5cc4 service nova] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:26.493783 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [req-93a044bd-99ab-4986-997d-0731f618c098 req-d064726a-b882-46c0-8ea8-8a6861dc5cc4 service nova] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:26.507579 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.compute.server_external_events [req-93a044bd-99ab-4986-997d-0731f618c098 req-d064726a-b882-46c0-8ea8-8a6861dc5cc4 service nova] Creating event network-changed:ae353570-1e3f-4fc2-8d0b-cfa07619e042 for instance a5d1635b-71e2-4f7c-9fcc-b6d2e9803c09 on hv-cinder-84713 Jun 22 10:19:26.513655 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [req-93a044bd-99ab-4986-997d-0731f618c098 req-d064726a-b882-46c0-8ea8-8a6861dc5cc4 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054451 Jun 22 10:19:26.514898 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 253/524] 10.222.0.43 () {64 vars in 1317 bytes} [Wed Jun 22 10:19:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 10:19:27.048516 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-65ff6f5e-20aa-4f8f-ab19-add54eb9d9e3 tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Calling method '>' {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:19:27.049111 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.compute.api [None req-65ff6f5e-20aa-4f8f-ab19-add54eb9d9e3 tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] [instance: a5d1635b-71e2-4f7c-9fcc-b6d2e9803c09] Fetching instance by UUID {{(pid=117874) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:19:27.059023 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-65ff6f5e-20aa-4f8f-ab19-add54eb9d9e3 tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:27.059873 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-65ff6f5e-20aa-4f8f-ab19-add54eb9d9e3 tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:27.061144 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-65ff6f5e-20aa-4f8f-ab19-add54eb9d9e3 tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:27.062113 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-65ff6f5e-20aa-4f8f-ab19-add54eb9d9e3 tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:27.212841 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.policy [None req-65ff6f5e-20aa-4f8f-ab19-add54eb9d9e3 tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7be3d844dcee4d19966fc7944463a0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78629282e2b74418a2c1cdac32576ef1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117874) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:19:27.221231 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [None req-65ff6f5e-20aa-4f8f-ab19-add54eb9d9e3 tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] 10.222.0.43 "GET /compute/v2.1/servers/a5d1635b-71e2-4f7c-9fcc-b6d2e9803c09" status: 200 len: 1365 microversion: 2.1 time: 0.178391 Jun 22 10:19:27.222089 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 272/525] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:19:27 2022] GET /compute/v2.1/servers/a5d1635b-71e2-4f7c-9fcc-b6d2e9803c09 => generated 1365 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:19:28.244196 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-17d093d4-9f2a-443f-9826-32a7686026e4 tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Calling method '>' {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:19:28.245664 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.compute.api [None req-17d093d4-9f2a-443f-9826-32a7686026e4 tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] [instance: a5d1635b-71e2-4f7c-9fcc-b6d2e9803c09] Fetching instance by UUID {{(pid=117873) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:19:28.257114 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-17d093d4-9f2a-443f-9826-32a7686026e4 tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:28.258071 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-17d093d4-9f2a-443f-9826-32a7686026e4 tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:28.259115 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-17d093d4-9f2a-443f-9826-32a7686026e4 tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:28.259738 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-17d093d4-9f2a-443f-9826-32a7686026e4 tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:28.456762 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.policy [None req-17d093d4-9f2a-443f-9826-32a7686026e4 tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7be3d844dcee4d19966fc7944463a0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78629282e2b74418a2c1cdac32576ef1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117873) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:19:28.470028 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [None req-17d093d4-9f2a-443f-9826-32a7686026e4 tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] 10.222.0.43 "GET /compute/v2.1/servers/a5d1635b-71e2-4f7c-9fcc-b6d2e9803c09" status: 200 len: 1365 microversion: 2.1 time: 0.235501 Jun 22 10:19:28.480591 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 254/526] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:19:28 2022] GET /compute/v2.1/servers/a5d1635b-71e2-4f7c-9fcc-b6d2e9803c09 => generated 1365 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 10:19:29.488858 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-e86a52c7-3c54-4534-b61b-6ce3772c6f97 tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Calling method '>' {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:19:29.490196 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.compute.api [None req-e86a52c7-3c54-4534-b61b-6ce3772c6f97 tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] [instance: a5d1635b-71e2-4f7c-9fcc-b6d2e9803c09] Fetching instance by UUID {{(pid=117874) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:19:29.502001 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-e86a52c7-3c54-4534-b61b-6ce3772c6f97 tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:29.503507 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-e86a52c7-3c54-4534-b61b-6ce3772c6f97 tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:29.505178 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-e86a52c7-3c54-4534-b61b-6ce3772c6f97 tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:29.505842 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-e86a52c7-3c54-4534-b61b-6ce3772c6f97 tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:29.670758 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.policy [None req-e86a52c7-3c54-4534-b61b-6ce3772c6f97 tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7be3d844dcee4d19966fc7944463a0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78629282e2b74418a2c1cdac32576ef1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117874) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:19:29.681210 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [None req-e86a52c7-3c54-4534-b61b-6ce3772c6f97 tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] 10.222.0.43 "GET /compute/v2.1/servers/a5d1635b-71e2-4f7c-9fcc-b6d2e9803c09" status: 200 len: 1365 microversion: 2.1 time: 0.196610 Jun 22 10:19:29.694110 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 273/527] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:19:29 2022] GET /compute/v2.1/servers/a5d1635b-71e2-4f7c-9fcc-b6d2e9803c09 => generated 1365 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:19:30.700543 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-197f6e98-3e3b-4756-9e5e-3c471df21d17 tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Calling method '>' {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:19:30.701308 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.compute.api [None req-197f6e98-3e3b-4756-9e5e-3c471df21d17 tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] [instance: a5d1635b-71e2-4f7c-9fcc-b6d2e9803c09] Fetching instance by UUID {{(pid=117873) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:19:30.711575 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-197f6e98-3e3b-4756-9e5e-3c471df21d17 tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:30.712727 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-197f6e98-3e3b-4756-9e5e-3c471df21d17 tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:30.713390 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-197f6e98-3e3b-4756-9e5e-3c471df21d17 tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:30.714133 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-197f6e98-3e3b-4756-9e5e-3c471df21d17 tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:30.874814 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.policy [None req-197f6e98-3e3b-4756-9e5e-3c471df21d17 tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7be3d844dcee4d19966fc7944463a0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78629282e2b74418a2c1cdac32576ef1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117873) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:19:30.884621 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [None req-197f6e98-3e3b-4756-9e5e-3c471df21d17 tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] 10.222.0.43 "GET /compute/v2.1/servers/a5d1635b-71e2-4f7c-9fcc-b6d2e9803c09" status: 200 len: 1365 microversion: 2.1 time: 0.187940 Jun 22 10:19:30.885732 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 255/528] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:19:30 2022] GET /compute/v2.1/servers/a5d1635b-71e2-4f7c-9fcc-b6d2e9803c09 => generated 1365 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:19:31.168051 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-d0a17279-ef34-42e0-8803-ca6dcbcc581f tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:19:31.171101 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.compute.api [None req-d0a17279-ef34-42e0-8803-ca6dcbcc581f tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] [instance: 86a421a6-9b8c-40a9-ab7e-30b74c7bd0f3] Fetching instance by UUID {{(pid=117874) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:19:31.182570 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-d0a17279-ef34-42e0-8803-ca6dcbcc581f tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:31.183747 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-d0a17279-ef34-42e0-8803-ca6dcbcc581f tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:31.185332 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-d0a17279-ef34-42e0-8803-ca6dcbcc581f tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:31.186080 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-d0a17279-ef34-42e0-8803-ca6dcbcc581f tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:31.221575 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.objects.instance [None req-d0a17279-ef34-42e0-8803-ca6dcbcc581f tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lazy-loading 'flavor' on Instance uuid 86a421a6-9b8c-40a9-ab7e-30b74c7bd0f3 {{(pid=117874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 22 10:19:31.354810 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [req-2d4032b9-df89-4706-af6a-d8ad86f421a5 req-8d6ee263-28c7-451e-b8f0-905c1de2dd91 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a5d1635b-71e2-4f7c-9fcc-b6d2e9803c09", "name": "network-vif-plugged", "status": "completed", "tag": "ae353570-1e3f-4fc2-8d0b-cfa07619e042"}]} {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:19:31.367523 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [req-2d4032b9-df89-4706-af6a-d8ad86f421a5 req-8d6ee263-28c7-451e-b8f0-905c1de2dd91 service nova] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:31.372107 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [req-2d4032b9-df89-4706-af6a-d8ad86f421a5 req-8d6ee263-28c7-451e-b8f0-905c1de2dd91 service nova] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:31.401508 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.compute.server_external_events [req-2d4032b9-df89-4706-af6a-d8ad86f421a5 req-8d6ee263-28c7-451e-b8f0-905c1de2dd91 service nova] Creating event network-vif-plugged:ae353570-1e3f-4fc2-8d0b-cfa07619e042 for instance a5d1635b-71e2-4f7c-9fcc-b6d2e9803c09 on hv-cinder-84713 Jun 22 10:19:31.433927 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [req-2d4032b9-df89-4706-af6a-d8ad86f421a5 req-8d6ee263-28c7-451e-b8f0-905c1de2dd91 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060709 Jun 22 10:19:31.437928 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 256/529] 10.222.0.43 () {64 vars in 1317 bytes} [Wed Jun 22 10:19:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 10:19:31.445760 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [None req-d0a17279-ef34-42e0-8803-ca6dcbcc581f tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] 10.222.0.43 "POST /compute/v2.1/servers/86a421a6-9b8c-40a9-ab7e-30b74c7bd0f3/action" status: 200 len: 32 microversion: 2.1 time: 0.281519 Jun 22 10:19:31.465907 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 274/530] 10.222.0.43 () {60 vars in 1277 bytes} [Wed Jun 22 10:19:31 2022] POST /compute/v2.1/servers/86a421a6-9b8c-40a9-ab7e-30b74c7bd0f3/action => generated 32 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 22 10:19:31.467855 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-269d158d-7b04-4211-a2b4-7318b3ac9331 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Calling method '>' {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:19:31.477640 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.compute.api [None req-269d158d-7b04-4211-a2b4-7318b3ac9331 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] [instance: 86a421a6-9b8c-40a9-ab7e-30b74c7bd0f3] Fetching instance by UUID {{(pid=117873) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:19:31.491521 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-269d158d-7b04-4211-a2b4-7318b3ac9331 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:31.491965 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-269d158d-7b04-4211-a2b4-7318b3ac9331 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:31.492739 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-269d158d-7b04-4211-a2b4-7318b3ac9331 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:31.493222 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-269d158d-7b04-4211-a2b4-7318b3ac9331 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:31.881914 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.policy [None req-269d158d-7b04-4211-a2b4-7318b3ac9331 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d7292401816437fba46d073c4746e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3277b9cbc4b4a8bbacee8440cea1ed2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117873) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:19:31.891539 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [None req-269d158d-7b04-4211-a2b4-7318b3ac9331 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] 10.222.0.43 "GET /compute/v2.1/servers/86a421a6-9b8c-40a9-ab7e-30b74c7bd0f3" status: 200 len: 1737 microversion: 2.1 time: 0.434454 Jun 22 10:19:31.893356 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 257/531] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:19:31 2022] GET /compute/v2.1/servers/86a421a6-9b8c-40a9-ab7e-30b74c7bd0f3 => generated 1737 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:19:31.903750 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-b55dafac-85ab-43d9-acb5-58fb9ebdcb87 tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Calling method '>' {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:19:31.905997 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.compute.api [None req-b55dafac-85ab-43d9-acb5-58fb9ebdcb87 tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] [instance: a5d1635b-71e2-4f7c-9fcc-b6d2e9803c09] Fetching instance by UUID {{(pid=117874) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:19:31.915152 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-b55dafac-85ab-43d9-acb5-58fb9ebdcb87 tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:31.915734 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-b55dafac-85ab-43d9-acb5-58fb9ebdcb87 tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:31.916590 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-b55dafac-85ab-43d9-acb5-58fb9ebdcb87 tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:31.917107 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-b55dafac-85ab-43d9-acb5-58fb9ebdcb87 tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:32.066791 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.policy [None req-b55dafac-85ab-43d9-acb5-58fb9ebdcb87 tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7be3d844dcee4d19966fc7944463a0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78629282e2b74418a2c1cdac32576ef1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117874) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:19:32.074337 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [None req-b55dafac-85ab-43d9-acb5-58fb9ebdcb87 tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] 10.222.0.43 "GET /compute/v2.1/servers/a5d1635b-71e2-4f7c-9fcc-b6d2e9803c09" status: 200 len: 1365 microversion: 2.1 time: 0.174806 Jun 22 10:19:32.074839 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 275/532] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:19:31 2022] GET /compute/v2.1/servers/a5d1635b-71e2-4f7c-9fcc-b6d2e9803c09 => generated 1365 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:19:32.911592 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-a7f121dc-26ad-47e7-a427-f23c013da380 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Calling method '>' {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:19:32.912194 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.compute.api [None req-a7f121dc-26ad-47e7-a427-f23c013da380 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] [instance: 86a421a6-9b8c-40a9-ab7e-30b74c7bd0f3] Fetching instance by UUID {{(pid=117873) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:19:32.918784 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-a7f121dc-26ad-47e7-a427-f23c013da380 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:32.919221 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-a7f121dc-26ad-47e7-a427-f23c013da380 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:32.919975 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-a7f121dc-26ad-47e7-a427-f23c013da380 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:32.920484 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-a7f121dc-26ad-47e7-a427-f23c013da380 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:33.050118 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.policy [None req-a7f121dc-26ad-47e7-a427-f23c013da380 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d7292401816437fba46d073c4746e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3277b9cbc4b4a8bbacee8440cea1ed2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117873) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:19:33.057957 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [None req-a7f121dc-26ad-47e7-a427-f23c013da380 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] 10.222.0.43 "GET /compute/v2.1/servers/86a421a6-9b8c-40a9-ab7e-30b74c7bd0f3" status: 200 len: 1737 microversion: 2.1 time: 0.151819 Jun 22 10:19:33.058510 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 258/533] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:19:32 2022] GET /compute/v2.1/servers/86a421a6-9b8c-40a9-ab7e-30b74c7bd0f3 => generated 1737 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:19:33.090853 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-19d69f5b-339b-4ad2-a81a-5703855fa5a9 tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Calling method '>' {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:19:33.091516 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.compute.api [None req-19d69f5b-339b-4ad2-a81a-5703855fa5a9 tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] [instance: a5d1635b-71e2-4f7c-9fcc-b6d2e9803c09] Fetching instance by UUID {{(pid=117874) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:19:33.098739 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-19d69f5b-339b-4ad2-a81a-5703855fa5a9 tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:33.099166 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-19d69f5b-339b-4ad2-a81a-5703855fa5a9 tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:33.100212 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-19d69f5b-339b-4ad2-a81a-5703855fa5a9 tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:33.100399 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-19d69f5b-339b-4ad2-a81a-5703855fa5a9 tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:33.104966 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG dbcounter [-] [117874] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=117874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:19:33.231894 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.policy [None req-19d69f5b-339b-4ad2-a81a-5703855fa5a9 tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7be3d844dcee4d19966fc7944463a0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78629282e2b74418a2c1cdac32576ef1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117874) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:19:33.239456 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [None req-19d69f5b-339b-4ad2-a81a-5703855fa5a9 tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] 10.222.0.43 "GET /compute/v2.1/servers/a5d1635b-71e2-4f7c-9fcc-b6d2e9803c09" status: 200 len: 1365 microversion: 2.1 time: 0.152417 Jun 22 10:19:33.240015 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 276/534] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:19:33 2022] GET /compute/v2.1/servers/a5d1635b-71e2-4f7c-9fcc-b6d2e9803c09 => generated 1365 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:19:34.074463 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-75b28437-f1f5-422b-9508-c8b57471eeee tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Calling method '>' {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:19:34.075041 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.compute.api [None req-75b28437-f1f5-422b-9508-c8b57471eeee tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] [instance: 86a421a6-9b8c-40a9-ab7e-30b74c7bd0f3] Fetching instance by UUID {{(pid=117873) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:19:34.076984 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG dbcounter [-] [117873] Writing DB stats nova_cell0:SELECT=2 {{(pid=117873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:19:34.077632 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG dbcounter [-] [117873] Writing DB stats nova_cell0:SELECT=6 {{(pid=117873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:19:34.084471 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-75b28437-f1f5-422b-9508-c8b57471eeee tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:34.084910 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-75b28437-f1f5-422b-9508-c8b57471eeee tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:34.085659 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-75b28437-f1f5-422b-9508-c8b57471eeee tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:34.086125 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-75b28437-f1f5-422b-9508-c8b57471eeee tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:34.232093 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.policy [None req-75b28437-f1f5-422b-9508-c8b57471eeee tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d7292401816437fba46d073c4746e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3277b9cbc4b4a8bbacee8440cea1ed2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117873) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:19:34.241020 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [None req-75b28437-f1f5-422b-9508-c8b57471eeee tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] 10.222.0.43 "GET /compute/v2.1/servers/86a421a6-9b8c-40a9-ab7e-30b74c7bd0f3" status: 200 len: 1737 microversion: 2.1 time: 0.170318 Jun 22 10:19:34.241595 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 259/535] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:19:34 2022] GET /compute/v2.1/servers/86a421a6-9b8c-40a9-ab7e-30b74c7bd0f3 => generated 1737 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:19:34.255190 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-d207bd0d-e1a1-4290-9c3a-50b2406d5cea tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Calling method '>' {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:19:34.255722 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.compute.api [None req-d207bd0d-e1a1-4290-9c3a-50b2406d5cea tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] [instance: a5d1635b-71e2-4f7c-9fcc-b6d2e9803c09] Fetching instance by UUID {{(pid=117874) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:19:34.257721 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG dbcounter [-] [117874] Writing DB stats nova_cell0:SELECT=6 {{(pid=117874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:19:34.264463 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-d207bd0d-e1a1-4290-9c3a-50b2406d5cea tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:34.264903 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-d207bd0d-e1a1-4290-9c3a-50b2406d5cea tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:34.265653 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-d207bd0d-e1a1-4290-9c3a-50b2406d5cea tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:34.266281 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-d207bd0d-e1a1-4290-9c3a-50b2406d5cea tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:34.404211 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.policy [None req-d207bd0d-e1a1-4290-9c3a-50b2406d5cea tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7be3d844dcee4d19966fc7944463a0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78629282e2b74418a2c1cdac32576ef1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117874) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:19:34.413001 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [None req-d207bd0d-e1a1-4290-9c3a-50b2406d5cea tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] 10.222.0.43 "GET /compute/v2.1/servers/a5d1635b-71e2-4f7c-9fcc-b6d2e9803c09" status: 200 len: 1554 microversion: 2.1 time: 0.161720 Jun 22 10:19:34.413590 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 277/536] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:19:34 2022] GET /compute/v2.1/servers/a5d1635b-71e2-4f7c-9fcc-b6d2e9803c09 => generated 1554 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:19:34.429240 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-fda91fa3-c93f-4b87-9d5d-0bdbaae2680d tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Calling method '>' {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:19:34.429742 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.compute.api [None req-fda91fa3-c93f-4b87-9d5d-0bdbaae2680d tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] [instance: a5d1635b-71e2-4f7c-9fcc-b6d2e9803c09] Fetching instance by UUID {{(pid=117873) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:19:34.435570 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-fda91fa3-c93f-4b87-9d5d-0bdbaae2680d tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:34.436194 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-fda91fa3-c93f-4b87-9d5d-0bdbaae2680d tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:34.436942 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-fda91fa3-c93f-4b87-9d5d-0bdbaae2680d tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:34.437369 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-fda91fa3-c93f-4b87-9d5d-0bdbaae2680d tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:34.440975 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG dbcounter [-] [117873] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=117873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:19:34.518183 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [None req-fda91fa3-c93f-4b87-9d5d-0bdbaae2680d tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] 10.222.0.43 "GET /compute/v2.1/servers/a5d1635b-71e2-4f7c-9fcc-b6d2e9803c09/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.091640 Jun 22 10:19:34.518449 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 260/537] 10.222.0.43 () {58 vars in 1274 bytes} [Wed Jun 22 10:19:34 2022] GET /compute/v2.1/servers/a5d1635b-71e2-4f7c-9fcc-b6d2e9803c09/os-interface => generated 284 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 10:19:35.259586 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-ab3df875-7388-439a-aca4-d375f79587b3 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Calling method '>' {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:19:35.260199 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.compute.api [None req-ab3df875-7388-439a-aca4-d375f79587b3 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] [instance: 86a421a6-9b8c-40a9-ab7e-30b74c7bd0f3] Fetching instance by UUID {{(pid=117874) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:19:35.267670 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-ab3df875-7388-439a-aca4-d375f79587b3 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:35.268125 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-ab3df875-7388-439a-aca4-d375f79587b3 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:35.268909 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-ab3df875-7388-439a-aca4-d375f79587b3 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:35.269343 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-ab3df875-7388-439a-aca4-d375f79587b3 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:35.457720 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.policy [None req-ab3df875-7388-439a-aca4-d375f79587b3 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d7292401816437fba46d073c4746e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3277b9cbc4b4a8bbacee8440cea1ed2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117874) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:19:35.466481 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [None req-ab3df875-7388-439a-aca4-d375f79587b3 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] 10.222.0.43 "GET /compute/v2.1/servers/86a421a6-9b8c-40a9-ab7e-30b74c7bd0f3" status: 200 len: 1737 microversion: 2.1 time: 0.211332 Jun 22 10:19:35.479805 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 278/538] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:19:35 2022] GET /compute/v2.1/servers/86a421a6-9b8c-40a9-ab7e-30b74c7bd0f3 => generated 1737 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 10:19:35.574803 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [req-277409a5-6421-4e7c-b379-5a482d75c86b req-a6bc97ca-ff73-4266-8d75-20776c12ea21 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a5d1635b-71e2-4f7c-9fcc-b6d2e9803c09", "tag": "ae353570-1e3f-4fc2-8d0b-cfa07619e042"}]} {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:19:35.583545 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [req-277409a5-6421-4e7c-b379-5a482d75c86b req-a6bc97ca-ff73-4266-8d75-20776c12ea21 service nova] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:35.584104 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [req-277409a5-6421-4e7c-b379-5a482d75c86b req-a6bc97ca-ff73-4266-8d75-20776c12ea21 service nova] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:35.596874 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.compute.server_external_events [req-277409a5-6421-4e7c-b379-5a482d75c86b req-a6bc97ca-ff73-4266-8d75-20776c12ea21 service nova] Creating event network-changed:ae353570-1e3f-4fc2-8d0b-cfa07619e042 for instance a5d1635b-71e2-4f7c-9fcc-b6d2e9803c09 on hv-cinder-84713 Jun 22 10:19:35.602163 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [req-277409a5-6421-4e7c-b379-5a482d75c86b req-a6bc97ca-ff73-4266-8d75-20776c12ea21 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031484 Jun 22 10:19:35.603416 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 261/539] 10.222.0.43 () {64 vars in 1317 bytes} [Wed Jun 22 10:19:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 10:19:36.486342 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-346f9cfd-0fa3-47f5-b046-d4843585a059 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Calling method '>' {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:19:36.487975 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.compute.api [None req-346f9cfd-0fa3-47f5-b046-d4843585a059 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] [instance: 86a421a6-9b8c-40a9-ab7e-30b74c7bd0f3] Fetching instance by UUID {{(pid=117874) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:19:36.497233 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-346f9cfd-0fa3-47f5-b046-d4843585a059 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:36.497837 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-346f9cfd-0fa3-47f5-b046-d4843585a059 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:36.498926 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-346f9cfd-0fa3-47f5-b046-d4843585a059 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:36.500275 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-346f9cfd-0fa3-47f5-b046-d4843585a059 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:36.731243 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.policy [None req-346f9cfd-0fa3-47f5-b046-d4843585a059 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d7292401816437fba46d073c4746e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3277b9cbc4b4a8bbacee8440cea1ed2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117874) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:19:36.740870 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [None req-346f9cfd-0fa3-47f5-b046-d4843585a059 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] 10.222.0.43 "GET /compute/v2.1/servers/86a421a6-9b8c-40a9-ab7e-30b74c7bd0f3" status: 200 len: 1737 microversion: 2.1 time: 0.259853 Jun 22 10:19:36.750643 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 279/540] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:19:36 2022] GET /compute/v2.1/servers/86a421a6-9b8c-40a9-ab7e-30b74c7bd0f3 => generated 1737 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:19:37.759154 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-0ff47717-896c-40bc-b7c5-bda745bc649d tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Calling method '>' {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:19:37.760449 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.compute.api [None req-0ff47717-896c-40bc-b7c5-bda745bc649d tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] [instance: 86a421a6-9b8c-40a9-ab7e-30b74c7bd0f3] Fetching instance by UUID {{(pid=117873) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:19:37.766788 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-0ff47717-896c-40bc-b7c5-bda745bc649d tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:37.767873 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-0ff47717-896c-40bc-b7c5-bda745bc649d tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:37.768847 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-0ff47717-896c-40bc-b7c5-bda745bc649d tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:37.769272 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-0ff47717-896c-40bc-b7c5-bda745bc649d tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:38.003820 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.policy [None req-0ff47717-896c-40bc-b7c5-bda745bc649d tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d7292401816437fba46d073c4746e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3277b9cbc4b4a8bbacee8440cea1ed2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117873) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:19:38.012557 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [None req-0ff47717-896c-40bc-b7c5-bda745bc649d tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] 10.222.0.43 "GET /compute/v2.1/servers/86a421a6-9b8c-40a9-ab7e-30b74c7bd0f3" status: 200 len: 1737 microversion: 2.1 time: 0.257971 Jun 22 10:19:38.013815 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 262/541] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:19:37 2022] GET /compute/v2.1/servers/86a421a6-9b8c-40a9-ab7e-30b74c7bd0f3 => generated 1737 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:19:39.036734 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-d98ccca3-fcdb-4d12-bd59-982ec0946862 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Calling method '>' {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:19:39.038448 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.compute.api [None req-d98ccca3-fcdb-4d12-bd59-982ec0946862 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] [instance: 86a421a6-9b8c-40a9-ab7e-30b74c7bd0f3] Fetching instance by UUID {{(pid=117874) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:19:39.047495 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG dbcounter [-] [117874] Writing DB stats nova_api:SELECT=66,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=117874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:19:39.050114 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-d98ccca3-fcdb-4d12-bd59-982ec0946862 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:39.051152 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-d98ccca3-fcdb-4d12-bd59-982ec0946862 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:39.052325 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-d98ccca3-fcdb-4d12-bd59-982ec0946862 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:39.052858 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-d98ccca3-fcdb-4d12-bd59-982ec0946862 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:39.318869 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.policy [None req-d98ccca3-fcdb-4d12-bd59-982ec0946862 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d7292401816437fba46d073c4746e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3277b9cbc4b4a8bbacee8440cea1ed2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117874) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:19:39.333010 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [None req-d98ccca3-fcdb-4d12-bd59-982ec0946862 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] 10.222.0.43 "GET /compute/v2.1/servers/86a421a6-9b8c-40a9-ab7e-30b74c7bd0f3" status: 200 len: 1737 microversion: 2.1 time: 0.305459 Jun 22 10:19:39.342965 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 280/542] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:19:39 2022] GET /compute/v2.1/servers/86a421a6-9b8c-40a9-ab7e-30b74c7bd0f3 => generated 1737 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:19:40.350688 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-5014a461-75f1-4947-9f2d-a4fa47e6ec2f tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Calling method '>' {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:19:40.351308 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.compute.api [None req-5014a461-75f1-4947-9f2d-a4fa47e6ec2f tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] [instance: 86a421a6-9b8c-40a9-ab7e-30b74c7bd0f3] Fetching instance by UUID {{(pid=117873) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:19:40.358122 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-5014a461-75f1-4947-9f2d-a4fa47e6ec2f tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:40.358799 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-5014a461-75f1-4947-9f2d-a4fa47e6ec2f tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:40.359731 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-5014a461-75f1-4947-9f2d-a4fa47e6ec2f tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:40.361055 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-5014a461-75f1-4947-9f2d-a4fa47e6ec2f tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:40.627239 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.policy [None req-5014a461-75f1-4947-9f2d-a4fa47e6ec2f tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d7292401816437fba46d073c4746e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3277b9cbc4b4a8bbacee8440cea1ed2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117873) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:19:40.635631 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [None req-5014a461-75f1-4947-9f2d-a4fa47e6ec2f tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] 10.222.0.43 "GET /compute/v2.1/servers/86a421a6-9b8c-40a9-ab7e-30b74c7bd0f3" status: 200 len: 1737 microversion: 2.1 time: 0.289127 Jun 22 10:19:40.636885 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 263/543] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:19:40 2022] GET /compute/v2.1/servers/86a421a6-9b8c-40a9-ab7e-30b74c7bd0f3 => generated 1737 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:19:41.653442 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-1ccdfd28-43b6-45e2-b040-0394da0eda10 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Calling method '>' {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:19:41.654194 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.compute.api [None req-1ccdfd28-43b6-45e2-b040-0394da0eda10 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] [instance: 86a421a6-9b8c-40a9-ab7e-30b74c7bd0f3] Fetching instance by UUID {{(pid=117874) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:19:41.662020 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-1ccdfd28-43b6-45e2-b040-0394da0eda10 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:41.662681 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-1ccdfd28-43b6-45e2-b040-0394da0eda10 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:41.663669 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-1ccdfd28-43b6-45e2-b040-0394da0eda10 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:41.664276 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-1ccdfd28-43b6-45e2-b040-0394da0eda10 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:41.905183 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.policy [None req-1ccdfd28-43b6-45e2-b040-0394da0eda10 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d7292401816437fba46d073c4746e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3277b9cbc4b4a8bbacee8440cea1ed2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117874) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:19:41.919594 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [None req-1ccdfd28-43b6-45e2-b040-0394da0eda10 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] 10.222.0.43 "GET /compute/v2.1/servers/86a421a6-9b8c-40a9-ab7e-30b74c7bd0f3" status: 200 len: 1737 microversion: 2.1 time: 0.268978 Jun 22 10:19:41.932442 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 281/544] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:19:41 2022] GET /compute/v2.1/servers/86a421a6-9b8c-40a9-ab7e-30b74c7bd0f3 => generated 1737 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:19:42.940518 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-dd79e8ca-dc33-4aab-9097-d929a5369d3f tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Calling method '>' {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:19:42.941317 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.compute.api [None req-dd79e8ca-dc33-4aab-9097-d929a5369d3f tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] [instance: 86a421a6-9b8c-40a9-ab7e-30b74c7bd0f3] Fetching instance by UUID {{(pid=117873) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:19:42.949226 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-dd79e8ca-dc33-4aab-9097-d929a5369d3f tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:42.949226 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-dd79e8ca-dc33-4aab-9097-d929a5369d3f tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:42.950695 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-dd79e8ca-dc33-4aab-9097-d929a5369d3f tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:42.951103 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-dd79e8ca-dc33-4aab-9097-d929a5369d3f tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:43.005777 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-28d95523-d1c9-4474-93a0-111aa613c441 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Calling method '>' {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:19:43.006342 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.compute.api [None req-28d95523-d1c9-4474-93a0-111aa613c441 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] [instance: eb851ab6-0e89-41d2-be52-d76cdc8644d6] Fetching instance by UUID {{(pid=117874) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:19:43.022358 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-28d95523-d1c9-4474-93a0-111aa613c441 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:43.022880 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-28d95523-d1c9-4474-93a0-111aa613c441 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:43.023766 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-28d95523-d1c9-4474-93a0-111aa613c441 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:43.024325 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-28d95523-d1c9-4474-93a0-111aa613c441 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:43.328564 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.objects.instance [None req-28d95523-d1c9-4474-93a0-111aa613c441 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Lazy-loading 'services' on Instance uuid eb851ab6-0e89-41d2-be52-d76cdc8644d6 {{(pid=117874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 22 10:19:43.434631 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.policy [None req-dd79e8ca-dc33-4aab-9097-d929a5369d3f tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d7292401816437fba46d073c4746e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3277b9cbc4b4a8bbacee8440cea1ed2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117873) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:19:43.455489 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [None req-dd79e8ca-dc33-4aab-9097-d929a5369d3f tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] 10.222.0.43 "GET /compute/v2.1/servers/86a421a6-9b8c-40a9-ab7e-30b74c7bd0f3" status: 200 len: 1737 microversion: 2.1 time: 0.519792 Jun 22 10:19:43.458574 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 264/545] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:19:42 2022] GET /compute/v2.1/servers/86a421a6-9b8c-40a9-ab7e-30b74c7bd0f3 => generated 1737 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:19:43.513885 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [None req-28d95523-d1c9-4474-93a0-111aa613c441 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] 10.222.0.43 "DELETE /compute/v2.1/servers/eb851ab6-0e89-41d2-be52-d76cdc8644d6/os-volume_attachments/eca82687-7d3f-41fa-9ae2-fb95a95357e8" status: 202 len: 0 microversion: 2.1 time: 0.513488 Jun 22 10:19:43.515168 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 282/546] 10.222.0.43 () {58 vars in 1415 bytes} [Wed Jun 22 10:19:42 2022] DELETE /compute/v2.1/servers/eb851ab6-0e89-41d2-be52-d76cdc8644d6/os-volume_attachments/eca82687-7d3f-41fa-9ae2-fb95a95357e8 => generated 0 bytes in 516 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 22 10:19:44.478238 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-acaadfed-d398-4fbf-8622-b25daa999ff1 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Calling method '>' {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:19:44.479576 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.compute.api [None req-acaadfed-d398-4fbf-8622-b25daa999ff1 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] [instance: 86a421a6-9b8c-40a9-ab7e-30b74c7bd0f3] Fetching instance by UUID {{(pid=117873) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:19:44.483561 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG dbcounter [-] [117873] Writing DB stats nova_api:SELECT=61,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=117873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:19:44.494813 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-acaadfed-d398-4fbf-8622-b25daa999ff1 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:44.502466 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-acaadfed-d398-4fbf-8622-b25daa999ff1 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:44.503657 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-acaadfed-d398-4fbf-8622-b25daa999ff1 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:44.505660 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-acaadfed-d398-4fbf-8622-b25daa999ff1 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:44.733294 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.policy [None req-acaadfed-d398-4fbf-8622-b25daa999ff1 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d7292401816437fba46d073c4746e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3277b9cbc4b4a8bbacee8440cea1ed2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117873) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:19:44.752569 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [None req-acaadfed-d398-4fbf-8622-b25daa999ff1 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] 10.222.0.43 "GET /compute/v2.1/servers/86a421a6-9b8c-40a9-ab7e-30b74c7bd0f3" status: 200 len: 1737 microversion: 2.1 time: 0.278998 Jun 22 10:19:44.756547 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-6089d99f-4a51-4b7f-a0ac-17d9a9eb8bb9 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:19:44.760672 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 265/547] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:19:44 2022] GET /compute/v2.1/servers/86a421a6-9b8c-40a9-ab7e-30b74c7bd0f3 => generated 1737 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:19:44.771393 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-6089d99f-4a51-4b7f-a0ac-17d9a9eb8bb9 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:44.773432 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-6089d99f-4a51-4b7f-a0ac-17d9a9eb8bb9 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:44.806697 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.compute.api [None req-6089d99f-4a51-4b7f-a0ac-17d9a9eb8bb9 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] [instance: eb851ab6-0e89-41d2-be52-d76cdc8644d6] Going to try to stop instance {{(pid=117874) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jun 22 10:19:44.878420 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [None req-6089d99f-4a51-4b7f-a0ac-17d9a9eb8bb9 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] 10.222.0.43 "POST /compute/v2.1/servers/eb851ab6-0e89-41d2-be52-d76cdc8644d6/action" status: 202 len: 0 microversion: 2.1 time: 0.127814 Jun 22 10:19:44.879914 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 283/548] 10.222.0.43 () {60 vars in 1277 bytes} [Wed Jun 22 10:19:44 2022] POST /compute/v2.1/servers/eb851ab6-0e89-41d2-be52-d76cdc8644d6/action => generated 0 bytes in 131 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 22 10:19:44.888208 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-f3c3236b-0f01-4cc2-8119-9ea4ca8fa9c2 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Calling method '>' {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:19:44.888823 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.compute.api [None req-f3c3236b-0f01-4cc2-8119-9ea4ca8fa9c2 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] [instance: eb851ab6-0e89-41d2-be52-d76cdc8644d6] Fetching instance by UUID {{(pid=117873) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:19:44.900139 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-f3c3236b-0f01-4cc2-8119-9ea4ca8fa9c2 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:44.902308 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-f3c3236b-0f01-4cc2-8119-9ea4ca8fa9c2 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:44.903260 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-f3c3236b-0f01-4cc2-8119-9ea4ca8fa9c2 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:44.903697 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-f3c3236b-0f01-4cc2-8119-9ea4ca8fa9c2 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:45.110873 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.policy [None req-f3c3236b-0f01-4cc2-8119-9ea4ca8fa9c2 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78fe3fc4334c43d7a5ef6d70f9f57523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad52333bcbec425089c44c3e55df97ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117873) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:19:45.119243 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [None req-f3c3236b-0f01-4cc2-8119-9ea4ca8fa9c2 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] 10.222.0.43 "GET /compute/v2.1/servers/eb851ab6-0e89-41d2-be52-d76cdc8644d6" status: 200 len: 1678 microversion: 2.1 time: 0.234806 Jun 22 10:19:45.120099 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 266/549] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:19:44 2022] GET /compute/v2.1/servers/eb851ab6-0e89-41d2-be52-d76cdc8644d6 => generated 1678 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:19:45.770590 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-b5b17bc9-e841-46f9-b229-2327e832cef7 tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] Action: 'create', calling method: .version_select at 0x7f36bdd0cc10>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1986835772", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBG4x8Rs+MWLHlriXGpFu/tQxLeGWw0jqYIm1RKyHwpuzvTmBvKpQ6SDLhFBv/FjeDQytvM6BJcL+78Hysz3Mh26MtJUtyJHaJ026ew4ngJ8NSAni7PJmUHkDliAhRkJ/A=="}} {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:19:45.778541 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-25f6cf72-b529-4a9a-9346-587ec35e3274 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Calling method '>' {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:19:45.779149 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.compute.api [None req-25f6cf72-b529-4a9a-9346-587ec35e3274 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] [instance: 86a421a6-9b8c-40a9-ab7e-30b74c7bd0f3] Fetching instance by UUID {{(pid=117873) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:19:45.785471 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.quota [None req-b5b17bc9-e841-46f9-b229-2327e832cef7 tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] Getting quotas for project 1cb1af845e594466b12a11b7cab99a7c. Resources: {'key_pairs'} {{(pid=117874) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 22 10:19:45.788303 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-25f6cf72-b529-4a9a-9346-587ec35e3274 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:45.789257 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-25f6cf72-b529-4a9a-9346-587ec35e3274 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:45.789441 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.quota [None req-b5b17bc9-e841-46f9-b229-2327e832cef7 tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] Getting quotas for user b2d3aa18a0a146808f584127411a1cf5 and project 1cb1af845e594466b12a11b7cab99a7c. Resources: {'key_pairs'} {{(pid=117874) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 22 10:19:45.790555 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-25f6cf72-b529-4a9a-9346-587ec35e3274 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:45.791466 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-25f6cf72-b529-4a9a-9346-587ec35e3274 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:45.814345 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [None req-b5b17bc9-e841-46f9-b229-2327e832cef7 tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.238726 Jun 22 10:19:45.814951 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 284/550] 10.222.0.43 () {60 vars in 1158 bytes} [Wed Jun 22 10:19:45 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 10:19:45.961844 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.policy [None req-25f6cf72-b529-4a9a-9346-587ec35e3274 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d7292401816437fba46d073c4746e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3277b9cbc4b4a8bbacee8440cea1ed2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117873) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:19:45.976064 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [None req-25f6cf72-b529-4a9a-9346-587ec35e3274 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] 10.222.0.43 "GET /compute/v2.1/servers/86a421a6-9b8c-40a9-ab7e-30b74c7bd0f3" status: 200 len: 1737 microversion: 2.1 time: 0.201374 Jun 22 10:19:45.976985 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 267/551] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:19:45 2022] GET /compute/v2.1/servers/86a421a6-9b8c-40a9-ab7e-30b74c7bd0f3 => generated 1737 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 10:19:46.137125 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-2a301ddc-7858-42cb-beb1-e08e72315af9 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Calling method '>' {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:19:46.137899 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.compute.api [None req-2a301ddc-7858-42cb-beb1-e08e72315af9 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] [instance: eb851ab6-0e89-41d2-be52-d76cdc8644d6] Fetching instance by UUID {{(pid=117874) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:19:46.146303 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-2a301ddc-7858-42cb-beb1-e08e72315af9 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:46.146972 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-2a301ddc-7858-42cb-beb1-e08e72315af9 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:46.147748 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-2a301ddc-7858-42cb-beb1-e08e72315af9 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:46.148187 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-2a301ddc-7858-42cb-beb1-e08e72315af9 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:46.299328 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.policy [None req-2a301ddc-7858-42cb-beb1-e08e72315af9 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78fe3fc4334c43d7a5ef6d70f9f57523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad52333bcbec425089c44c3e55df97ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117874) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:19:46.309471 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [None req-2a301ddc-7858-42cb-beb1-e08e72315af9 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] 10.222.0.43 "GET /compute/v2.1/servers/eb851ab6-0e89-41d2-be52-d76cdc8644d6" status: 200 len: 1678 microversion: 2.1 time: 0.176761 Jun 22 10:19:46.310076 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 285/552] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:19:46 2022] GET /compute/v2.1/servers/eb851ab6-0e89-41d2-be52-d76cdc8644d6 => generated 1678 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:19:46.923156 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-82c36f36-baed-4a66-b59b-e34746abb1c6 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Calling method '>' {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:19:46.924614 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.compute.api [None req-82c36f36-baed-4a66-b59b-e34746abb1c6 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] [instance: 73dbd5ab-5688-4de4-9da2-0b89d7cefb11] Fetching instance by UUID {{(pid=117873) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:19:46.931353 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-82c36f36-baed-4a66-b59b-e34746abb1c6 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:46.931892 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-82c36f36-baed-4a66-b59b-e34746abb1c6 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:46.932826 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-82c36f36-baed-4a66-b59b-e34746abb1c6 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:46.933441 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-82c36f36-baed-4a66-b59b-e34746abb1c6 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:46.966865 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [None req-82c36f36-baed-4a66-b59b-e34746abb1c6 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] 10.222.0.43 "GET /compute/v2.1/servers/73dbd5ab-5688-4de4-9da2-0b89d7cefb11/os-volume_attachments/2cb16ceb-0a80-4a93-8617-8ba2b4a1d166" status: 200 len: 194 microversion: 2.20 time: 0.048144 Jun 22 10:19:46.967465 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 268/553] 10.222.0.43 () {60 vars in 1453 bytes} [Wed Jun 22 10:19:46 2022] GET /compute/v2.1/servers/73dbd5ab-5688-4de4-9da2-0b89d7cefb11/os-volume_attachments/2cb16ceb-0a80-4a93-8617-8ba2b4a1d166 => generated 194 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 22 10:19:46.995451 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-2725d307-2e8f-433d-94ce-3f33d248e71e tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Calling method '>' {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:19:46.996325 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.compute.api [None req-2725d307-2e8f-433d-94ce-3f33d248e71e tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] [instance: 86a421a6-9b8c-40a9-ab7e-30b74c7bd0f3] Fetching instance by UUID {{(pid=117874) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:19:47.007412 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-2725d307-2e8f-433d-94ce-3f33d248e71e tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:47.011816 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-2725d307-2e8f-433d-94ce-3f33d248e71e tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:47.013076 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-2725d307-2e8f-433d-94ce-3f33d248e71e tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:47.014076 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-2725d307-2e8f-433d-94ce-3f33d248e71e tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:47.043047 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-778fb44a-735e-4405-b149-b8a89782f45b tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Calling method '>' {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:19:47.043786 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.compute.api [None req-778fb44a-735e-4405-b149-b8a89782f45b tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] [instance: 73dbd5ab-5688-4de4-9da2-0b89d7cefb11] Fetching instance by UUID {{(pid=117873) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:19:47.050969 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-778fb44a-735e-4405-b149-b8a89782f45b tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:47.051655 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-778fb44a-735e-4405-b149-b8a89782f45b tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:47.052581 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-778fb44a-735e-4405-b149-b8a89782f45b tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:47.053162 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-778fb44a-735e-4405-b149-b8a89782f45b tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:47.163991 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.objects.instance [None req-778fb44a-735e-4405-b149-b8a89782f45b tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lazy-loading 'services' on Instance uuid 73dbd5ab-5688-4de4-9da2-0b89d7cefb11 {{(pid=117873) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 22 10:19:47.195280 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.policy [None req-2725d307-2e8f-433d-94ce-3f33d248e71e tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d7292401816437fba46d073c4746e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3277b9cbc4b4a8bbacee8440cea1ed2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117874) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:19:47.206428 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [None req-2725d307-2e8f-433d-94ce-3f33d248e71e tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] 10.222.0.43 "GET /compute/v2.1/servers/86a421a6-9b8c-40a9-ab7e-30b74c7bd0f3" status: 200 len: 1737 microversion: 2.1 time: 0.215652 Jun 22 10:19:47.207872 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 286/554] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:19:46 2022] GET /compute/v2.1/servers/86a421a6-9b8c-40a9-ab7e-30b74c7bd0f3 => generated 1737 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:19:47.258558 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [None req-778fb44a-735e-4405-b149-b8a89782f45b tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] 10.222.0.43 "DELETE /compute/v2.1/servers/73dbd5ab-5688-4de4-9da2-0b89d7cefb11/os-volume_attachments/2cb16ceb-0a80-4a93-8617-8ba2b4a1d166" status: 202 len: 0 microversion: 2.20 time: 0.219002 Jun 22 10:19:47.259768 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 269/555] 10.222.0.43 () {60 vars in 1456 bytes} [Wed Jun 22 10:19:47 2022] DELETE /compute/v2.1/servers/73dbd5ab-5688-4de4-9da2-0b89d7cefb11/os-volume_attachments/2cb16ceb-0a80-4a93-8617-8ba2b4a1d166 => generated 0 bytes in 221 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Jun 22 10:19:47.269296 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-12d3a6b4-c8ea-4832-9d4f-91841bcf2c7a tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Calling method '>' {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:19:47.270120 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.compute.api [None req-12d3a6b4-c8ea-4832-9d4f-91841bcf2c7a tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] [instance: 73dbd5ab-5688-4de4-9da2-0b89d7cefb11] Fetching instance by UUID {{(pid=117874) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:19:47.279646 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-12d3a6b4-c8ea-4832-9d4f-91841bcf2c7a tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:47.297153 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-12d3a6b4-c8ea-4832-9d4f-91841bcf2c7a tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:47.299154 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-12d3a6b4-c8ea-4832-9d4f-91841bcf2c7a tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:47.299748 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-12d3a6b4-c8ea-4832-9d4f-91841bcf2c7a tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:47.331161 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-0bb3e73c-d51a-4412-b6dc-6cfb14e4a8b3 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Calling method '>' {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:19:47.331971 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.compute.api [None req-0bb3e73c-d51a-4412-b6dc-6cfb14e4a8b3 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] [instance: eb851ab6-0e89-41d2-be52-d76cdc8644d6] Fetching instance by UUID {{(pid=117873) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:19:47.339630 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-0bb3e73c-d51a-4412-b6dc-6cfb14e4a8b3 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:47.340144 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-0bb3e73c-d51a-4412-b6dc-6cfb14e4a8b3 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:47.341120 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-0bb3e73c-d51a-4412-b6dc-6cfb14e4a8b3 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:47.341760 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-0bb3e73c-d51a-4412-b6dc-6cfb14e4a8b3 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:47.353573 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [None req-12d3a6b4-c8ea-4832-9d4f-91841bcf2c7a tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] 10.222.0.43 "GET /compute/v2.1/servers/73dbd5ab-5688-4de4-9da2-0b89d7cefb11/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.089484 Jun 22 10:19:47.354566 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 287/556] 10.222.0.43 () {60 vars in 1342 bytes} [Wed Jun 22 10:19:47 2022] GET /compute/v2.1/servers/73dbd5ab-5688-4de4-9da2-0b89d7cefb11/os-volume_attachments => generated 197 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 22 10:19:47.527132 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.policy [None req-0bb3e73c-d51a-4412-b6dc-6cfb14e4a8b3 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78fe3fc4334c43d7a5ef6d70f9f57523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad52333bcbec425089c44c3e55df97ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117873) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:19:47.535860 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [None req-0bb3e73c-d51a-4412-b6dc-6cfb14e4a8b3 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] 10.222.0.43 "GET /compute/v2.1/servers/eb851ab6-0e89-41d2-be52-d76cdc8644d6" status: 200 len: 1678 microversion: 2.1 time: 0.211920 Jun 22 10:19:47.536519 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 270/557] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:19:47 2022] GET /compute/v2.1/servers/eb851ab6-0e89-41d2-be52-d76cdc8644d6 => generated 1678 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:19:48.224131 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-beaba214-c34e-47fb-af3e-87a5a1214fea tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Calling method '>' {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:19:48.224738 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.compute.api [None req-beaba214-c34e-47fb-af3e-87a5a1214fea tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] [instance: 86a421a6-9b8c-40a9-ab7e-30b74c7bd0f3] Fetching instance by UUID {{(pid=117874) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:19:48.231578 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-beaba214-c34e-47fb-af3e-87a5a1214fea tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:48.232023 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-beaba214-c34e-47fb-af3e-87a5a1214fea tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:48.232782 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-beaba214-c34e-47fb-af3e-87a5a1214fea tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:48.233210 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-beaba214-c34e-47fb-af3e-87a5a1214fea tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:48.365942 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-15a0e186-ebaf-4760-959a-d1744a989c9d tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Calling method '>' {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:19:48.367600 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.compute.api [None req-15a0e186-ebaf-4760-959a-d1744a989c9d tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] [instance: 73dbd5ab-5688-4de4-9da2-0b89d7cefb11] Fetching instance by UUID {{(pid=117873) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:19:48.368766 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.policy [None req-beaba214-c34e-47fb-af3e-87a5a1214fea tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d7292401816437fba46d073c4746e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3277b9cbc4b4a8bbacee8440cea1ed2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117874) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:19:48.374748 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-15a0e186-ebaf-4760-959a-d1744a989c9d tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:48.375307 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-15a0e186-ebaf-4760-959a-d1744a989c9d tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:48.376066 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-15a0e186-ebaf-4760-959a-d1744a989c9d tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:48.376658 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-15a0e186-ebaf-4760-959a-d1744a989c9d tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:48.377859 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [None req-beaba214-c34e-47fb-af3e-87a5a1214fea tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] 10.222.0.43 "GET /compute/v2.1/servers/86a421a6-9b8c-40a9-ab7e-30b74c7bd0f3" status: 200 len: 1737 microversion: 2.1 time: 0.157974 Jun 22 10:19:48.387667 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 288/558] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:19:48 2022] GET /compute/v2.1/servers/86a421a6-9b8c-40a9-ab7e-30b74c7bd0f3 => generated 1737 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:19:48.410142 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [None req-15a0e186-ebaf-4760-959a-d1744a989c9d tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] 10.222.0.43 "GET /compute/v2.1/servers/73dbd5ab-5688-4de4-9da2-0b89d7cefb11/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.049395 Jun 22 10:19:48.410714 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 271/559] 10.222.0.43 () {60 vars in 1342 bytes} [Wed Jun 22 10:19:48 2022] GET /compute/v2.1/servers/73dbd5ab-5688-4de4-9da2-0b89d7cefb11/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 10:19:48.474587 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-3f4bc1bc-4ce6-4c0b-811e-801244fdf49b tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Calling method '>' {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:19:48.475096 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.compute.api [None req-3f4bc1bc-4ce6-4c0b-811e-801244fdf49b tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] [instance: 73dbd5ab-5688-4de4-9da2-0b89d7cefb11] Fetching instance by UUID {{(pid=117874) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:19:48.485274 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-3f4bc1bc-4ce6-4c0b-811e-801244fdf49b tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:48.485759 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-3f4bc1bc-4ce6-4c0b-811e-801244fdf49b tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:48.486539 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-3f4bc1bc-4ce6-4c0b-811e-801244fdf49b tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:48.486978 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-3f4bc1bc-4ce6-4c0b-811e-801244fdf49b tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:48.517136 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.compute.api [None req-3f4bc1bc-4ce6-4c0b-811e-801244fdf49b tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] [instance: 73dbd5ab-5688-4de4-9da2-0b89d7cefb11] Going to try to terminate instance {{(pid=117874) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 22 10:19:48.553913 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-76a5da6c-4e74-4437-94d1-134e69eb6f69 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Calling method '>' {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:19:48.555254 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.compute.api [None req-76a5da6c-4e74-4437-94d1-134e69eb6f69 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] [instance: eb851ab6-0e89-41d2-be52-d76cdc8644d6] Fetching instance by UUID {{(pid=117873) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:19:48.562203 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-76a5da6c-4e74-4437-94d1-134e69eb6f69 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:48.562933 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-76a5da6c-4e74-4437-94d1-134e69eb6f69 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:48.564831 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-76a5da6c-4e74-4437-94d1-134e69eb6f69 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:48.565495 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-76a5da6c-4e74-4437-94d1-134e69eb6f69 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:48.612758 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [None req-3f4bc1bc-4ce6-4c0b-811e-801244fdf49b tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] 10.222.0.43 "DELETE /compute/v2.1/servers/73dbd5ab-5688-4de4-9da2-0b89d7cefb11" status: 204 len: 0 microversion: 2.20 time: 0.142660 Jun 22 10:19:48.614218 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 289/560] 10.222.0.43 () {60 vars in 1279 bytes} [Wed Jun 22 10:19:48 2022] DELETE /compute/v2.1/servers/73dbd5ab-5688-4de4-9da2-0b89d7cefb11 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 22 10:19:48.622842 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-1dd193bc-b105-48ba-8f2d-2a3bb4c767e2 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Calling method '>' {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:19:48.623866 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.compute.api [None req-1dd193bc-b105-48ba-8f2d-2a3bb4c767e2 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] [instance: 73dbd5ab-5688-4de4-9da2-0b89d7cefb11] Fetching instance by UUID {{(pid=117874) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:19:48.631674 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-1dd193bc-b105-48ba-8f2d-2a3bb4c767e2 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:48.632129 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-1dd193bc-b105-48ba-8f2d-2a3bb4c767e2 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:48.632905 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-1dd193bc-b105-48ba-8f2d-2a3bb4c767e2 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:48.633341 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-1dd193bc-b105-48ba-8f2d-2a3bb4c767e2 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:48.658501 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG dbcounter [-] [117874] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=117874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:19:48.797890 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.policy [None req-76a5da6c-4e74-4437-94d1-134e69eb6f69 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78fe3fc4334c43d7a5ef6d70f9f57523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad52333bcbec425089c44c3e55df97ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117873) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:19:48.805961 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [None req-76a5da6c-4e74-4437-94d1-134e69eb6f69 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] 10.222.0.43 "GET /compute/v2.1/servers/eb851ab6-0e89-41d2-be52-d76cdc8644d6" status: 200 len: 1678 microversion: 2.1 time: 0.256392 Jun 22 10:19:48.810101 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 272/561] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:19:48 2022] GET /compute/v2.1/servers/eb851ab6-0e89-41d2-be52-d76cdc8644d6 => generated 1678 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 10:19:48.830512 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.policy [None req-1dd193bc-b105-48ba-8f2d-2a3bb4c767e2 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75753b29a78640df9622d4e2655baf9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee9d603d9cc4a8797f55d544f189720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117874) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:19:48.838624 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.policy [None req-1dd193bc-b105-48ba-8f2d-2a3bb4c767e2 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75753b29a78640df9622d4e2655baf9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee9d603d9cc4a8797f55d544f189720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117874) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:19:48.840215 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.policy [None req-1dd193bc-b105-48ba-8f2d-2a3bb4c767e2 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75753b29a78640df9622d4e2655baf9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee9d603d9cc4a8797f55d544f189720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117874) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:19:48.841469 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [None req-1dd193bc-b105-48ba-8f2d-2a3bb4c767e2 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] 10.222.0.43 "GET /compute/v2.1/servers/73dbd5ab-5688-4de4-9da2-0b89d7cefb11" status: 200 len: 1724 microversion: 2.20 time: 0.222914 Jun 22 10:19:48.842127 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 290/562] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jun 22 10:19:48 2022] GET /compute/v2.1/servers/73dbd5ab-5688-4de4-9da2-0b89d7cefb11 => generated 1724 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 22 10:19:49.394921 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-1c46a1b0-5c69-4dde-854d-7e2b0ae392a1 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Calling method '>' {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:19:49.395593 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.compute.api [None req-1c46a1b0-5c69-4dde-854d-7e2b0ae392a1 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] [instance: 86a421a6-9b8c-40a9-ab7e-30b74c7bd0f3] Fetching instance by UUID {{(pid=117873) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:19:49.401889 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-1c46a1b0-5c69-4dde-854d-7e2b0ae392a1 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:49.402333 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-1c46a1b0-5c69-4dde-854d-7e2b0ae392a1 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:49.403345 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-1c46a1b0-5c69-4dde-854d-7e2b0ae392a1 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:49.403782 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-1c46a1b0-5c69-4dde-854d-7e2b0ae392a1 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:49.564524 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.policy [None req-1c46a1b0-5c69-4dde-854d-7e2b0ae392a1 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d7292401816437fba46d073c4746e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3277b9cbc4b4a8bbacee8440cea1ed2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117873) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:19:49.572917 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [None req-1c46a1b0-5c69-4dde-854d-7e2b0ae392a1 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] 10.222.0.43 "GET /compute/v2.1/servers/86a421a6-9b8c-40a9-ab7e-30b74c7bd0f3" status: 200 len: 1737 microversion: 2.1 time: 0.181810 Jun 22 10:19:49.573651 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 273/563] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:19:49 2022] GET /compute/v2.1/servers/86a421a6-9b8c-40a9-ab7e-30b74c7bd0f3 => generated 1737 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:19:49.824832 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-6d49e354-ce73-415c-90bb-d61755e1d5d4 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Calling method '>' {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:19:49.826964 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.compute.api [None req-6d49e354-ce73-415c-90bb-d61755e1d5d4 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] [instance: eb851ab6-0e89-41d2-be52-d76cdc8644d6] Fetching instance by UUID {{(pid=117874) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:19:49.841539 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-6d49e354-ce73-415c-90bb-d61755e1d5d4 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:49.842284 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-6d49e354-ce73-415c-90bb-d61755e1d5d4 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:49.843252 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-6d49e354-ce73-415c-90bb-d61755e1d5d4 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:49.844212 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-6d49e354-ce73-415c-90bb-d61755e1d5d4 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:49.862366 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-c65d5ecf-60b6-47b4-953e-fd4fe5705bca tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Calling method '>' {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:19:49.862896 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.compute.api [None req-c65d5ecf-60b6-47b4-953e-fd4fe5705bca tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] [instance: 73dbd5ab-5688-4de4-9da2-0b89d7cefb11] Fetching instance by UUID {{(pid=117873) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:19:49.883665 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-c65d5ecf-60b6-47b4-953e-fd4fe5705bca tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:49.884543 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-c65d5ecf-60b6-47b4-953e-fd4fe5705bca tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:49.885357 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-c65d5ecf-60b6-47b4-953e-fd4fe5705bca tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:49.885822 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-c65d5ecf-60b6-47b4-953e-fd4fe5705bca tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:50.099307 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.policy [None req-c65d5ecf-60b6-47b4-953e-fd4fe5705bca tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75753b29a78640df9622d4e2655baf9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee9d603d9cc4a8797f55d544f189720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117873) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:19:50.108759 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.policy [None req-c65d5ecf-60b6-47b4-953e-fd4fe5705bca tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75753b29a78640df9622d4e2655baf9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee9d603d9cc4a8797f55d544f189720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117873) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:19:50.109405 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.policy [None req-6d49e354-ce73-415c-90bb-d61755e1d5d4 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78fe3fc4334c43d7a5ef6d70f9f57523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad52333bcbec425089c44c3e55df97ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117874) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:19:50.111910 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.policy [None req-c65d5ecf-60b6-47b4-953e-fd4fe5705bca tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75753b29a78640df9622d4e2655baf9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee9d603d9cc4a8797f55d544f189720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117873) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:19:50.113633 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [None req-c65d5ecf-60b6-47b4-953e-fd4fe5705bca tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] 10.222.0.43 "GET /compute/v2.1/servers/73dbd5ab-5688-4de4-9da2-0b89d7cefb11" status: 200 len: 1724 microversion: 2.20 time: 0.256104 Jun 22 10:19:50.114485 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 274/564] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jun 22 10:19:49 2022] GET /compute/v2.1/servers/73dbd5ab-5688-4de4-9da2-0b89d7cefb11 => generated 1724 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 22 10:19:50.127789 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [None req-6d49e354-ce73-415c-90bb-d61755e1d5d4 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] 10.222.0.43 "GET /compute/v2.1/servers/eb851ab6-0e89-41d2-be52-d76cdc8644d6" status: 200 len: 1678 microversion: 2.1 time: 0.307850 Jun 22 10:19:50.128681 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 291/565] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:19:49 2022] GET /compute/v2.1/servers/eb851ab6-0e89-41d2-be52-d76cdc8644d6 => generated 1678 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:19:50.590958 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-03a7c7b1-bd63-4c3f-90f3-4032a36b5075 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Calling method '>' {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:19:50.591570 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.compute.api [None req-03a7c7b1-bd63-4c3f-90f3-4032a36b5075 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] [instance: 86a421a6-9b8c-40a9-ab7e-30b74c7bd0f3] Fetching instance by UUID {{(pid=117873) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:19:50.600771 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-03a7c7b1-bd63-4c3f-90f3-4032a36b5075 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:50.601484 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-03a7c7b1-bd63-4c3f-90f3-4032a36b5075 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:50.602693 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-03a7c7b1-bd63-4c3f-90f3-4032a36b5075 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:50.603543 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-03a7c7b1-bd63-4c3f-90f3-4032a36b5075 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:50.756687 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.policy [None req-03a7c7b1-bd63-4c3f-90f3-4032a36b5075 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d7292401816437fba46d073c4746e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3277b9cbc4b4a8bbacee8440cea1ed2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117873) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:19:50.765101 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [None req-03a7c7b1-bd63-4c3f-90f3-4032a36b5075 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] 10.222.0.43 "GET /compute/v2.1/servers/86a421a6-9b8c-40a9-ab7e-30b74c7bd0f3" status: 200 len: 1737 microversion: 2.1 time: 0.178648 Jun 22 10:19:50.765681 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 275/566] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:19:50 2022] GET /compute/v2.1/servers/86a421a6-9b8c-40a9-ab7e-30b74c7bd0f3 => generated 1737 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:19:51.132410 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-fc87f6e9-7c16-4dad-acc8-38b6a202ba5b tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Calling method '>' {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:19:51.133103 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.compute.api [None req-fc87f6e9-7c16-4dad-acc8-38b6a202ba5b tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] [instance: 73dbd5ab-5688-4de4-9da2-0b89d7cefb11] Fetching instance by UUID {{(pid=117874) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:19:51.141965 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-fc87f6e9-7c16-4dad-acc8-38b6a202ba5b tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:51.142419 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-fc87f6e9-7c16-4dad-acc8-38b6a202ba5b tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:51.143189 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-fc87f6e9-7c16-4dad-acc8-38b6a202ba5b tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:51.143618 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-fc87f6e9-7c16-4dad-acc8-38b6a202ba5b tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:51.145512 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-57de9bba-9903-4b28-af5d-37e55436a31f tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Calling method '>' {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:19:51.146355 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.compute.api [None req-57de9bba-9903-4b28-af5d-37e55436a31f tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] [instance: eb851ab6-0e89-41d2-be52-d76cdc8644d6] Fetching instance by UUID {{(pid=117873) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:19:51.154296 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-57de9bba-9903-4b28-af5d-37e55436a31f tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:51.155125 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-57de9bba-9903-4b28-af5d-37e55436a31f tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:51.155933 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-57de9bba-9903-4b28-af5d-37e55436a31f tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:51.156425 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-57de9bba-9903-4b28-af5d-37e55436a31f tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:51.355275 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.policy [None req-fc87f6e9-7c16-4dad-acc8-38b6a202ba5b tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75753b29a78640df9622d4e2655baf9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee9d603d9cc4a8797f55d544f189720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117874) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:19:51.358209 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.policy [None req-57de9bba-9903-4b28-af5d-37e55436a31f tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78fe3fc4334c43d7a5ef6d70f9f57523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad52333bcbec425089c44c3e55df97ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117873) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:19:51.365220 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.policy [None req-fc87f6e9-7c16-4dad-acc8-38b6a202ba5b tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75753b29a78640df9622d4e2655baf9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee9d603d9cc4a8797f55d544f189720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117874) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:19:51.366228 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [None req-57de9bba-9903-4b28-af5d-37e55436a31f tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] 10.222.0.43 "GET /compute/v2.1/servers/eb851ab6-0e89-41d2-be52-d76cdc8644d6" status: 200 len: 1678 microversion: 2.1 time: 0.225535 Jun 22 10:19:51.367281 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 276/567] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:19:51 2022] GET /compute/v2.1/servers/eb851ab6-0e89-41d2-be52-d76cdc8644d6 => generated 1678 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:19:51.371135 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.policy [None req-fc87f6e9-7c16-4dad-acc8-38b6a202ba5b tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75753b29a78640df9622d4e2655baf9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee9d603d9cc4a8797f55d544f189720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117874) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:19:51.372652 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [None req-fc87f6e9-7c16-4dad-acc8-38b6a202ba5b tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] 10.222.0.43 "GET /compute/v2.1/servers/73dbd5ab-5688-4de4-9da2-0b89d7cefb11" status: 200 len: 1724 microversion: 2.20 time: 0.244118 Jun 22 10:19:51.373710 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 292/568] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jun 22 10:19:51 2022] GET /compute/v2.1/servers/73dbd5ab-5688-4de4-9da2-0b89d7cefb11 => generated 1724 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 10:19:51.783460 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-7fa8119c-7cc8-4bb1-9daa-648868a03d57 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Calling method '>' {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:19:51.784096 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.compute.api [None req-7fa8119c-7cc8-4bb1-9daa-648868a03d57 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] [instance: 86a421a6-9b8c-40a9-ab7e-30b74c7bd0f3] Fetching instance by UUID {{(pid=117873) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:19:51.790936 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-7fa8119c-7cc8-4bb1-9daa-648868a03d57 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:51.791377 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-7fa8119c-7cc8-4bb1-9daa-648868a03d57 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:51.792143 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-7fa8119c-7cc8-4bb1-9daa-648868a03d57 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:51.792575 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-7fa8119c-7cc8-4bb1-9daa-648868a03d57 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:51.795548 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG dbcounter [-] [117873] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=117873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:19:51.936561 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.policy [None req-7fa8119c-7cc8-4bb1-9daa-648868a03d57 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d7292401816437fba46d073c4746e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3277b9cbc4b4a8bbacee8440cea1ed2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117873) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:19:51.946580 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [None req-7fa8119c-7cc8-4bb1-9daa-648868a03d57 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] 10.222.0.43 "GET /compute/v2.1/servers/86a421a6-9b8c-40a9-ab7e-30b74c7bd0f3" status: 200 len: 1737 microversion: 2.1 time: 0.167921 Jun 22 10:19:51.956567 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 277/569] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:19:51 2022] GET /compute/v2.1/servers/86a421a6-9b8c-40a9-ab7e-30b74c7bd0f3 => generated 1737 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:19:52.383111 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-6b71b3d8-71cd-49ee-9497-98bfd98589c3 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Calling method '>' {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:19:52.383845 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.compute.api [None req-6b71b3d8-71cd-49ee-9497-98bfd98589c3 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] [instance: eb851ab6-0e89-41d2-be52-d76cdc8644d6] Fetching instance by UUID {{(pid=117874) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:19:52.390532 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-6b71b3d8-71cd-49ee-9497-98bfd98589c3 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:52.391064 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-6b71b3d8-71cd-49ee-9497-98bfd98589c3 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:52.392435 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-6b71b3d8-71cd-49ee-9497-98bfd98589c3 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:52.392558 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-30a95fae-8778-49e4-98a6-010fc7c5078e tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Calling method '>' {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:19:52.393126 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-6b71b3d8-71cd-49ee-9497-98bfd98589c3 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:52.393317 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.compute.api [None req-30a95fae-8778-49e4-98a6-010fc7c5078e tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] [instance: 73dbd5ab-5688-4de4-9da2-0b89d7cefb11] Fetching instance by UUID {{(pid=117873) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:19:52.400213 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-30a95fae-8778-49e4-98a6-010fc7c5078e tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:52.400657 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-30a95fae-8778-49e4-98a6-010fc7c5078e tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:52.401573 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-30a95fae-8778-49e4-98a6-010fc7c5078e tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:52.402178 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-30a95fae-8778-49e4-98a6-010fc7c5078e tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:52.502375 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.policy [None req-30a95fae-8778-49e4-98a6-010fc7c5078e tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75753b29a78640df9622d4e2655baf9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee9d603d9cc4a8797f55d544f189720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117873) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:19:52.518186 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.policy [None req-30a95fae-8778-49e4-98a6-010fc7c5078e tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75753b29a78640df9622d4e2655baf9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee9d603d9cc4a8797f55d544f189720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117873) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:19:52.519903 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.policy [None req-30a95fae-8778-49e4-98a6-010fc7c5078e tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75753b29a78640df9622d4e2655baf9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee9d603d9cc4a8797f55d544f189720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117873) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:19:52.521450 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [None req-30a95fae-8778-49e4-98a6-010fc7c5078e tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] 10.222.0.43 "GET /compute/v2.1/servers/73dbd5ab-5688-4de4-9da2-0b89d7cefb11" status: 200 len: 1656 microversion: 2.20 time: 0.133511 Jun 22 10:19:52.524921 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 278/570] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jun 22 10:19:52 2022] GET /compute/v2.1/servers/73dbd5ab-5688-4de4-9da2-0b89d7cefb11 => generated 1656 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 22 10:19:52.529216 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [req-5dbcb42e-9f96-42d0-8145-4c5122681040 req-81eed263-aaa1-47d3-99c9-5a3723ba7e0b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "73dbd5ab-5688-4de4-9da2-0b89d7cefb11", "name": "network-vif-deleted", "tag": "468a7090-7d3f-43e5-8303-b6f8870ced56"}]} {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:19:52.544323 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [req-5dbcb42e-9f96-42d0-8145-4c5122681040 req-81eed263-aaa1-47d3-99c9-5a3723ba7e0b service nova] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:52.545069 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [req-5dbcb42e-9f96-42d0-8145-4c5122681040 req-81eed263-aaa1-47d3-99c9-5a3723ba7e0b service nova] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:52.558564 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.compute.server_external_events [req-5dbcb42e-9f96-42d0-8145-4c5122681040 req-81eed263-aaa1-47d3-99c9-5a3723ba7e0b service nova] Creating event network-vif-deleted:468a7090-7d3f-43e5-8303-b6f8870ced56 for instance 73dbd5ab-5688-4de4-9da2-0b89d7cefb11 on hv-cinder-84713 Jun 22 10:19:52.565836 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [req-5dbcb42e-9f96-42d0-8145-4c5122681040 req-81eed263-aaa1-47d3-99c9-5a3723ba7e0b service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041850 Jun 22 10:19:52.567258 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 279/571] 10.222.0.43 () {64 vars in 1317 bytes} [Wed Jun 22 10:19:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 10:19:52.597828 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.policy [None req-6b71b3d8-71cd-49ee-9497-98bfd98589c3 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78fe3fc4334c43d7a5ef6d70f9f57523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad52333bcbec425089c44c3e55df97ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117874) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:19:52.605872 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [None req-6b71b3d8-71cd-49ee-9497-98bfd98589c3 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] 10.222.0.43 "GET /compute/v2.1/servers/eb851ab6-0e89-41d2-be52-d76cdc8644d6" status: 200 len: 1678 microversion: 2.1 time: 0.226499 Jun 22 10:19:52.606673 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 293/572] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:19:52 2022] GET /compute/v2.1/servers/eb851ab6-0e89-41d2-be52-d76cdc8644d6 => generated 1678 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:19:52.967016 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-df06d10a-c4e7-4d14-b380-b6042efe10a5 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Calling method '>' {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:19:52.969553 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.compute.api [None req-df06d10a-c4e7-4d14-b380-b6042efe10a5 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] [instance: 86a421a6-9b8c-40a9-ab7e-30b74c7bd0f3] Fetching instance by UUID {{(pid=117873) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:19:52.981621 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-df06d10a-c4e7-4d14-b380-b6042efe10a5 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:52.981997 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-df06d10a-c4e7-4d14-b380-b6042efe10a5 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:52.982987 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-df06d10a-c4e7-4d14-b380-b6042efe10a5 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:52.983431 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-df06d10a-c4e7-4d14-b380-b6042efe10a5 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:53.167520 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.policy [None req-df06d10a-c4e7-4d14-b380-b6042efe10a5 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d7292401816437fba46d073c4746e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3277b9cbc4b4a8bbacee8440cea1ed2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117873) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:19:53.176449 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [None req-df06d10a-c4e7-4d14-b380-b6042efe10a5 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] 10.222.0.43 "GET /compute/v2.1/servers/86a421a6-9b8c-40a9-ab7e-30b74c7bd0f3" status: 200 len: 1717 microversion: 2.1 time: 0.216032 Jun 22 10:19:53.177041 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 280/573] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:19:52 2022] GET /compute/v2.1/servers/86a421a6-9b8c-40a9-ab7e-30b74c7bd0f3 => generated 1717 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 10:19:53.286968 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-59ff548d-6824-4273-8459-2e2a622a9584 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Calling method '>' {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:19:53.287543 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.compute.api [None req-59ff548d-6824-4273-8459-2e2a622a9584 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] [instance: 86a421a6-9b8c-40a9-ab7e-30b74c7bd0f3] Fetching instance by UUID {{(pid=117874) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:19:53.294747 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-59ff548d-6824-4273-8459-2e2a622a9584 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:53.294747 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-59ff548d-6824-4273-8459-2e2a622a9584 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:53.295260 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-59ff548d-6824-4273-8459-2e2a622a9584 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:53.295762 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-59ff548d-6824-4273-8459-2e2a622a9584 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:53.402633 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.wsgi [None req-59ff548d-6824-4273-8459-2e2a622a9584 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] HTTP exception thrown: Cannot 'detach_volume' instance 86a421a6-9b8c-40a9-ab7e-30b74c7bd0f3 while it is in vm_state rescued Jun 22 10:19:53.405670 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-59ff548d-6824-4273-8459-2e2a622a9584 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Request method failure captured: Jun 22 10:19:53.405670 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: request: DELETE /compute/v2.1/servers/86a421a6-9b8c-40a9-ab7e-30b74c7bd0f3/os-volume_attachments/b6734bf6-cc80-4200-81e5-88d794ca04e8 HTTP/1.1 Jun 22 10:19:53.405670 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: Accept: application/json Jun 22 10:19:53.405670 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: Accept-Encoding: identity Jun 22 10:19:53.405670 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: Connection: close Jun 22 10:19:53.405670 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: Content-Length: 0 Jun 22 10:19:53.405670 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: Content-Type: application/json Jun 22 10:19:53.405670 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: Host: 10.222.0.43 Jun 22 10:19:53.405670 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: Openstack-System-Scope: None Jun 22 10:19:53.405670 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: User-Agent: python-urllib3/1.26.9 Jun 22 10:19:53.405670 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-Auth-Token: gAAAAABisuvjVgSjiKizNMOSSpCqXljNGSFOhAJqDEs6LcefAlRz8CAyn7YtQIZuzfdzoXcb1I3sPaeBjRE3nGlR4nfnglF3o0W8ZwIXa-t2T7Kvu9u_9tTAcMDpcQ53GMtzR-i0HixNHH9XjiiRNTwzoo0r6BKSTSNuiStSMHwEgpkRgSyLC2I Jun 22 10:19:53.405670 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-Domain-Id: None Jun 22 10:19:53.405670 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-Domain-Name: None Jun 22 10:19:53.405670 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-Identity-Status: Confirmed Jun 22 10:19:53.405670 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-Is-Admin-Project: True Jun 22 10:19:53.405670 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-Project-Domain-Id: default Jun 22 10:19:53.405670 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-Project-Domain-Name: Default Jun 22 10:19:53.405670 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-Project-Id: c3277b9cbc4b4a8bbacee8440cea1ed2 Jun 22 10:19:53.405670 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-2023039799 Jun 22 10:19:53.405670 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-Role: reader,member Jun 22 10:19:53.405670 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-Roles: reader,member Jun 22 10:19:53.407767 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/c3277b9cbc4b4a8bbacee8440cea1ed2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/c3277b9cbc4b4a8bbacee8440cea1ed2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_c3277b9cbc4b4a8bbacee8440cea1ed2", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/c3277b9cbc4b4a8bbacee8440cea1ed2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}] Jun 22 10:19:53.407767 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-Tenant: tempest-ServerRescueNegativeTestJSON-2023039799 Jun 22 10:19:53.407767 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-Tenant-Id: c3277b9cbc4b4a8bbacee8440cea1ed2 Jun 22 10:19:53.407767 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-2023039799 Jun 22 10:19:53.407767 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-User: tempest-ServerRescueNegativeTestJSON-2023039799-project Jun 22 10:19:53.407767 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-User-Domain-Id: default Jun 22 10:19:53.407767 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-User-Domain-Name: Default Jun 22 10:19:53.407767 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-User-Id: 0d7292401816437fba46d073c4746e45 Jun 22 10:19:53.407767 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-User-Name: tempest-ServerRescueNegativeTestJSON-2023039799-project Jun 22 10:19:53.407767 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: method: > Jun 22 10:19:53.407767 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: exception: Cannot 'detach_volume' instance 86a421a6-9b8c-40a9-ab7e-30b74c7bd0f3 while it is in vm_state rescued Jun 22 10:19:53.408430 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: action_args: {'server_id': '86a421a6-9b8c-40a9-ab7e-30b74c7bd0f3', 'id': 'b6734bf6-cc80-4200-81e5-88d794ca04e8'} Jun 22 10:19:53.408430 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 10:19:53.408430 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:19:53.408430 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jun 22 10:19:53.408430 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jun 22 10:19:53.408430 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 22 10:19:53.408430 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 22 10:19:53.408430 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jun 22 10:19:53.408430 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jun 22 10:19:53.408430 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 86a421a6-9b8c-40a9-ab7e-30b74c7bd0f3 in vm_state rescued. Cannot detach_volume while the instance is in this state. Jun 22 10:19:53.408430 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi Jun 22 10:19:53.408430 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 10:19:53.408430 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi Jun 22 10:19:53.408430 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:19:53.408430 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 10:19:53.408430 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 10:19:53.408430 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 10:19:53.408430 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 10:19:53.408430 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 10:19:53.408430 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 10:19:53.409865 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Jun 22 10:19:53.409865 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jun 22 10:19:53.409865 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jun 22 10:19:53.409865 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jun 22 10:19:53.409865 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 86a421a6-9b8c-40a9-ab7e-30b74c7bd0f3 while it is in vm_state rescued Jun 22 10:19:53.409865 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi Jun 22 10:19:53.409865 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 10:19:53.409865 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi Jun 22 10:19:53.409865 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:19:53.409865 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 10:19:53.409865 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 10:19:53.409865 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 10:19:53.409865 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 10:19:53.409865 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 86a421a6-9b8c-40a9-ab7e-30b74c7bd0f3 while it is in vm_state rescued Jun 22 10:19:53.409865 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi Jun 22 10:19:53.409865 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-59ff548d-6824-4273-8459-2e2a622a9584 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Returning 409 to user: Cannot 'detach_volume' instance 86a421a6-9b8c-40a9-ab7e-30b74c7bd0f3 while it is in vm_state rescued {{(pid=117874) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 10:19:53.411164 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [None req-59ff548d-6824-4273-8459-2e2a622a9584 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] 10.222.0.43 "DELETE /compute/v2.1/servers/86a421a6-9b8c-40a9-ab7e-30b74c7bd0f3/os-volume_attachments/b6734bf6-cc80-4200-81e5-88d794ca04e8" status: 409 len: 152 microversion: 2.1 time: 0.126726 Jun 22 10:19:53.413442 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 294/574] 10.222.0.43 () {58 vars in 1415 bytes} [Wed Jun 22 10:19:53 2022] DELETE /compute/v2.1/servers/86a421a6-9b8c-40a9-ab7e-30b74c7bd0f3/os-volume_attachments/b6734bf6-cc80-4200-81e5-88d794ca04e8 => generated 152 bytes in 132 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jun 22 10:19:53.418754 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-d8294bf3-3f60-4f68-87b5-57eefd637971 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:19:53.419412 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.compute.api [None req-d8294bf3-3f60-4f68-87b5-57eefd637971 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] [instance: 86a421a6-9b8c-40a9-ab7e-30b74c7bd0f3] Fetching instance by UUID {{(pid=117873) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:19:53.426526 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-d8294bf3-3f60-4f68-87b5-57eefd637971 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:53.427228 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-d8294bf3-3f60-4f68-87b5-57eefd637971 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:53.428437 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-d8294bf3-3f60-4f68-87b5-57eefd637971 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:53.429171 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-d8294bf3-3f60-4f68-87b5-57eefd637971 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:53.515538 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [None req-d8294bf3-3f60-4f68-87b5-57eefd637971 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] 10.222.0.43 "POST /compute/v2.1/servers/86a421a6-9b8c-40a9-ab7e-30b74c7bd0f3/action" status: 202 len: 0 microversion: 2.1 time: 0.100647 Jun 22 10:19:53.519682 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 281/575] 10.222.0.43 () {60 vars in 1277 bytes} [Wed Jun 22 10:19:53 2022] POST /compute/v2.1/servers/86a421a6-9b8c-40a9-ab7e-30b74c7bd0f3/action => generated 0 bytes in 103 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 22 10:19:53.526916 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-a7a0a97b-d826-4ae7-aef2-5cde2748bbe7 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Calling method '>' {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:19:53.527894 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.compute.api [None req-a7a0a97b-d826-4ae7-aef2-5cde2748bbe7 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] [instance: 86a421a6-9b8c-40a9-ab7e-30b74c7bd0f3] Fetching instance by UUID {{(pid=117874) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:19:53.536537 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-a7a0a97b-d826-4ae7-aef2-5cde2748bbe7 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:53.537193 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-a7a0a97b-d826-4ae7-aef2-5cde2748bbe7 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:53.538223 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-a7a0a97b-d826-4ae7-aef2-5cde2748bbe7 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:53.538864 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-a7a0a97b-d826-4ae7-aef2-5cde2748bbe7 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:53.543642 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-0c28431f-433f-46ef-bfde-3f7b6d1bbed9 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Calling method '>' {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:19:53.544322 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.compute.api [None req-0c28431f-433f-46ef-bfde-3f7b6d1bbed9 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] [instance: 73dbd5ab-5688-4de4-9da2-0b89d7cefb11] Fetching instance by UUID {{(pid=117873) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:19:53.553874 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-0c28431f-433f-46ef-bfde-3f7b6d1bbed9 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:53.554276 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-0c28431f-433f-46ef-bfde-3f7b6d1bbed9 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:53.555278 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-0c28431f-433f-46ef-bfde-3f7b6d1bbed9 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:53.555831 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-0c28431f-433f-46ef-bfde-3f7b6d1bbed9 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:53.578584 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.wsgi [None req-0c28431f-433f-46ef-bfde-3f7b6d1bbed9 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] HTTP exception thrown: Instance 73dbd5ab-5688-4de4-9da2-0b89d7cefb11 could not be found. Jun 22 10:19:53.581254 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-0c28431f-433f-46ef-bfde-3f7b6d1bbed9 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Request method failure captured: Jun 22 10:19:53.581254 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: request: GET /compute/v2.1/servers/73dbd5ab-5688-4de4-9da2-0b89d7cefb11 HTTP/1.1 Jun 22 10:19:53.581254 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: Accept: application/json Jun 22 10:19:53.581254 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: Accept-Encoding: identity Jun 22 10:19:53.581254 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: Connection: close Jun 22 10:19:53.581254 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: Content-Length: 0 Jun 22 10:19:53.581254 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: Content-Type: application/json Jun 22 10:19:53.581254 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: Host: 10.222.0.43 Jun 22 10:19:53.581254 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: Openstack-System-Scope: None Jun 22 10:19:53.581254 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: User-Agent: python-urllib3/1.26.9 Jun 22 10:19:53.581254 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-Auth-Token: gAAAAABisuvYS2CXj8gCG7Yc42bXsdyTNZGez3H7ko4foQwezMJLTIf_Gnp6Bb6FBbV0UL-h7nopQ4Zbjw32tlioI-fzkdCmRzFS-ECXrTtuGF0yr0Jygcyn8ziPm4NY4mS70dt4GHZiefYTRmBJ0pCpEOrQP-y8Yi9B62jLLANooAtVTJOUQzg Jun 22 10:19:53.581254 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-Domain-Id: None Jun 22 10:19:53.581254 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-Domain-Name: None Jun 22 10:19:53.581254 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-Identity-Status: Confirmed Jun 22 10:19:53.581254 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-Is-Admin-Project: True Jun 22 10:19:53.581254 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-Openstack-Nova-Api-Version: 2.20 Jun 22 10:19:53.581254 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-Project-Domain-Id: default Jun 22 10:19:53.581254 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-Project-Domain-Name: Default Jun 22 10:19:53.581254 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-Project-Id: 5ee9d603d9cc4a8797f55d544f189720 Jun 22 10:19:53.581254 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1985965461 Jun 22 10:19:53.581254 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-Role: reader,member Jun 22 10:19:53.581254 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-Roles: reader,member Jun 22 10:19:53.582814 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/5ee9d603d9cc4a8797f55d544f189720"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/5ee9d603d9cc4a8797f55d544f189720"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_5ee9d603d9cc4a8797f55d544f189720", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/5ee9d603d9cc4a8797f55d544f189720"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}] Jun 22 10:19:53.582814 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1985965461 Jun 22 10:19:53.582814 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-Tenant-Id: 5ee9d603d9cc4a8797f55d544f189720 Jun 22 10:19:53.582814 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1985965461 Jun 22 10:19:53.582814 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-User: tempest-AttachVolumeShelveTestJSON-1985965461-project Jun 22 10:19:53.582814 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-User-Domain-Id: default Jun 22 10:19:53.582814 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-User-Domain-Name: Default Jun 22 10:19:53.582814 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-User-Id: 75753b29a78640df9622d4e2655baf9b Jun 22 10:19:53.582814 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1985965461-project Jun 22 10:19:53.582814 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: method: > Jun 22 10:19:53.582814 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: exception: Instance 73dbd5ab-5688-4de4-9da2-0b89d7cefb11 could not be found. Jun 22 10:19:53.582814 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: action_args: {'id': '73dbd5ab-5688-4de4-9da2-0b89d7cefb11'} Jun 22 10:19:53.583637 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 10:19:53.583637 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:19:53.583637 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 22 10:19:53.583637 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 22 10:19:53.583637 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 22 10:19:53.583637 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 22 10:19:53.583637 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 22 10:19:53.583637 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 22 10:19:53.583637 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 22 10:19:53.583637 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 22 10:19:53.583637 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 73dbd5ab-5688-4de4-9da2-0b89d7cefb11 could not be found. Jun 22 10:19:53.583637 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi Jun 22 10:19:53.583637 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 10:19:53.583637 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi Jun 22 10:19:53.583637 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:19:53.583637 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 10:19:53.583637 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 10:19:53.583637 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 10:19:53.583637 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 10:19:53.583637 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 10:19:53.585873 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 10:19:53.585873 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 22 10:19:53.585873 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 22 10:19:53.585873 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 22 10:19:53.585873 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 22 10:19:53.585873 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 22 10:19:53.585873 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 22 10:19:53.585873 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 73dbd5ab-5688-4de4-9da2-0b89d7cefb11 could not be found. Jun 22 10:19:53.585873 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi Jun 22 10:19:53.585873 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 10:19:53.585873 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi Jun 22 10:19:53.585873 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:19:53.585873 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 10:19:53.585873 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 10:19:53.585873 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 10:19:53.585873 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 10:19:53.585873 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 73dbd5ab-5688-4de4-9da2-0b89d7cefb11 could not be found. Jun 22 10:19:53.585873 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi Jun 22 10:19:53.588565 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-0c28431f-433f-46ef-bfde-3f7b6d1bbed9 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Returning 404 to user: Instance 73dbd5ab-5688-4de4-9da2-0b89d7cefb11 could not be found. {{(pid=117873) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 10:19:53.588565 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [None req-0c28431f-433f-46ef-bfde-3f7b6d1bbed9 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] 10.222.0.43 "GET /compute/v2.1/servers/73dbd5ab-5688-4de4-9da2-0b89d7cefb11" status: 404 len: 111 microversion: 2.20 time: 0.046112 Jun 22 10:19:53.588565 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 282/576] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jun 22 10:19:53 2022] GET /compute/v2.1/servers/73dbd5ab-5688-4de4-9da2-0b89d7cefb11 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 22 10:19:53.600842 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-7381eaa5-2917-455e-9b79-7c6e2f5df6ac tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Calling method '.version_select at 0x7f36be503d30>' {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:19:53.628781 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [None req-7381eaa5-2917-455e-9b79-7c6e2f5df6ac tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] 10.222.0.43 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1340879061" status: 204 len: 0 microversion: 2.20 time: 0.039908 Jun 22 10:19:53.630841 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 283/577] 10.222.0.43 () {60 vars in 1261 bytes} [Wed Jun 22 10:19:53 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1340879061 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 22 10:19:53.636962 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-c503de3f-ee94-4321-930f-44e0bcbc3400 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Calling method '>' {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:19:53.637639 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.compute.api [None req-c503de3f-ee94-4321-930f-44e0bcbc3400 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] [instance: eb851ab6-0e89-41d2-be52-d76cdc8644d6] Fetching instance by UUID {{(pid=117873) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:19:53.644085 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-c503de3f-ee94-4321-930f-44e0bcbc3400 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:53.644525 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-c503de3f-ee94-4321-930f-44e0bcbc3400 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:53.645444 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-c503de3f-ee94-4321-930f-44e0bcbc3400 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:53.646062 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-c503de3f-ee94-4321-930f-44e0bcbc3400 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:53.803890 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.policy [None req-a7a0a97b-d826-4ae7-aef2-5cde2748bbe7 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d7292401816437fba46d073c4746e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3277b9cbc4b4a8bbacee8440cea1ed2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117874) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:19:53.813929 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [None req-a7a0a97b-d826-4ae7-aef2-5cde2748bbe7 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] 10.222.0.43 "GET /compute/v2.1/servers/86a421a6-9b8c-40a9-ab7e-30b74c7bd0f3" status: 200 len: 1725 microversion: 2.1 time: 0.290583 Jun 22 10:19:53.815396 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 295/578] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:19:53 2022] GET /compute/v2.1/servers/86a421a6-9b8c-40a9-ab7e-30b74c7bd0f3 => generated 1725 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:19:53.842142 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.policy [None req-c503de3f-ee94-4321-930f-44e0bcbc3400 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78fe3fc4334c43d7a5ef6d70f9f57523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad52333bcbec425089c44c3e55df97ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117873) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:19:53.854820 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [None req-c503de3f-ee94-4321-930f-44e0bcbc3400 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] 10.222.0.43 "GET /compute/v2.1/servers/eb851ab6-0e89-41d2-be52-d76cdc8644d6" status: 200 len: 1678 microversion: 2.1 time: 0.222799 Jun 22 10:19:53.855576 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 284/579] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:19:53 2022] GET /compute/v2.1/servers/eb851ab6-0e89-41d2-be52-d76cdc8644d6 => generated 1678 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:19:54.413483 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-5bbda1ab-ec6e-4b78-a77c-b5c31114e158 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Action: 'create', calling method: .version_select at 0x7f36bdd0c790>, body: {"keypair": {"name": "tempest-keypair-10225989", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJXl88rLKSUFL++R149fXC1ydyJrKnW87Zj5C5R1f3Czm4imp8UueRu+GBFIUTHzFimlBYaOZr17DfhYmsRUAWpRsPAeqYk4demhsQLNxdhTvsBQSOYeAIlOGDjkO8A88Q=="}} {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:19:54.429464 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.quota [None req-5bbda1ab-ec6e-4b78-a77c-b5c31114e158 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Getting quotas for project 5ee9d603d9cc4a8797f55d544f189720. Resources: {'key_pairs'} {{(pid=117874) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 22 10:19:54.433361 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.quota [None req-5bbda1ab-ec6e-4b78-a77c-b5c31114e158 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Getting quotas for user 75753b29a78640df9622d4e2655baf9b and project 5ee9d603d9cc4a8797f55d544f189720. Resources: {'key_pairs'} {{(pid=117874) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 22 10:19:54.459972 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [None req-5bbda1ab-ec6e-4b78-a77c-b5c31114e158 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 201 len: 399 microversion: 2.20 time: 0.050259 Jun 22 10:19:54.460693 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 296/580] 10.222.0.43 () {62 vars in 1199 bytes} [Wed Jun 22 10:19:54 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 52 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jun 22 10:19:54.831845 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-c37dfaaa-35a4-453b-b48a-a871db9c3b0b tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Calling method '>' {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:19:54.832583 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.compute.api [None req-c37dfaaa-35a4-453b-b48a-a871db9c3b0b tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] [instance: 86a421a6-9b8c-40a9-ab7e-30b74c7bd0f3] Fetching instance by UUID {{(pid=117873) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:19:54.840184 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-c37dfaaa-35a4-453b-b48a-a871db9c3b0b tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:54.840736 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-c37dfaaa-35a4-453b-b48a-a871db9c3b0b tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:54.842222 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-c37dfaaa-35a4-453b-b48a-a871db9c3b0b tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:54.843091 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-c37dfaaa-35a4-453b-b48a-a871db9c3b0b tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:54.875509 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-2198425a-fe2c-42a2-98e1-8b715a1108a9 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Calling method '>' {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:19:54.876729 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.compute.api [None req-2198425a-fe2c-42a2-98e1-8b715a1108a9 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] [instance: eb851ab6-0e89-41d2-be52-d76cdc8644d6] Fetching instance by UUID {{(pid=117874) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:19:54.884191 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-2198425a-fe2c-42a2-98e1-8b715a1108a9 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:54.884802 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-2198425a-fe2c-42a2-98e1-8b715a1108a9 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:54.885869 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-2198425a-fe2c-42a2-98e1-8b715a1108a9 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:54.886439 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-2198425a-fe2c-42a2-98e1-8b715a1108a9 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:55.080744 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.policy [None req-c37dfaaa-35a4-453b-b48a-a871db9c3b0b tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d7292401816437fba46d073c4746e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3277b9cbc4b4a8bbacee8440cea1ed2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117873) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:19:55.098442 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [None req-c37dfaaa-35a4-453b-b48a-a871db9c3b0b tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] 10.222.0.43 "GET /compute/v2.1/servers/86a421a6-9b8c-40a9-ab7e-30b74c7bd0f3" status: 200 len: 1725 microversion: 2.1 time: 0.269937 Jun 22 10:19:55.104639 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.policy [None req-2198425a-fe2c-42a2-98e1-8b715a1108a9 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78fe3fc4334c43d7a5ef6d70f9f57523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad52333bcbec425089c44c3e55df97ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117874) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:19:55.110851 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 285/581] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:19:54 2022] GET /compute/v2.1/servers/86a421a6-9b8c-40a9-ab7e-30b74c7bd0f3 => generated 1725 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:19:55.113088 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [None req-2198425a-fe2c-42a2-98e1-8b715a1108a9 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] 10.222.0.43 "GET /compute/v2.1/servers/eb851ab6-0e89-41d2-be52-d76cdc8644d6" status: 200 len: 1678 microversion: 2.1 time: 0.243534 Jun 22 10:19:55.114598 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 297/582] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:19:54 2022] GET /compute/v2.1/servers/eb851ab6-0e89-41d2-be52-d76cdc8644d6 => generated 1678 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 10:19:55.934530 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-f13b4c30-bce4-4e86-bc30-ac29ef754a0c tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-952636814", "imageRef": "22d2c064-5bf7-438e-bbb7-47259e4bdab5", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "323c8696-2ed1-4abe-97f8-e9536ce29485"}], "security_groups": [{"name": "tempest-securitygroup--259619342"}], "key_name": "tempest-keypair-10225989", "user_data": "}} {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:19:56.044138 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.network.neutron [None req-f13b4c30-bce4-4e86-bc30-ac29ef754a0c tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] validate_networks() for [('323c8696-2ed1-4abe-97f8-e9536ce29485', None, None, None, None, None)] {{(pid=117873) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 22 10:19:56.122592 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-3f958f75-7b1a-4742-905a-d4ef2f1301a8 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Calling method '>' {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:19:56.123788 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.compute.api [None req-3f958f75-7b1a-4742-905a-d4ef2f1301a8 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] [instance: 86a421a6-9b8c-40a9-ab7e-30b74c7bd0f3] Fetching instance by UUID {{(pid=117874) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:19:56.135361 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-3f958f75-7b1a-4742-905a-d4ef2f1301a8 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:56.135811 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-3f958f75-7b1a-4742-905a-d4ef2f1301a8 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:56.136586 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-3f958f75-7b1a-4742-905a-d4ef2f1301a8 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:56.137719 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-3f958f75-7b1a-4742-905a-d4ef2f1301a8 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:56.338303 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.policy [None req-3f958f75-7b1a-4742-905a-d4ef2f1301a8 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d7292401816437fba46d073c4746e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3277b9cbc4b4a8bbacee8440cea1ed2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117874) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:19:56.347167 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [None req-3f958f75-7b1a-4742-905a-d4ef2f1301a8 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] 10.222.0.43 "GET /compute/v2.1/servers/86a421a6-9b8c-40a9-ab7e-30b74c7bd0f3" status: 200 len: 1725 microversion: 2.1 time: 0.228625 Jun 22 10:19:56.347788 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 298/583] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:19:56 2022] GET /compute/v2.1/servers/86a421a6-9b8c-40a9-ab7e-30b74c7bd0f3 => generated 1725 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 10:19:56.352216 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-13934518-f60f-4573-8b87-2e5831e98447 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Calling method '>' {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:19:56.353244 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.compute.api [None req-13934518-f60f-4573-8b87-2e5831e98447 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] [instance: eb851ab6-0e89-41d2-be52-d76cdc8644d6] Fetching instance by UUID {{(pid=117874) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:19:56.365718 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-13934518-f60f-4573-8b87-2e5831e98447 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:56.366168 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-13934518-f60f-4573-8b87-2e5831e98447 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:56.366973 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-13934518-f60f-4573-8b87-2e5831e98447 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:56.367398 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-13934518-f60f-4573-8b87-2e5831e98447 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:56.575788 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.policy [None req-13934518-f60f-4573-8b87-2e5831e98447 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78fe3fc4334c43d7a5ef6d70f9f57523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad52333bcbec425089c44c3e55df97ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117874) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:19:56.585461 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [None req-13934518-f60f-4573-8b87-2e5831e98447 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] 10.222.0.43 "GET /compute/v2.1/servers/eb851ab6-0e89-41d2-be52-d76cdc8644d6" status: 200 len: 1655 microversion: 2.1 time: 0.236578 Jun 22 10:19:56.586088 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 299/584] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:19:56 2022] GET /compute/v2.1/servers/eb851ab6-0e89-41d2-be52-d76cdc8644d6 => generated 1655 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:19:56.603194 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.virt.hardware [None req-f13b4c30-bce4-4e86-bc30-ac29ef754a0c tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Flavor limits 0:0:0 {{(pid=117873) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 22 10:19:56.603456 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-19e37759-d235-4797-b0b7-51de4719ee1d tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:19:56.603754 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.virt.hardware [None req-f13b4c30-bce4-4e86-bc30-ac29ef754a0c tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Image limits 0:0:0 {{(pid=117873) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 22 10:19:56.604293 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.virt.hardware [None req-f13b4c30-bce4-4e86-bc30-ac29ef754a0c tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Flavor pref 0:0:0 {{(pid=117873) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 22 10:19:56.604766 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.virt.hardware [None req-f13b4c30-bce4-4e86-bc30-ac29ef754a0c tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Image pref 0:0:0 {{(pid=117873) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 22 10:19:56.605241 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.virt.hardware [None req-f13b4c30-bce4-4e86-bc30-ac29ef754a0c tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117873) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 22 10:19:56.609675 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-19e37759-d235-4797-b0b7-51de4719ee1d tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:56.610455 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-19e37759-d235-4797-b0b7-51de4719ee1d tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:56.614959 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-f13b4c30-bce4-4e86-bc30-ac29ef754a0c tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:56.615480 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-f13b4c30-bce4-4e86-bc30-ac29ef754a0c tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:56.616274 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-f13b4c30-bce4-4e86-bc30-ac29ef754a0c tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:56.616706 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-f13b4c30-bce4-4e86-bc30-ac29ef754a0c tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:56.634644 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.compute.api [None req-19e37759-d235-4797-b0b7-51de4719ee1d tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] [instance: eb851ab6-0e89-41d2-be52-d76cdc8644d6] Going to try to start instance {{(pid=117874) start /opt/stack/nova/nova/compute/api.py:2730}} Jun 22 10:19:56.635211 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.quota [None req-f13b4c30-bce4-4e86-bc30-ac29ef754a0c tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Getting quotas for project 5ee9d603d9cc4a8797f55d544f189720. Resources: {'instances', 'cores', 'ram'} {{(pid=117873) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 22 10:19:56.643017 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.quota [None req-f13b4c30-bce4-4e86-bc30-ac29ef754a0c tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Getting quotas for user 75753b29a78640df9622d4e2655baf9b and project 5ee9d603d9cc4a8797f55d544f189720. Resources: {'instances', 'cores', 'ram'} {{(pid=117873) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 22 10:19:56.654752 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.compute.api [None req-f13b4c30-bce4-4e86-bc30-ac29ef754a0c tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Going to run 1 instances... {{(pid=117873) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 22 10:19:56.657383 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.compute.api [None req-f13b4c30-bce4-4e86-bc30-ac29ef754a0c tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] [instance: b357b60f-93be-4898-a651-4a407a7dc490] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='22d2c064-5bf7-438e-bbb7-47259e4bdab5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117873) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 22 10:19:56.691201 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [None req-19e37759-d235-4797-b0b7-51de4719ee1d tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] 10.222.0.43 "POST /compute/v2.1/servers/eb851ab6-0e89-41d2-be52-d76cdc8644d6/action" status: 202 len: 0 microversion: 2.1 time: 0.091046 Jun 22 10:19:56.692223 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 300/585] 10.222.0.43 () {60 vars in 1277 bytes} [Wed Jun 22 10:19:56 2022] POST /compute/v2.1/servers/eb851ab6-0e89-41d2-be52-d76cdc8644d6/action => generated 0 bytes in 94 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 22 10:19:56.704094 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-fa3b534a-8f6b-4cba-ac56-63ff98f09cb6 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Calling method '>' {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:19:56.705162 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.compute.api [None req-fa3b534a-8f6b-4cba-ac56-63ff98f09cb6 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] [instance: eb851ab6-0e89-41d2-be52-d76cdc8644d6] Fetching instance by UUID {{(pid=117874) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:19:56.712479 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [None req-f13b4c30-bce4-4e86-bc30-ac29ef754a0c tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 0.782043 Jun 22 10:19:56.713423 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 286/586] 10.222.0.43 () {62 vars in 1187 bytes} [Wed Jun 22 10:19:55 2022] POST /compute/v2.1/servers => generated 401 bytes in 784 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jun 22 10:19:56.714984 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-fa3b534a-8f6b-4cba-ac56-63ff98f09cb6 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:56.715696 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-fa3b534a-8f6b-4cba-ac56-63ff98f09cb6 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:56.716685 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-fa3b534a-8f6b-4cba-ac56-63ff98f09cb6 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:56.717124 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-fa3b534a-8f6b-4cba-ac56-63ff98f09cb6 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:56.724030 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-9bdb69dd-0d52-4fc3-888a-07f92e569b19 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Calling method '>' {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:19:56.724972 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.compute.api [None req-9bdb69dd-0d52-4fc3-888a-07f92e569b19 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] [instance: b357b60f-93be-4898-a651-4a407a7dc490] Fetching instance by UUID {{(pid=117873) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:19:56.820857 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.policy [None req-9bdb69dd-0d52-4fc3-888a-07f92e569b19 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75753b29a78640df9622d4e2655baf9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee9d603d9cc4a8797f55d544f189720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117873) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:19:56.832843 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.policy [None req-9bdb69dd-0d52-4fc3-888a-07f92e569b19 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75753b29a78640df9622d4e2655baf9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee9d603d9cc4a8797f55d544f189720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117873) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:19:56.834409 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.policy [None req-9bdb69dd-0d52-4fc3-888a-07f92e569b19 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75753b29a78640df9622d4e2655baf9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee9d603d9cc4a8797f55d544f189720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117873) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:19:56.836472 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [None req-9bdb69dd-0d52-4fc3-888a-07f92e569b19 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] 10.222.0.43 "GET /compute/v2.1/servers/b357b60f-93be-4898-a651-4a407a7dc490" status: 200 len: 1279 microversion: 2.20 time: 0.116682 Jun 22 10:19:56.837723 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 287/587] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jun 22 10:19:56 2022] GET /compute/v2.1/servers/b357b60f-93be-4898-a651-4a407a7dc490 => generated 1279 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 22 10:19:56.902900 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.policy [None req-fa3b534a-8f6b-4cba-ac56-63ff98f09cb6 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78fe3fc4334c43d7a5ef6d70f9f57523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad52333bcbec425089c44c3e55df97ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117874) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:19:56.911578 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [None req-fa3b534a-8f6b-4cba-ac56-63ff98f09cb6 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] 10.222.0.43 "GET /compute/v2.1/servers/eb851ab6-0e89-41d2-be52-d76cdc8644d6" status: 200 len: 1664 microversion: 2.1 time: 0.211529 Jun 22 10:19:56.913752 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 301/588] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:19:56 2022] GET /compute/v2.1/servers/eb851ab6-0e89-41d2-be52-d76cdc8644d6 => generated 1664 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:19:57.366073 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-33f16b2a-7011-4d9f-a6fd-ce86d9a22b31 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Calling method '>' {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:19:57.366679 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.compute.api [None req-33f16b2a-7011-4d9f-a6fd-ce86d9a22b31 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] [instance: 86a421a6-9b8c-40a9-ab7e-30b74c7bd0f3] Fetching instance by UUID {{(pid=117873) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:19:57.374168 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-33f16b2a-7011-4d9f-a6fd-ce86d9a22b31 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:57.374626 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-33f16b2a-7011-4d9f-a6fd-ce86d9a22b31 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:57.375639 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-33f16b2a-7011-4d9f-a6fd-ce86d9a22b31 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:57.376089 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-33f16b2a-7011-4d9f-a6fd-ce86d9a22b31 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:57.534339 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.policy [None req-33f16b2a-7011-4d9f-a6fd-ce86d9a22b31 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d7292401816437fba46d073c4746e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3277b9cbc4b4a8bbacee8440cea1ed2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117873) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:19:57.542561 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [None req-33f16b2a-7011-4d9f-a6fd-ce86d9a22b31 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] 10.222.0.43 "GET /compute/v2.1/servers/86a421a6-9b8c-40a9-ab7e-30b74c7bd0f3" status: 200 len: 1731 microversion: 2.1 time: 0.180835 Jun 22 10:19:57.543124 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 288/589] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:19:57 2022] GET /compute/v2.1/servers/86a421a6-9b8c-40a9-ab7e-30b74c7bd0f3 => generated 1731 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:19:57.559599 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-918ed042-5470-4feb-9b35-2e2987915035 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Calling method '>' {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:19:57.560136 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.compute.api [None req-918ed042-5470-4feb-9b35-2e2987915035 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] [instance: 86a421a6-9b8c-40a9-ab7e-30b74c7bd0f3] Fetching instance by UUID {{(pid=117874) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:19:57.567026 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-918ed042-5470-4feb-9b35-2e2987915035 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:57.567581 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-918ed042-5470-4feb-9b35-2e2987915035 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:57.568369 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-918ed042-5470-4feb-9b35-2e2987915035 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:57.568814 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-918ed042-5470-4feb-9b35-2e2987915035 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:57.650594 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [None req-918ed042-5470-4feb-9b35-2e2987915035 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] 10.222.0.43 "GET /compute/v2.1/servers/86a421a6-9b8c-40a9-ab7e-30b74c7bd0f3/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.094760 Jun 22 10:19:57.651195 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 302/590] 10.222.0.43 () {58 vars in 1274 bytes} [Wed Jun 22 10:19:57 2022] GET /compute/v2.1/servers/86a421a6-9b8c-40a9-ab7e-30b74c7bd0f3/os-interface => generated 284 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 10:19:57.854820 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-7dc57729-aed5-460e-afb9-7ea2e71b16c7 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Calling method '>' {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:19:57.855486 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.compute.api [None req-7dc57729-aed5-460e-afb9-7ea2e71b16c7 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] [instance: b357b60f-93be-4898-a651-4a407a7dc490] Fetching instance by UUID {{(pid=117873) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:19:57.861825 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-7dc57729-aed5-460e-afb9-7ea2e71b16c7 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:57.862350 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-7dc57729-aed5-460e-afb9-7ea2e71b16c7 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:57.863175 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-7dc57729-aed5-460e-afb9-7ea2e71b16c7 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:57.863672 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-7dc57729-aed5-460e-afb9-7ea2e71b16c7 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:57.929980 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-82b3d474-1044-481b-ab3b-c1fd3dfedd1c tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Calling method '>' {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:19:57.930681 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.compute.api [None req-82b3d474-1044-481b-ab3b-c1fd3dfedd1c tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] [instance: eb851ab6-0e89-41d2-be52-d76cdc8644d6] Fetching instance by UUID {{(pid=117874) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:19:57.940143 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-82b3d474-1044-481b-ab3b-c1fd3dfedd1c tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:57.942160 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-82b3d474-1044-481b-ab3b-c1fd3dfedd1c tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:57.943240 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-82b3d474-1044-481b-ab3b-c1fd3dfedd1c tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:57.944262 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-82b3d474-1044-481b-ab3b-c1fd3dfedd1c tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:57.977381 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.policy [None req-7dc57729-aed5-460e-afb9-7ea2e71b16c7 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75753b29a78640df9622d4e2655baf9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee9d603d9cc4a8797f55d544f189720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117873) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:19:57.989307 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.policy [None req-7dc57729-aed5-460e-afb9-7ea2e71b16c7 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75753b29a78640df9622d4e2655baf9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee9d603d9cc4a8797f55d544f189720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117873) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:19:57.993737 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.policy [None req-7dc57729-aed5-460e-afb9-7ea2e71b16c7 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75753b29a78640df9622d4e2655baf9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee9d603d9cc4a8797f55d544f189720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117873) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:19:57.995539 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [None req-7dc57729-aed5-460e-afb9-7ea2e71b16c7 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] 10.222.0.43 "GET /compute/v2.1/servers/b357b60f-93be-4898-a651-4a407a7dc490" status: 200 len: 1331 microversion: 2.20 time: 0.144600 Jun 22 10:19:58.006083 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 289/591] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jun 22 10:19:57 2022] GET /compute/v2.1/servers/b357b60f-93be-4898-a651-4a407a7dc490 => generated 1331 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 10:19:58.465193 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.policy [None req-82b3d474-1044-481b-ab3b-c1fd3dfedd1c tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78fe3fc4334c43d7a5ef6d70f9f57523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad52333bcbec425089c44c3e55df97ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117874) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:19:58.478812 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [None req-82b3d474-1044-481b-ab3b-c1fd3dfedd1c tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] 10.222.0.43 "GET /compute/v2.1/servers/eb851ab6-0e89-41d2-be52-d76cdc8644d6" status: 200 len: 1664 microversion: 2.1 time: 0.553820 Jun 22 10:19:58.479811 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 303/592] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:19:57 2022] GET /compute/v2.1/servers/eb851ab6-0e89-41d2-be52-d76cdc8644d6 => generated 1664 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:19:58.954099 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [req-105f11c0-c02c-46ee-93fc-be668263f476 req-e72fc534-f3b1-4002-adfd-53b29103d749 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "86a421a6-9b8c-40a9-ab7e-30b74c7bd0f3", "tag": "b3cb81b4-fc19-4acc-bb84-84c1f3b739b7"}]} {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:19:58.965332 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [req-105f11c0-c02c-46ee-93fc-be668263f476 req-e72fc534-f3b1-4002-adfd-53b29103d749 service nova] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:58.966160 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [req-105f11c0-c02c-46ee-93fc-be668263f476 req-e72fc534-f3b1-4002-adfd-53b29103d749 service nova] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:58.986632 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.compute.server_external_events [req-105f11c0-c02c-46ee-93fc-be668263f476 req-e72fc534-f3b1-4002-adfd-53b29103d749 service nova] Creating event network-changed:b3cb81b4-fc19-4acc-bb84-84c1f3b739b7 for instance 86a421a6-9b8c-40a9-ab7e-30b74c7bd0f3 on hv-cinder-84713 Jun 22 10:19:58.993552 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [req-105f11c0-c02c-46ee-93fc-be668263f476 req-e72fc534-f3b1-4002-adfd-53b29103d749 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043548 Jun 22 10:19:58.994417 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 290/593] 10.222.0.43 () {64 vars in 1317 bytes} [Wed Jun 22 10:19:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 10:19:59.016744 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-da6390f9-4dbc-499b-b14e-286e2d637845 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Calling method '>' {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:19:59.017989 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.compute.api [None req-da6390f9-4dbc-499b-b14e-286e2d637845 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] [instance: b357b60f-93be-4898-a651-4a407a7dc490] Fetching instance by UUID {{(pid=117874) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:19:59.027497 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-da6390f9-4dbc-499b-b14e-286e2d637845 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:59.028151 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-da6390f9-4dbc-499b-b14e-286e2d637845 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:59.029071 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-da6390f9-4dbc-499b-b14e-286e2d637845 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:59.030040 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-da6390f9-4dbc-499b-b14e-286e2d637845 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:59.116179 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.policy [None req-da6390f9-4dbc-499b-b14e-286e2d637845 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75753b29a78640df9622d4e2655baf9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee9d603d9cc4a8797f55d544f189720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117874) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:19:59.124986 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.policy [None req-da6390f9-4dbc-499b-b14e-286e2d637845 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75753b29a78640df9622d4e2655baf9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee9d603d9cc4a8797f55d544f189720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117874) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:19:59.127353 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.policy [None req-da6390f9-4dbc-499b-b14e-286e2d637845 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75753b29a78640df9622d4e2655baf9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee9d603d9cc4a8797f55d544f189720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117874) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:19:59.128667 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [None req-da6390f9-4dbc-499b-b14e-286e2d637845 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] 10.222.0.43 "GET /compute/v2.1/servers/b357b60f-93be-4898-a651-4a407a7dc490" status: 200 len: 1337 microversion: 2.20 time: 0.116045 Jun 22 10:19:59.129305 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 304/594] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jun 22 10:19:59 2022] GET /compute/v2.1/servers/b357b60f-93be-4898-a651-4a407a7dc490 => generated 1337 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 10:19:59.496965 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-f6cd053e-8e31-450f-bab4-70b494fda739 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Calling method '>' {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:19:59.498008 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.compute.api [None req-f6cd053e-8e31-450f-bab4-70b494fda739 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] [instance: eb851ab6-0e89-41d2-be52-d76cdc8644d6] Fetching instance by UUID {{(pid=117873) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:19:59.507726 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-f6cd053e-8e31-450f-bab4-70b494fda739 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:59.508183 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-f6cd053e-8e31-450f-bab4-70b494fda739 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:59.508961 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-f6cd053e-8e31-450f-bab4-70b494fda739 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:59.509398 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-f6cd053e-8e31-450f-bab4-70b494fda739 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:59.659997 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.policy [None req-f6cd053e-8e31-450f-bab4-70b494fda739 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78fe3fc4334c43d7a5ef6d70f9f57523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad52333bcbec425089c44c3e55df97ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117873) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:19:59.669763 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [None req-f6cd053e-8e31-450f-bab4-70b494fda739 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] 10.222.0.43 "GET /compute/v2.1/servers/eb851ab6-0e89-41d2-be52-d76cdc8644d6" status: 200 len: 1668 microversion: 2.1 time: 0.176831 Jun 22 10:19:59.670863 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 291/595] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:19:59 2022] GET /compute/v2.1/servers/eb851ab6-0e89-41d2-be52-d76cdc8644d6 => generated 1668 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:20:00.152402 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-ee18d8b2-f562-49b1-afec-92a66a739ed4 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Calling method '>' {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:20:00.153015 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.compute.api [None req-ee18d8b2-f562-49b1-afec-92a66a739ed4 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] [instance: b357b60f-93be-4898-a651-4a407a7dc490] Fetching instance by UUID {{(pid=117874) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:20:00.161179 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-ee18d8b2-f562-49b1-afec-92a66a739ed4 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:20:00.161630 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-ee18d8b2-f562-49b1-afec-92a66a739ed4 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:20:00.162429 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-ee18d8b2-f562-49b1-afec-92a66a739ed4 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:20:00.162876 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-ee18d8b2-f562-49b1-afec-92a66a739ed4 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:20:00.323292 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [req-e6e0323c-3653-42ad-8bfd-f3ff7c5afd08 req-fb82771a-f7fd-43db-8622-56fbfa30e4b9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b357b60f-93be-4898-a651-4a407a7dc490", "tag": "41dc4ae0-ddcc-4582-8858-4f23e4695e4a"}]} {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:20:00.325259 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.policy [None req-ee18d8b2-f562-49b1-afec-92a66a739ed4 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75753b29a78640df9622d4e2655baf9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee9d603d9cc4a8797f55d544f189720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117874) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:20:00.338699 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.policy [None req-ee18d8b2-f562-49b1-afec-92a66a739ed4 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75753b29a78640df9622d4e2655baf9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee9d603d9cc4a8797f55d544f189720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117874) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:20:00.342191 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.policy [None req-ee18d8b2-f562-49b1-afec-92a66a739ed4 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75753b29a78640df9622d4e2655baf9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee9d603d9cc4a8797f55d544f189720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117874) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:20:00.343614 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [None req-ee18d8b2-f562-49b1-afec-92a66a739ed4 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] 10.222.0.43 "GET /compute/v2.1/servers/b357b60f-93be-4898-a651-4a407a7dc490" status: 200 len: 1404 microversion: 2.20 time: 0.198619 Jun 22 10:20:00.347072 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 305/596] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jun 22 10:20:00 2022] GET /compute/v2.1/servers/b357b60f-93be-4898-a651-4a407a7dc490 => generated 1404 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 10:20:00.348245 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [req-e6e0323c-3653-42ad-8bfd-f3ff7c5afd08 req-fb82771a-f7fd-43db-8622-56fbfa30e4b9 service nova] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:20:00.348867 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [req-e6e0323c-3653-42ad-8bfd-f3ff7c5afd08 req-fb82771a-f7fd-43db-8622-56fbfa30e4b9 service nova] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:20:00.366513 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.compute.server_external_events [req-e6e0323c-3653-42ad-8bfd-f3ff7c5afd08 req-fb82771a-f7fd-43db-8622-56fbfa30e4b9 service nova] Creating event network-changed:41dc4ae0-ddcc-4582-8858-4f23e4695e4a for instance b357b60f-93be-4898-a651-4a407a7dc490 on hv-cinder-84713 Jun 22 10:20:00.372366 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [req-e6e0323c-3653-42ad-8bfd-f3ff7c5afd08 req-fb82771a-f7fd-43db-8622-56fbfa30e4b9 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060753 Jun 22 10:20:00.373422 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 292/597] 10.222.0.43 () {64 vars in 1317 bytes} [Wed Jun 22 10:20:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 22 10:20:01.009227 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [req-9ffa2b6e-1c05-494c-a6e8-20d71377aa3e req-17201b32-5dd8-4da4-a154-929cfcd1e9c3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "86a421a6-9b8c-40a9-ab7e-30b74c7bd0f3", "tag": "b3cb81b4-fc19-4acc-bb84-84c1f3b739b7"}]} {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:20:01.017449 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [req-9ffa2b6e-1c05-494c-a6e8-20d71377aa3e req-17201b32-5dd8-4da4-a154-929cfcd1e9c3 service nova] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:20:01.017917 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [req-9ffa2b6e-1c05-494c-a6e8-20d71377aa3e req-17201b32-5dd8-4da4-a154-929cfcd1e9c3 service nova] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:20:01.028769 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.compute.server_external_events [req-9ffa2b6e-1c05-494c-a6e8-20d71377aa3e req-17201b32-5dd8-4da4-a154-929cfcd1e9c3 service nova] Creating event network-changed:b3cb81b4-fc19-4acc-bb84-84c1f3b739b7 for instance 86a421a6-9b8c-40a9-ab7e-30b74c7bd0f3 on hv-cinder-84713 Jun 22 10:20:01.033800 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [req-9ffa2b6e-1c05-494c-a6e8-20d71377aa3e req-17201b32-5dd8-4da4-a154-929cfcd1e9c3 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028254 Jun 22 10:20:01.034386 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 306/598] 10.222.0.43 () {64 vars in 1317 bytes} [Wed Jun 22 10:20:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 10:20:01.365003 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-8e4c98ea-88fc-4df9-84a6-90485c6bfbfe tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Calling method '>' {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:20:01.365607 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.compute.api [None req-8e4c98ea-88fc-4df9-84a6-90485c6bfbfe tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] [instance: b357b60f-93be-4898-a651-4a407a7dc490] Fetching instance by UUID {{(pid=117873) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:20:01.373260 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-8e4c98ea-88fc-4df9-84a6-90485c6bfbfe tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:20:01.373735 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-8e4c98ea-88fc-4df9-84a6-90485c6bfbfe tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:20:01.374482 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-8e4c98ea-88fc-4df9-84a6-90485c6bfbfe tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:20:01.374916 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-8e4c98ea-88fc-4df9-84a6-90485c6bfbfe tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:20:01.515880 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.policy [None req-8e4c98ea-88fc-4df9-84a6-90485c6bfbfe tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75753b29a78640df9622d4e2655baf9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee9d603d9cc4a8797f55d544f189720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117873) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:20:01.534488 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.policy [None req-8e4c98ea-88fc-4df9-84a6-90485c6bfbfe tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75753b29a78640df9622d4e2655baf9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee9d603d9cc4a8797f55d544f189720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117873) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:20:01.536037 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.policy [None req-8e4c98ea-88fc-4df9-84a6-90485c6bfbfe tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75753b29a78640df9622d4e2655baf9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee9d603d9cc4a8797f55d544f189720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117873) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:20:01.537155 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [None req-8e4c98ea-88fc-4df9-84a6-90485c6bfbfe tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] 10.222.0.43 "GET /compute/v2.1/servers/b357b60f-93be-4898-a651-4a407a7dc490" status: 200 len: 1404 microversion: 2.20 time: 0.176483 Jun 22 10:20:01.537753 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 293/599] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jun 22 10:20:01 2022] GET /compute/v2.1/servers/b357b60f-93be-4898-a651-4a407a7dc490 => generated 1404 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 10:20:02.379802 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-26ba76ee-d3df-4ccf-a6a5-b407f9cce308 tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1224473116", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1986835772", "security_groups": [{"name": "tempest-secgroup-smoke-1789065302"}], "block_device_mapping_v2": [{"uuid": "b9dd562c-2b45-41ba-8033-15ca2966df92", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "96156af8-0bc3-4b6c-bec6-429f61356c8a"}]}} {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:20:02.502125 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.network.neutron [None req-26ba76ee-d3df-4ccf-a6a5-b407f9cce308 tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] validate_networks() for [('96156af8-0bc3-4b6c-bec6-429f61356c8a', None, None, None, None, None)] {{(pid=117874) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 22 10:20:02.555884 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-b64c04f6-299d-4b8d-9c0b-df029b16ca6b tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Calling method '>' {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:20:02.556575 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.compute.api [None req-b64c04f6-299d-4b8d-9c0b-df029b16ca6b tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] [instance: b357b60f-93be-4898-a651-4a407a7dc490] Fetching instance by UUID {{(pid=117873) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:20:02.566371 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-b64c04f6-299d-4b8d-9c0b-df029b16ca6b tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:20:02.567078 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-b64c04f6-299d-4b8d-9c0b-df029b16ca6b tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:20:02.569079 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-b64c04f6-299d-4b8d-9c0b-df029b16ca6b tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:20:02.570170 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-b64c04f6-299d-4b8d-9c0b-df029b16ca6b tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:20:02.798786 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.policy [None req-b64c04f6-299d-4b8d-9c0b-df029b16ca6b tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75753b29a78640df9622d4e2655baf9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee9d603d9cc4a8797f55d544f189720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117873) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:20:02.807898 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.policy [None req-b64c04f6-299d-4b8d-9c0b-df029b16ca6b tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75753b29a78640df9622d4e2655baf9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee9d603d9cc4a8797f55d544f189720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117873) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:20:02.809679 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.policy [None req-b64c04f6-299d-4b8d-9c0b-df029b16ca6b tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75753b29a78640df9622d4e2655baf9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee9d603d9cc4a8797f55d544f189720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117873) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:20:02.811327 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [None req-b64c04f6-299d-4b8d-9c0b-df029b16ca6b tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] 10.222.0.43 "GET /compute/v2.1/servers/b357b60f-93be-4898-a651-4a407a7dc490" status: 200 len: 1404 microversion: 2.20 time: 0.259359 Jun 22 10:20:02.822444 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 294/600] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jun 22 10:20:02 2022] GET /compute/v2.1/servers/b357b60f-93be-4898-a651-4a407a7dc490 => generated 1404 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 10:20:03.027074 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.virt.hardware [None req-26ba76ee-d3df-4ccf-a6a5-b407f9cce308 tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] Flavor limits 0:0:0 {{(pid=117874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 22 10:20:03.027494 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.virt.hardware [None req-26ba76ee-d3df-4ccf-a6a5-b407f9cce308 tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] Image limits 0:0:0 {{(pid=117874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 22 10:20:03.027959 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.virt.hardware [None req-26ba76ee-d3df-4ccf-a6a5-b407f9cce308 tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] Flavor pref 0:0:0 {{(pid=117874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 22 10:20:03.028362 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.virt.hardware [None req-26ba76ee-d3df-4ccf-a6a5-b407f9cce308 tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] Image pref 0:0:0 {{(pid=117874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 22 10:20:03.028766 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.virt.hardware [None req-26ba76ee-d3df-4ccf-a6a5-b407f9cce308 tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 22 10:20:03.041219 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-26ba76ee-d3df-4ccf-a6a5-b407f9cce308 tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:20:03.041882 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-26ba76ee-d3df-4ccf-a6a5-b407f9cce308 tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:20:03.042673 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-26ba76ee-d3df-4ccf-a6a5-b407f9cce308 tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:20:03.043102 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-26ba76ee-d3df-4ccf-a6a5-b407f9cce308 tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:20:03.061266 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.quota [None req-26ba76ee-d3df-4ccf-a6a5-b407f9cce308 tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] Getting quotas for project 1cb1af845e594466b12a11b7cab99a7c. Resources: {'instances', 'cores', 'ram'} {{(pid=117874) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 22 10:20:03.065660 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.quota [None req-26ba76ee-d3df-4ccf-a6a5-b407f9cce308 tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] Getting quotas for user b2d3aa18a0a146808f584127411a1cf5 and project 1cb1af845e594466b12a11b7cab99a7c. Resources: {'instances', 'cores', 'ram'} {{(pid=117874) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 22 10:20:03.126840 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.compute.api [None req-26ba76ee-d3df-4ccf-a6a5-b407f9cce308 tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] Going to run 1 instances... {{(pid=117874) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 22 10:20:03.128984 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.compute.api [None req-26ba76ee-d3df-4ccf-a6a5-b407f9cce308 tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] [instance: 28c617f3-3db0-484a-9d66-15fef4010ec4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='b9dd562c-2b45-41ba-8033-15ca2966df92',volume_size=None,volume_type=None)] {{(pid=117874) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 22 10:20:03.260733 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [None req-26ba76ee-d3df-4ccf-a6a5-b407f9cce308 tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.886847 Jun 22 10:20:03.261390 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 307/601] 10.222.0.43 () {60 vars in 1146 bytes} [Wed Jun 22 10:20:02 2022] POST /compute/v2.1/servers => generated 406 bytes in 888 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 22 10:20:03.272735 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-c5433554-690a-42d2-a6ee-e90ac20f194a tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] Calling method '>' {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:20:03.273443 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.compute.api [None req-c5433554-690a-42d2-a6ee-e90ac20f194a tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] [instance: 28c617f3-3db0-484a-9d66-15fef4010ec4] Fetching instance by UUID {{(pid=117873) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:20:03.332186 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.policy [None req-c5433554-690a-42d2-a6ee-e90ac20f194a tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2d3aa18a0a146808f584127411a1cf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1af845e594466b12a11b7cab99a7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117873) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:20:03.340484 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [None req-c5433554-690a-42d2-a6ee-e90ac20f194a tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] 10.222.0.43 "GET /compute/v2.1/servers/28c617f3-3db0-484a-9d66-15fef4010ec4" status: 200 len: 1095 microversion: 2.1 time: 0.071534 Jun 22 10:20:03.341064 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 295/602] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:20:03 2022] GET /compute/v2.1/servers/28c617f3-3db0-484a-9d66-15fef4010ec4 => generated 1095 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 10:20:03.833210 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-888d659f-5493-4256-b73f-3c3d5365d1d8 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Calling method '>' {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:20:03.833825 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.compute.api [None req-888d659f-5493-4256-b73f-3c3d5365d1d8 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] [instance: b357b60f-93be-4898-a651-4a407a7dc490] Fetching instance by UUID {{(pid=117874) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:20:03.841571 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-888d659f-5493-4256-b73f-3c3d5365d1d8 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:20:03.842077 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-888d659f-5493-4256-b73f-3c3d5365d1d8 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:20:03.842858 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-888d659f-5493-4256-b73f-3c3d5365d1d8 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:20:03.843299 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-888d659f-5493-4256-b73f-3c3d5365d1d8 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:20:03.989230 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.policy [None req-888d659f-5493-4256-b73f-3c3d5365d1d8 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75753b29a78640df9622d4e2655baf9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee9d603d9cc4a8797f55d544f189720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117874) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:20:03.993027 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG dbcounter [-] [117874] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:20:03.998506 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.policy [None req-888d659f-5493-4256-b73f-3c3d5365d1d8 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75753b29a78640df9622d4e2655baf9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee9d603d9cc4a8797f55d544f189720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117874) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:20:04.000066 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.policy [None req-888d659f-5493-4256-b73f-3c3d5365d1d8 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75753b29a78640df9622d4e2655baf9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee9d603d9cc4a8797f55d544f189720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117874) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:20:04.001776 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [None req-888d659f-5493-4256-b73f-3c3d5365d1d8 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] 10.222.0.43 "GET /compute/v2.1/servers/b357b60f-93be-4898-a651-4a407a7dc490" status: 200 len: 1404 microversion: 2.20 time: 0.174802 Jun 22 10:20:04.002344 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 308/603] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jun 22 10:20:03 2022] GET /compute/v2.1/servers/b357b60f-93be-4898-a651-4a407a7dc490 => generated 1404 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 10:20:04.357625 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-73172847-7463-42cc-97c7-1501de7e364d tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] Calling method '>' {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:20:04.358194 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.compute.api [None req-73172847-7463-42cc-97c7-1501de7e364d tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] [instance: 28c617f3-3db0-484a-9d66-15fef4010ec4] Fetching instance by UUID {{(pid=117873) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:20:04.365176 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-73172847-7463-42cc-97c7-1501de7e364d tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:20:04.365608 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-73172847-7463-42cc-97c7-1501de7e364d tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:20:04.366469 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-73172847-7463-42cc-97c7-1501de7e364d tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:20:04.366821 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-73172847-7463-42cc-97c7-1501de7e364d tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:20:04.434271 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.policy [None req-73172847-7463-42cc-97c7-1501de7e364d tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2d3aa18a0a146808f584127411a1cf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1af845e594466b12a11b7cab99a7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117873) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:20:04.443230 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [None req-73172847-7463-42cc-97c7-1501de7e364d tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] 10.222.0.43 "GET /compute/v2.1/servers/28c617f3-3db0-484a-9d66-15fef4010ec4" status: 200 len: 1211 microversion: 2.1 time: 0.089447 Jun 22 10:20:04.447204 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 296/604] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:20:04 2022] GET /compute/v2.1/servers/28c617f3-3db0-484a-9d66-15fef4010ec4 => generated 1211 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:20:05.021235 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-112beb0b-8909-4ae7-a7ea-855bd68b4982 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Calling method '>' {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:20:05.021870 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.compute.api [None req-112beb0b-8909-4ae7-a7ea-855bd68b4982 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] [instance: b357b60f-93be-4898-a651-4a407a7dc490] Fetching instance by UUID {{(pid=117874) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:20:05.024889 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG dbcounter [-] [117874] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=5,nova_api:UPDATE=1 {{(pid=117874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:20:05.033035 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-112beb0b-8909-4ae7-a7ea-855bd68b4982 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:20:05.033828 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-112beb0b-8909-4ae7-a7ea-855bd68b4982 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:20:05.035198 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-112beb0b-8909-4ae7-a7ea-855bd68b4982 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:20:05.035912 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-112beb0b-8909-4ae7-a7ea-855bd68b4982 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:20:05.193860 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.policy [None req-112beb0b-8909-4ae7-a7ea-855bd68b4982 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75753b29a78640df9622d4e2655baf9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee9d603d9cc4a8797f55d544f189720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117874) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:20:05.210680 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.policy [None req-112beb0b-8909-4ae7-a7ea-855bd68b4982 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75753b29a78640df9622d4e2655baf9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee9d603d9cc4a8797f55d544f189720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117874) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:20:05.212086 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.policy [None req-112beb0b-8909-4ae7-a7ea-855bd68b4982 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75753b29a78640df9622d4e2655baf9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee9d603d9cc4a8797f55d544f189720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117874) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:20:05.213180 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [None req-112beb0b-8909-4ae7-a7ea-855bd68b4982 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] 10.222.0.43 "GET /compute/v2.1/servers/b357b60f-93be-4898-a651-4a407a7dc490" status: 200 len: 1404 microversion: 2.20 time: 0.196227 Jun 22 10:20:05.213748 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 309/605] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jun 22 10:20:05 2022] GET /compute/v2.1/servers/b357b60f-93be-4898-a651-4a407a7dc490 => generated 1404 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 10:20:05.464862 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-d85b6c50-c147-4406-9396-e15923cf42b9 tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] Calling method '>' {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:20:05.466105 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.compute.api [None req-d85b6c50-c147-4406-9396-e15923cf42b9 tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] [instance: 28c617f3-3db0-484a-9d66-15fef4010ec4] Fetching instance by UUID {{(pid=117873) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:20:05.473375 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-d85b6c50-c147-4406-9396-e15923cf42b9 tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:20:05.474179 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-d85b6c50-c147-4406-9396-e15923cf42b9 tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:20:05.475173 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-d85b6c50-c147-4406-9396-e15923cf42b9 tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:20:05.475836 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-d85b6c50-c147-4406-9396-e15923cf42b9 tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:20:05.649552 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.policy [None req-d85b6c50-c147-4406-9396-e15923cf42b9 tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2d3aa18a0a146808f584127411a1cf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1af845e594466b12a11b7cab99a7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117873) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:20:05.658461 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [None req-d85b6c50-c147-4406-9396-e15923cf42b9 tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] 10.222.0.43 "GET /compute/v2.1/servers/28c617f3-3db0-484a-9d66-15fef4010ec4" status: 200 len: 1267 microversion: 2.1 time: 0.197047 Jun 22 10:20:05.659619 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 297/606] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:20:05 2022] GET /compute/v2.1/servers/28c617f3-3db0-484a-9d66-15fef4010ec4 => generated 1267 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:20:05.668624 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [req-1b087c76-42eb-4c8e-83fe-c6f398a0f5e2 req-b45bc0c7-1774-480d-84bd-a1a622f9263f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b357b60f-93be-4898-a651-4a407a7dc490", "name": "network-vif-plugged", "status": "completed", "tag": "41dc4ae0-ddcc-4582-8858-4f23e4695e4a"}]} {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:20:05.681274 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [req-1b087c76-42eb-4c8e-83fe-c6f398a0f5e2 req-b45bc0c7-1774-480d-84bd-a1a622f9263f service nova] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:20:05.682109 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [req-1b087c76-42eb-4c8e-83fe-c6f398a0f5e2 req-b45bc0c7-1774-480d-84bd-a1a622f9263f service nova] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:20:05.697140 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.compute.server_external_events [req-1b087c76-42eb-4c8e-83fe-c6f398a0f5e2 req-b45bc0c7-1774-480d-84bd-a1a622f9263f service nova] Creating event network-vif-plugged:41dc4ae0-ddcc-4582-8858-4f23e4695e4a for instance b357b60f-93be-4898-a651-4a407a7dc490 on hv-cinder-84713 Jun 22 10:20:05.702830 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [req-1b087c76-42eb-4c8e-83fe-c6f398a0f5e2 req-b45bc0c7-1774-480d-84bd-a1a622f9263f service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047937 Jun 22 10:20:05.705278 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 310/607] 10.222.0.43 () {64 vars in 1317 bytes} [Wed Jun 22 10:20:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 22 10:20:05.774468 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [req-7a9f38dd-d11a-415c-a385-f4f3a68bd9de req-501e4085-42a0-4465-ab43-41fe0f51164b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "28c617f3-3db0-484a-9d66-15fef4010ec4", "tag": "13d80eb1-6fcf-4d7d-864a-8e6485a20811"}]} {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:20:05.790935 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [req-7a9f38dd-d11a-415c-a385-f4f3a68bd9de req-501e4085-42a0-4465-ab43-41fe0f51164b service nova] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:20:05.791969 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [req-7a9f38dd-d11a-415c-a385-f4f3a68bd9de req-501e4085-42a0-4465-ab43-41fe0f51164b service nova] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:20:05.809070 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.compute.server_external_events [req-7a9f38dd-d11a-415c-a385-f4f3a68bd9de req-501e4085-42a0-4465-ab43-41fe0f51164b service nova] Creating event network-changed:13d80eb1-6fcf-4d7d-864a-8e6485a20811 for instance 28c617f3-3db0-484a-9d66-15fef4010ec4 on hv-cinder-84713 Jun 22 10:20:05.815110 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [req-7a9f38dd-d11a-415c-a385-f4f3a68bd9de req-501e4085-42a0-4465-ab43-41fe0f51164b service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044925 Jun 22 10:20:05.815907 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 298/608] 10.222.0.43 () {64 vars in 1317 bytes} [Wed Jun 22 10:20:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 10:20:06.233510 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-19da1a66-0fa1-4526-a139-813c6be0a329 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Calling method '>' {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:20:06.234819 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.compute.api [None req-19da1a66-0fa1-4526-a139-813c6be0a329 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] [instance: b357b60f-93be-4898-a651-4a407a7dc490] Fetching instance by UUID {{(pid=117874) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:20:06.242077 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-19da1a66-0fa1-4526-a139-813c6be0a329 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:20:06.242762 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-19da1a66-0fa1-4526-a139-813c6be0a329 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:20:06.243637 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-19da1a66-0fa1-4526-a139-813c6be0a329 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:20:06.244077 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-19da1a66-0fa1-4526-a139-813c6be0a329 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:20:06.403103 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.policy [None req-19da1a66-0fa1-4526-a139-813c6be0a329 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75753b29a78640df9622d4e2655baf9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee9d603d9cc4a8797f55d544f189720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117874) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:20:06.412782 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.policy [None req-19da1a66-0fa1-4526-a139-813c6be0a329 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75753b29a78640df9622d4e2655baf9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee9d603d9cc4a8797f55d544f189720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117874) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:20:06.414318 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.policy [None req-19da1a66-0fa1-4526-a139-813c6be0a329 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75753b29a78640df9622d4e2655baf9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee9d603d9cc4a8797f55d544f189720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117874) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:20:06.415433 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [None req-19da1a66-0fa1-4526-a139-813c6be0a329 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] 10.222.0.43 "GET /compute/v2.1/servers/b357b60f-93be-4898-a651-4a407a7dc490" status: 200 len: 1404 microversion: 2.20 time: 0.187468 Jun 22 10:20:06.415988 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 311/609] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jun 22 10:20:06 2022] GET /compute/v2.1/servers/b357b60f-93be-4898-a651-4a407a7dc490 => generated 1404 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 10:20:06.675660 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-a0e45e6c-cb79-481c-bd6b-132beee84c46 tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] Calling method '>' {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:20:06.676344 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.compute.api [None req-a0e45e6c-cb79-481c-bd6b-132beee84c46 tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] [instance: 28c617f3-3db0-484a-9d66-15fef4010ec4] Fetching instance by UUID {{(pid=117873) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:20:06.678753 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG dbcounter [-] [117873] Writing DB stats nova_cell0:SELECT=2 {{(pid=117873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:20:06.684797 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-a0e45e6c-cb79-481c-bd6b-132beee84c46 tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:20:06.685309 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-a0e45e6c-cb79-481c-bd6b-132beee84c46 tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:20:06.686147 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-a0e45e6c-cb79-481c-bd6b-132beee84c46 tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:20:06.686575 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-a0e45e6c-cb79-481c-bd6b-132beee84c46 tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:20:06.833722 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.policy [None req-a0e45e6c-cb79-481c-bd6b-132beee84c46 tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2d3aa18a0a146808f584127411a1cf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1af845e594466b12a11b7cab99a7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117873) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:20:06.835919 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG dbcounter [-] [117873] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:20:06.842209 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [None req-a0e45e6c-cb79-481c-bd6b-132beee84c46 tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] 10.222.0.43 "GET /compute/v2.1/servers/28c617f3-3db0-484a-9d66-15fef4010ec4" status: 200 len: 1267 microversion: 2.1 time: 0.170921 Jun 22 10:20:06.842777 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 299/610] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:20:06 2022] GET /compute/v2.1/servers/28c617f3-3db0-484a-9d66-15fef4010ec4 => generated 1267 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:20:07.434906 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-25c3dac6-4465-4cd1-92f9-0cdaac294ef7 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Calling method '>' {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:20:07.435510 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.compute.api [None req-25c3dac6-4465-4cd1-92f9-0cdaac294ef7 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] [instance: b357b60f-93be-4898-a651-4a407a7dc490] Fetching instance by UUID {{(pid=117874) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:20:07.443918 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-25c3dac6-4465-4cd1-92f9-0cdaac294ef7 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:20:07.444366 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-25c3dac6-4465-4cd1-92f9-0cdaac294ef7 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:20:07.445129 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-25c3dac6-4465-4cd1-92f9-0cdaac294ef7 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:20:07.445564 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-25c3dac6-4465-4cd1-92f9-0cdaac294ef7 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:20:07.574304 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.policy [None req-25c3dac6-4465-4cd1-92f9-0cdaac294ef7 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75753b29a78640df9622d4e2655baf9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee9d603d9cc4a8797f55d544f189720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117874) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:20:07.582955 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.policy [None req-25c3dac6-4465-4cd1-92f9-0cdaac294ef7 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75753b29a78640df9622d4e2655baf9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee9d603d9cc4a8797f55d544f189720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117874) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:20:07.584649 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.policy [None req-25c3dac6-4465-4cd1-92f9-0cdaac294ef7 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75753b29a78640df9622d4e2655baf9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee9d603d9cc4a8797f55d544f189720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117874) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:20:07.586020 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [None req-25c3dac6-4465-4cd1-92f9-0cdaac294ef7 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] 10.222.0.43 "GET /compute/v2.1/servers/b357b60f-93be-4898-a651-4a407a7dc490" status: 200 len: 1596 microversion: 2.20 time: 0.154935 Jun 22 10:20:07.586580 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 312/611] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jun 22 10:20:07 2022] GET /compute/v2.1/servers/b357b60f-93be-4898-a651-4a407a7dc490 => generated 1596 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 10:20:07.604678 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-ff4ffa6b-cc46-43e7-ac78-e21d33513722 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Calling method '>' {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:20:07.605161 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.compute.api [None req-ff4ffa6b-cc46-43e7-ac78-e21d33513722 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] [instance: b357b60f-93be-4898-a651-4a407a7dc490] Fetching instance by UUID {{(pid=117873) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:20:07.613170 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-ff4ffa6b-cc46-43e7-ac78-e21d33513722 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:20:07.613617 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-ff4ffa6b-cc46-43e7-ac78-e21d33513722 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:20:07.614402 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-ff4ffa6b-cc46-43e7-ac78-e21d33513722 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:20:07.614843 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-ff4ffa6b-cc46-43e7-ac78-e21d33513722 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:20:07.694893 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [None req-ff4ffa6b-cc46-43e7-ac78-e21d33513722 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] 10.222.0.43 "GET /compute/v2.1/servers/b357b60f-93be-4898-a651-4a407a7dc490/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.094943 Jun 22 10:20:07.695520 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 300/612] 10.222.0.43 () {60 vars in 1315 bytes} [Wed Jun 22 10:20:07 2022] GET /compute/v2.1/servers/b357b60f-93be-4898-a651-4a407a7dc490/os-interface => generated 284 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 22 10:20:07.859521 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-0fc9aa40-c7fd-4386-bda3-59537f542cf7 tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] Calling method '>' {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:20:07.861578 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.compute.api [None req-0fc9aa40-c7fd-4386-bda3-59537f542cf7 tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] [instance: 28c617f3-3db0-484a-9d66-15fef4010ec4] Fetching instance by UUID {{(pid=117874) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:20:07.866705 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-0fc9aa40-c7fd-4386-bda3-59537f542cf7 tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:20:07.867226 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-0fc9aa40-c7fd-4386-bda3-59537f542cf7 tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:20:07.868283 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-0fc9aa40-c7fd-4386-bda3-59537f542cf7 tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:20:07.868634 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-0fc9aa40-c7fd-4386-bda3-59537f542cf7 tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:20:08.181083 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.policy [None req-0fc9aa40-c7fd-4386-bda3-59537f542cf7 tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2d3aa18a0a146808f584127411a1cf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1af845e594466b12a11b7cab99a7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117874) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:20:08.189933 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [None req-0fc9aa40-c7fd-4386-bda3-59537f542cf7 tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] 10.222.0.43 "GET /compute/v2.1/servers/28c617f3-3db0-484a-9d66-15fef4010ec4" status: 200 len: 1267 microversion: 2.1 time: 0.334512 Jun 22 10:20:08.190777 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 313/613] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:20:07 2022] GET /compute/v2.1/servers/28c617f3-3db0-484a-9d66-15fef4010ec4 => generated 1267 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:20:08.961929 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [req-e68a76ca-dc7b-4437-92dd-a005ffc7cf4e req-c896adad-b192-47b7-835c-3a0b9c7f959d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b357b60f-93be-4898-a651-4a407a7dc490", "tag": "41dc4ae0-ddcc-4582-8858-4f23e4695e4a"}]} {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:20:08.971910 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [req-e68a76ca-dc7b-4437-92dd-a005ffc7cf4e req-c896adad-b192-47b7-835c-3a0b9c7f959d service nova] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:20:08.972447 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [req-e68a76ca-dc7b-4437-92dd-a005ffc7cf4e req-c896adad-b192-47b7-835c-3a0b9c7f959d service nova] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:20:08.986255 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.compute.server_external_events [req-e68a76ca-dc7b-4437-92dd-a005ffc7cf4e req-c896adad-b192-47b7-835c-3a0b9c7f959d service nova] Creating event network-changed:41dc4ae0-ddcc-4582-8858-4f23e4695e4a for instance b357b60f-93be-4898-a651-4a407a7dc490 on hv-cinder-84713 Jun 22 10:20:08.992041 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [req-e68a76ca-dc7b-4437-92dd-a005ffc7cf4e req-c896adad-b192-47b7-835c-3a0b9c7f959d service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034187 Jun 22 10:20:08.992833 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 301/614] 10.222.0.43 () {64 vars in 1317 bytes} [Wed Jun 22 10:20:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 22 10:20:09.207111 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-fef22ac8-faf8-4b0b-b853-384ad8213b42 tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] Calling method '>' {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:20:09.208026 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.compute.api [None req-fef22ac8-faf8-4b0b-b853-384ad8213b42 tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] [instance: 28c617f3-3db0-484a-9d66-15fef4010ec4] Fetching instance by UUID {{(pid=117874) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:20:09.215406 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-fef22ac8-faf8-4b0b-b853-384ad8213b42 tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:20:09.215984 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-fef22ac8-faf8-4b0b-b853-384ad8213b42 tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:20:09.216976 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-fef22ac8-faf8-4b0b-b853-384ad8213b42 tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:20:09.217412 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-fef22ac8-faf8-4b0b-b853-384ad8213b42 tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:20:09.358382 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.policy [None req-fef22ac8-faf8-4b0b-b853-384ad8213b42 tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2d3aa18a0a146808f584127411a1cf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1af845e594466b12a11b7cab99a7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117874) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:20:09.365918 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [None req-fef22ac8-faf8-4b0b-b853-384ad8213b42 tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] 10.222.0.43 "GET /compute/v2.1/servers/28c617f3-3db0-484a-9d66-15fef4010ec4" status: 200 len: 1267 microversion: 2.1 time: 0.162933 Jun 22 10:20:09.366491 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 314/615] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:20:09 2022] GET /compute/v2.1/servers/28c617f3-3db0-484a-9d66-15fef4010ec4 => generated 1267 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:20:10.384239 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-4d282f3a-75b3-41cf-ab27-0361f5b022e6 tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] Calling method '>' {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:20:10.385146 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.compute.api [None req-4d282f3a-75b3-41cf-ab27-0361f5b022e6 tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] [instance: 28c617f3-3db0-484a-9d66-15fef4010ec4] Fetching instance by UUID {{(pid=117873) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:20:10.393950 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-4d282f3a-75b3-41cf-ab27-0361f5b022e6 tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:20:10.394425 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-4d282f3a-75b3-41cf-ab27-0361f5b022e6 tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:20:10.395191 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-4d282f3a-75b3-41cf-ab27-0361f5b022e6 tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:20:10.395630 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-4d282f3a-75b3-41cf-ab27-0361f5b022e6 tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:20:10.537680 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.policy [None req-4d282f3a-75b3-41cf-ab27-0361f5b022e6 tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2d3aa18a0a146808f584127411a1cf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1af845e594466b12a11b7cab99a7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117873) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:20:10.545358 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [None req-4d282f3a-75b3-41cf-ab27-0361f5b022e6 tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] 10.222.0.43 "GET /compute/v2.1/servers/28c617f3-3db0-484a-9d66-15fef4010ec4" status: 200 len: 1267 microversion: 2.1 time: 0.165466 Jun 22 10:20:10.546113 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 302/616] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:20:10 2022] GET /compute/v2.1/servers/28c617f3-3db0-484a-9d66-15fef4010ec4 => generated 1267 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:20:11.562829 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-78d31b9c-c994-41d4-9ab6-d627f521cb51 tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] Calling method '>' {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:20:11.563429 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.compute.api [None req-78d31b9c-c994-41d4-9ab6-d627f521cb51 tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] [instance: 28c617f3-3db0-484a-9d66-15fef4010ec4] Fetching instance by UUID {{(pid=117874) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:20:11.569944 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-78d31b9c-c994-41d4-9ab6-d627f521cb51 tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:20:11.570391 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-78d31b9c-c994-41d4-9ab6-d627f521cb51 tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:20:11.571151 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-78d31b9c-c994-41d4-9ab6-d627f521cb51 tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:20:11.571586 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-78d31b9c-c994-41d4-9ab6-d627f521cb51 tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:20:11.699675 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.policy [None req-78d31b9c-c994-41d4-9ab6-d627f521cb51 tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2d3aa18a0a146808f584127411a1cf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1af845e594466b12a11b7cab99a7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117874) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:20:11.707568 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [None req-78d31b9c-c994-41d4-9ab6-d627f521cb51 tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] 10.222.0.43 "GET /compute/v2.1/servers/28c617f3-3db0-484a-9d66-15fef4010ec4" status: 200 len: 1267 microversion: 2.1 time: 0.148593 Jun 22 10:20:11.708132 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 315/617] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:20:11 2022] GET /compute/v2.1/servers/28c617f3-3db0-484a-9d66-15fef4010ec4 => generated 1267 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:20:12.724561 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-4196f50b-7630-4274-9753-5de82057bf7d tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] Calling method '>' {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:20:12.725169 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.compute.api [None req-4196f50b-7630-4274-9753-5de82057bf7d tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] [instance: 28c617f3-3db0-484a-9d66-15fef4010ec4] Fetching instance by UUID {{(pid=117873) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:20:12.732000 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-4196f50b-7630-4274-9753-5de82057bf7d tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:20:12.732445 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-4196f50b-7630-4274-9753-5de82057bf7d tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:20:12.733214 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-4196f50b-7630-4274-9753-5de82057bf7d tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:20:12.733651 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-4196f50b-7630-4274-9753-5de82057bf7d tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:20:12.867157 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.policy [None req-4196f50b-7630-4274-9753-5de82057bf7d tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2d3aa18a0a146808f584127411a1cf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1af845e594466b12a11b7cab99a7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117873) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:20:12.875958 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [None req-4196f50b-7630-4274-9753-5de82057bf7d tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] 10.222.0.43 "GET /compute/v2.1/servers/28c617f3-3db0-484a-9d66-15fef4010ec4" status: 200 len: 1267 microversion: 2.1 time: 0.154101 Jun 22 10:20:12.876550 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 303/618] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:20:12 2022] GET /compute/v2.1/servers/28c617f3-3db0-484a-9d66-15fef4010ec4 => generated 1267 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:20:13.892998 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-c6da5621-52a3-49c0-95d2-c19da725b420 tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] Calling method '>' {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:20:13.893747 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.compute.api [None req-c6da5621-52a3-49c0-95d2-c19da725b420 tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] [instance: 28c617f3-3db0-484a-9d66-15fef4010ec4] Fetching instance by UUID {{(pid=117874) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:20:13.895716 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG dbcounter [-] [117874] Writing DB stats nova_cell0:SELECT=2 {{(pid=117874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:20:13.896373 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG dbcounter [-] [117874] Writing DB stats nova_cell0:SELECT=14 {{(pid=117874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:20:13.902499 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-c6da5621-52a3-49c0-95d2-c19da725b420 tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:20:13.902946 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-c6da5621-52a3-49c0-95d2-c19da725b420 tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:20:13.903704 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-c6da5621-52a3-49c0-95d2-c19da725b420 tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:20:13.904135 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-c6da5621-52a3-49c0-95d2-c19da725b420 tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:20:14.043595 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.policy [None req-c6da5621-52a3-49c0-95d2-c19da725b420 tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2d3aa18a0a146808f584127411a1cf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1af845e594466b12a11b7cab99a7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117874) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:20:14.051579 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [None req-c6da5621-52a3-49c0-95d2-c19da725b420 tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] 10.222.0.43 "GET /compute/v2.1/servers/28c617f3-3db0-484a-9d66-15fef4010ec4" status: 200 len: 1267 microversion: 2.1 time: 0.162820 Jun 22 10:20:14.052140 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 316/619] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:20:13 2022] GET /compute/v2.1/servers/28c617f3-3db0-484a-9d66-15fef4010ec4 => generated 1267 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:20:15.069198 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-f1d3d873-6c42-43d4-be5c-2140341824d4 tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] Calling method '>' {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:20:15.069872 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.compute.api [None req-f1d3d873-6c42-43d4-be5c-2140341824d4 tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] [instance: 28c617f3-3db0-484a-9d66-15fef4010ec4] Fetching instance by UUID {{(pid=117873) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:20:15.071764 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG dbcounter [-] [117873] Writing DB stats nova_cell0:SELECT=10 {{(pid=117873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:20:15.072929 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG dbcounter [-] [117873] Writing DB stats nova_api:SELECT=96,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=117873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:20:15.079694 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-f1d3d873-6c42-43d4-be5c-2140341824d4 tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:20:15.080132 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-f1d3d873-6c42-43d4-be5c-2140341824d4 tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:20:15.080895 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-f1d3d873-6c42-43d4-be5c-2140341824d4 tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:20:15.081320 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-f1d3d873-6c42-43d4-be5c-2140341824d4 tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:20:15.214063 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.policy [None req-f1d3d873-6c42-43d4-be5c-2140341824d4 tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2d3aa18a0a146808f584127411a1cf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1af845e594466b12a11b7cab99a7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117873) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:20:15.221658 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [None req-f1d3d873-6c42-43d4-be5c-2140341824d4 tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] 10.222.0.43 "GET /compute/v2.1/servers/28c617f3-3db0-484a-9d66-15fef4010ec4" status: 200 len: 1267 microversion: 2.1 time: 0.156270 Jun 22 10:20:15.222262 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 304/620] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:20:15 2022] GET /compute/v2.1/servers/28c617f3-3db0-484a-9d66-15fef4010ec4 => generated 1267 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:20:16.238870 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-41ff2e09-def7-4c92-922e-bf802451e07b tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] Calling method '>' {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:20:16.239492 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.compute.api [None req-41ff2e09-def7-4c92-922e-bf802451e07b tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] [instance: 28c617f3-3db0-484a-9d66-15fef4010ec4] Fetching instance by UUID {{(pid=117874) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:20:16.246420 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-41ff2e09-def7-4c92-922e-bf802451e07b tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:20:16.246874 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-41ff2e09-def7-4c92-922e-bf802451e07b tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:20:16.247653 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-41ff2e09-def7-4c92-922e-bf802451e07b tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:20:16.248087 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-41ff2e09-def7-4c92-922e-bf802451e07b tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:20:16.396973 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.policy [None req-41ff2e09-def7-4c92-922e-bf802451e07b tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2d3aa18a0a146808f584127411a1cf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1af845e594466b12a11b7cab99a7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117874) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:20:16.404446 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [None req-41ff2e09-def7-4c92-922e-bf802451e07b tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] 10.222.0.43 "GET /compute/v2.1/servers/28c617f3-3db0-484a-9d66-15fef4010ec4" status: 200 len: 1267 microversion: 2.1 time: 0.169611 Jun 22 10:20:16.405015 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 317/621] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:20:16 2022] GET /compute/v2.1/servers/28c617f3-3db0-484a-9d66-15fef4010ec4 => generated 1267 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:20:17.420840 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-d7247ddc-61ac-48cb-9726-4c356d7c4f87 tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] Calling method '>' {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:20:17.421934 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.compute.api [None req-d7247ddc-61ac-48cb-9726-4c356d7c4f87 tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] [instance: 28c617f3-3db0-484a-9d66-15fef4010ec4] Fetching instance by UUID {{(pid=117873) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:20:17.429789 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-d7247ddc-61ac-48cb-9726-4c356d7c4f87 tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:20:17.430317 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-d7247ddc-61ac-48cb-9726-4c356d7c4f87 tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:20:17.431010 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-d7247ddc-61ac-48cb-9726-4c356d7c4f87 tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:20:17.431441 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-d7247ddc-61ac-48cb-9726-4c356d7c4f87 tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:20:17.574672 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [req-9d0f9b86-93ba-4ee6-937b-ec7923315195 req-1530741f-cf9a-4a61-a9b1-bb1dd94df0aa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "28c617f3-3db0-484a-9d66-15fef4010ec4", "name": "network-vif-plugged", "status": "completed", "tag": "13d80eb1-6fcf-4d7d-864a-8e6485a20811"}]} {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:20:17.581373 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.policy [None req-d7247ddc-61ac-48cb-9726-4c356d7c4f87 tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2d3aa18a0a146808f584127411a1cf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1af845e594466b12a11b7cab99a7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117873) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:20:17.592132 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [req-9d0f9b86-93ba-4ee6-937b-ec7923315195 req-1530741f-cf9a-4a61-a9b1-bb1dd94df0aa service nova] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:20:17.592132 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [req-9d0f9b86-93ba-4ee6-937b-ec7923315195 req-1530741f-cf9a-4a61-a9b1-bb1dd94df0aa service nova] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:20:17.592858 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [None req-d7247ddc-61ac-48cb-9726-4c356d7c4f87 tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] 10.222.0.43 "GET /compute/v2.1/servers/28c617f3-3db0-484a-9d66-15fef4010ec4" status: 200 len: 1267 microversion: 2.1 time: 0.176049 Jun 22 10:20:17.593449 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 305/622] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:20:17 2022] GET /compute/v2.1/servers/28c617f3-3db0-484a-9d66-15fef4010ec4 => generated 1267 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:20:17.614189 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.compute.server_external_events [req-9d0f9b86-93ba-4ee6-937b-ec7923315195 req-1530741f-cf9a-4a61-a9b1-bb1dd94df0aa service nova] Creating event network-vif-plugged:13d80eb1-6fcf-4d7d-864a-8e6485a20811 for instance 28c617f3-3db0-484a-9d66-15fef4010ec4 on hv-cinder-84713 Jun 22 10:20:17.620400 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [req-9d0f9b86-93ba-4ee6-937b-ec7923315195 req-1530741f-cf9a-4a61-a9b1-bb1dd94df0aa service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049285 Jun 22 10:20:17.621485 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 318/623] 10.222.0.43 () {64 vars in 1317 bytes} [Wed Jun 22 10:20:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 10:20:18.611442 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-fafc6429-52aa-4d43-acd4-90bc12226dd2 tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] Calling method '>' {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:20:18.612057 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.compute.api [None req-fafc6429-52aa-4d43-acd4-90bc12226dd2 tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] [instance: 28c617f3-3db0-484a-9d66-15fef4010ec4] Fetching instance by UUID {{(pid=117873) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:20:18.618419 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-fafc6429-52aa-4d43-acd4-90bc12226dd2 tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:20:18.618857 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-fafc6429-52aa-4d43-acd4-90bc12226dd2 tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:20:18.619614 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-fafc6429-52aa-4d43-acd4-90bc12226dd2 tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:20:18.620043 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-fafc6429-52aa-4d43-acd4-90bc12226dd2 tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:20:18.760350 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.policy [None req-fafc6429-52aa-4d43-acd4-90bc12226dd2 tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2d3aa18a0a146808f584127411a1cf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1af845e594466b12a11b7cab99a7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117873) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:20:18.769293 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [None req-fafc6429-52aa-4d43-acd4-90bc12226dd2 tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] 10.222.0.43 "GET /compute/v2.1/servers/28c617f3-3db0-484a-9d66-15fef4010ec4" status: 200 len: 1267 microversion: 2.1 time: 0.161968 Jun 22 10:20:18.770123 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 306/624] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:20:18 2022] GET /compute/v2.1/servers/28c617f3-3db0-484a-9d66-15fef4010ec4 => generated 1267 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:20:19.787189 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-d8c9bd7a-679a-4703-b5f0-c40735763b35 tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] Calling method '>' {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:20:19.787936 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.compute.api [None req-d8c9bd7a-679a-4703-b5f0-c40735763b35 tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] [instance: 28c617f3-3db0-484a-9d66-15fef4010ec4] Fetching instance by UUID {{(pid=117874) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:20:19.794214 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-d8c9bd7a-679a-4703-b5f0-c40735763b35 tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:20:19.794663 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-d8c9bd7a-679a-4703-b5f0-c40735763b35 tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:20:19.795427 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-d8c9bd7a-679a-4703-b5f0-c40735763b35 tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:20:19.795863 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-d8c9bd7a-679a-4703-b5f0-c40735763b35 tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:20:19.843127 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-a0216ac8-30c2-4560-b741-8f1f8d1b07fe tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Calling method '>' {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:20:19.844144 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.compute.api [None req-a0216ac8-30c2-4560-b741-8f1f8d1b07fe tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] [instance: a5d1635b-71e2-4f7c-9fcc-b6d2e9803c09] Fetching instance by UUID {{(pid=117873) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:20:19.853394 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-a0216ac8-30c2-4560-b741-8f1f8d1b07fe tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:20:19.853881 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-a0216ac8-30c2-4560-b741-8f1f8d1b07fe tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:20:19.854664 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-a0216ac8-30c2-4560-b741-8f1f8d1b07fe tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:20:19.855102 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-a0216ac8-30c2-4560-b741-8f1f8d1b07fe tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:20:19.880536 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [None req-a0216ac8-30c2-4560-b741-8f1f8d1b07fe tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] 10.222.0.43 "GET /compute/v2.1/servers/a5d1635b-71e2-4f7c-9fcc-b6d2e9803c09/ips" status: 200 len: 149 microversion: 2.1 time: 0.041623 Jun 22 10:20:19.881133 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 307/625] 10.222.0.43 () {58 vars in 1247 bytes} [Wed Jun 22 10:20:19 2022] GET /compute/v2.1/servers/a5d1635b-71e2-4f7c-9fcc-b6d2e9803c09/ips => generated 149 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 22 10:20:19.947054 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.policy [None req-d8c9bd7a-679a-4703-b5f0-c40735763b35 tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2d3aa18a0a146808f584127411a1cf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1af845e594466b12a11b7cab99a7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117874) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:20:19.954950 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [None req-d8c9bd7a-679a-4703-b5f0-c40735763b35 tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] 10.222.0.43 "GET /compute/v2.1/servers/28c617f3-3db0-484a-9d66-15fef4010ec4" status: 200 len: 1453 microversion: 2.1 time: 0.172112 Jun 22 10:20:19.955222 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 319/626] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:20:19 2022] GET /compute/v2.1/servers/28c617f3-3db0-484a-9d66-15fef4010ec4 => generated 1453 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 10:20:19.973201 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-8feb236f-e33a-401a-b8a6-17f5b8eddae4 tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] Calling method '>' {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:20:19.974023 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.compute.api [None req-8feb236f-e33a-401a-b8a6-17f5b8eddae4 tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] [instance: 28c617f3-3db0-484a-9d66-15fef4010ec4] Fetching instance by UUID {{(pid=117873) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:20:19.980676 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-8feb236f-e33a-401a-b8a6-17f5b8eddae4 tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:20:19.981122 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-8feb236f-e33a-401a-b8a6-17f5b8eddae4 tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:20:19.981957 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-8feb236f-e33a-401a-b8a6-17f5b8eddae4 tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:20:19.982394 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-8feb236f-e33a-401a-b8a6-17f5b8eddae4 tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:20:20.147352 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.policy [None req-8feb236f-e33a-401a-b8a6-17f5b8eddae4 tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2d3aa18a0a146808f584127411a1cf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1af845e594466b12a11b7cab99a7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117873) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:20:20.155225 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [None req-8feb236f-e33a-401a-b8a6-17f5b8eddae4 tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] 10.222.0.43 "GET /compute/v2.1/servers/28c617f3-3db0-484a-9d66-15fef4010ec4" status: 200 len: 1453 microversion: 2.1 time: 0.187264 Jun 22 10:20:20.155875 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 308/627] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:20:19 2022] GET /compute/v2.1/servers/28c617f3-3db0-484a-9d66-15fef4010ec4 => generated 1453 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 10:20:21.244590 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-c7e50c09-c7ad-483b-b014-37f0046836bc tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9dc1e900-f57d-4e74-adc1-a224c83aba05"}} {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:20:21.245674 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.compute.api [None req-c7e50c09-c7ad-483b-b014-37f0046836bc tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] [instance: a5d1635b-71e2-4f7c-9fcc-b6d2e9803c09] Fetching instance by UUID {{(pid=117874) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:20:21.253267 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-c7e50c09-c7ad-483b-b014-37f0046836bc tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:20:21.253735 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-c7e50c09-c7ad-483b-b014-37f0046836bc tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:20:21.254530 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-c7e50c09-c7ad-483b-b014-37f0046836bc tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:20:21.255002 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-c7e50c09-c7ad-483b-b014-37f0046836bc tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:20:21.529148 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [None req-c7e50c09-c7ad-483b-b014-37f0046836bc tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] 10.222.0.43 "POST /compute/v2.1/servers/a5d1635b-71e2-4f7c-9fcc-b6d2e9803c09/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.288440 Jun 22 10:20:21.536037 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 320/628] 10.222.0.43 () {60 vars in 1322 bytes} [Wed Jun 22 10:20:21 2022] POST /compute/v2.1/servers/a5d1635b-71e2-4f7c-9fcc-b6d2e9803c09/os-volume_attachments => generated 194 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 10:20:22.192253 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [req-2d2acfb5-e436-4488-8d88-1e845754ea5e req-d4f94878-7ced-4309-a0f0-c8f3484c50af service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "28c617f3-3db0-484a-9d66-15fef4010ec4", "tag": "13d80eb1-6fcf-4d7d-864a-8e6485a20811"}]} {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:20:22.201110 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [req-2d2acfb5-e436-4488-8d88-1e845754ea5e req-d4f94878-7ced-4309-a0f0-c8f3484c50af service nova] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:20:22.201549 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [req-2d2acfb5-e436-4488-8d88-1e845754ea5e req-d4f94878-7ced-4309-a0f0-c8f3484c50af service nova] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:20:22.214338 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.compute.server_external_events [req-2d2acfb5-e436-4488-8d88-1e845754ea5e req-d4f94878-7ced-4309-a0f0-c8f3484c50af service nova] Creating event network-changed:13d80eb1-6fcf-4d7d-864a-8e6485a20811 for instance 28c617f3-3db0-484a-9d66-15fef4010ec4 on hv-cinder-84713 Jun 22 10:20:22.219421 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [req-2d2acfb5-e436-4488-8d88-1e845754ea5e req-d4f94878-7ced-4309-a0f0-c8f3484c50af service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031770 Jun 22 10:20:22.220121 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 309/629] 10.222.0.43 () {64 vars in 1317 bytes} [Wed Jun 22 10:20:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 10:20:29.037985 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-8c7d15a6-f876-4af1-a671-dfe9e3a5412d tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9dc1e900-f57d-4e74-adc1-a224c83aba05"}} {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:20:29.039174 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.compute.api [None req-8c7d15a6-f876-4af1-a671-dfe9e3a5412d tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] [instance: a5d1635b-71e2-4f7c-9fcc-b6d2e9803c09] Fetching instance by UUID {{(pid=117874) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:20:29.045530 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-8c7d15a6-f876-4af1-a671-dfe9e3a5412d tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:20:29.045998 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-8c7d15a6-f876-4af1-a671-dfe9e3a5412d tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:20:29.046756 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-8c7d15a6-f876-4af1-a671-dfe9e3a5412d tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:20:29.047896 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-8c7d15a6-f876-4af1-a671-dfe9e3a5412d tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:20:29.133395 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.wsgi [None req-8c7d15a6-f876-4af1-a671-dfe9e3a5412d tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] HTTP exception thrown: Invalid volume: volume 9dc1e900-f57d-4e74-adc1-a224c83aba05 is already attached to instances: a5d1635b-71e2-4f7c-9fcc-b6d2e9803c09 Jun 22 10:20:29.135228 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-8c7d15a6-f876-4af1-a671-dfe9e3a5412d tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Request method failure captured: Jun 22 10:20:29.135228 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: request: POST /compute/v2.1/servers/a5d1635b-71e2-4f7c-9fcc-b6d2e9803c09/os-volume_attachments HTTP/1.1 Jun 22 10:20:29.135228 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: Accept: application/json Jun 22 10:20:29.135228 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: Accept-Encoding: identity Jun 22 10:20:29.135228 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: Connection: close Jun 22 10:20:29.135228 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: Content-Length: 74 Jun 22 10:20:29.135228 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: Content-Type: application/json Jun 22 10:20:29.135228 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: Host: 10.222.0.43 Jun 22 10:20:29.135228 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: Openstack-System-Scope: None Jun 22 10:20:29.135228 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: User-Agent: python-urllib3/1.26.9 Jun 22 10:20:29.135228 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-Auth-Token: gAAAAABisuvUpGkoSsQ9d1KNFPX834O5Ed4reiDCWeVnTPicJ3T1CXVLNJjI8u1aloRBXjMgN_RPq4rTUmL5P2islljUOvvHIwLebG3DYtPiBpBpjPn3C8o_VLQB3yNvqrLTJBaPVXC7QVZTOTIWPKqjtW_CrQ0ZdCwS1UGZXZ6Doixu1TJW9Cg Jun 22 10:20:29.135228 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-Domain-Id: None Jun 22 10:20:29.135228 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-Domain-Name: None Jun 22 10:20:29.135228 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-Identity-Status: Confirmed Jun 22 10:20:29.135228 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-Is-Admin-Project: True Jun 22 10:20:29.135228 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-Project-Domain-Id: default Jun 22 10:20:29.135228 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-Project-Domain-Name: Default Jun 22 10:20:29.135228 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-Project-Id: 78629282e2b74418a2c1cdac32576ef1 Jun 22 10:20:29.135228 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-Project-Name: tempest-AttachVolumeNegativeTest-73508829 Jun 22 10:20:29.135228 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-Role: reader,member Jun 22 10:20:29.135228 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-Roles: reader,member Jun 22 10:20:29.136768 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/78629282e2b74418a2c1cdac32576ef1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/78629282e2b74418a2c1cdac32576ef1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_78629282e2b74418a2c1cdac32576ef1", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/78629282e2b74418a2c1cdac32576ef1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}] Jun 22 10:20:29.136768 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-Tenant: tempest-AttachVolumeNegativeTest-73508829 Jun 22 10:20:29.136768 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-Tenant-Id: 78629282e2b74418a2c1cdac32576ef1 Jun 22 10:20:29.136768 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-73508829 Jun 22 10:20:29.136768 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-User: tempest-AttachVolumeNegativeTest-73508829-project Jun 22 10:20:29.136768 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-User-Domain-Id: default Jun 22 10:20:29.136768 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-User-Domain-Name: Default Jun 22 10:20:29.136768 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-User-Id: 7be3d844dcee4d19966fc7944463a0bc Jun 22 10:20:29.136768 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-User-Name: tempest-AttachVolumeNegativeTest-73508829-project Jun 22 10:20:29.136768 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: Jun 22 10:20:29.136768 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: {"volumeAttachment": {"volumeId": "9dc1e900-f57d-4e74-adc1-a224c83aba05"}} Jun 22 10:20:29.136768 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: method: > Jun 22 10:20:29.137533 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: exception: Invalid volume: volume 9dc1e900-f57d-4e74-adc1-a224c83aba05 is already attached to instances: a5d1635b-71e2-4f7c-9fcc-b6d2e9803c09 Jun 22 10:20:29.137533 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: action_args: {'server_id': 'a5d1635b-71e2-4f7c-9fcc-b6d2e9803c09', 'body': {'volumeAttachment': {'volumeId': '9dc1e900-f57d-4e74-adc1-a224c83aba05'}}} Jun 22 10:20:29.137533 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 10:20:29.137533 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:20:29.137533 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jun 22 10:20:29.137533 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jun 22 10:20:29.137533 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 22 10:20:29.137533 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 22 10:20:29.137533 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jun 22 10:20:29.137533 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 22 10:20:29.137533 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jun 22 10:20:29.137533 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jun 22 10:20:29.137533 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jun 22 10:20:29.137533 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jun 22 10:20:29.137533 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 9dc1e900-f57d-4e74-adc1-a224c83aba05 is already attached to instances: a5d1635b-71e2-4f7c-9fcc-b6d2e9803c09 Jun 22 10:20:29.137533 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi Jun 22 10:20:29.137533 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 10:20:29.137533 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi Jun 22 10:20:29.137533 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:20:29.138938 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 10:20:29.138938 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 10:20:29.138938 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 10:20:29.138938 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 10:20:29.138938 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 10:20:29.138938 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 10:20:29.138938 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 22 10:20:29.138938 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 22 10:20:29.138938 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 22 10:20:29.138938 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 22 10:20:29.138938 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 22 10:20:29.138938 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 22 10:20:29.138938 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jun 22 10:20:29.138938 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jun 22 10:20:29.138938 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 9dc1e900-f57d-4e74-adc1-a224c83aba05 is already attached to instances: a5d1635b-71e2-4f7c-9fcc-b6d2e9803c09 Jun 22 10:20:29.138938 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi Jun 22 10:20:29.138938 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 10:20:29.138938 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi Jun 22 10:20:29.138938 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:20:29.138938 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 10:20:29.140350 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 10:20:29.140350 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 10:20:29.140350 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 10:20:29.140350 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 9dc1e900-f57d-4e74-adc1-a224c83aba05 is already attached to instances: a5d1635b-71e2-4f7c-9fcc-b6d2e9803c09 Jun 22 10:20:29.140350 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi Jun 22 10:20:29.140350 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-8c7d15a6-f876-4af1-a671-dfe9e3a5412d tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Returning 400 to user: Invalid volume: volume 9dc1e900-f57d-4e74-adc1-a224c83aba05 is already attached to instances: a5d1635b-71e2-4f7c-9fcc-b6d2e9803c09 {{(pid=117874) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 10:20:29.140350 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [None req-8c7d15a6-f876-4af1-a671-dfe9e3a5412d tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] 10.222.0.43 "POST /compute/v2.1/servers/a5d1635b-71e2-4f7c-9fcc-b6d2e9803c09/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.103733 Jun 22 10:20:29.140350 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 321/630] 10.222.0.43 () {60 vars in 1322 bytes} [Wed Jun 22 10:20:29 2022] POST /compute/v2.1/servers/a5d1635b-71e2-4f7c-9fcc-b6d2e9803c09/os-volume_attachments => generated 174 bytes in 105 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 22 10:20:29.201417 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-d4ecdfa3-2d8f-4b91-b690-3c884a96767c tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Calling method '>' {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:20:29.202031 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.compute.api [None req-d4ecdfa3-2d8f-4b91-b690-3c884a96767c tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] [instance: a5d1635b-71e2-4f7c-9fcc-b6d2e9803c09] Fetching instance by UUID {{(pid=117873) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:20:29.209297 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-d4ecdfa3-2d8f-4b91-b690-3c884a96767c tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:20:29.209772 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-d4ecdfa3-2d8f-4b91-b690-3c884a96767c tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:20:29.210542 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-d4ecdfa3-2d8f-4b91-b690-3c884a96767c tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:20:29.211010 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-d4ecdfa3-2d8f-4b91-b690-3c884a96767c tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:20:29.294351 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.objects.instance [None req-d4ecdfa3-2d8f-4b91-b690-3c884a96767c tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Lazy-loading 'services' on Instance uuid a5d1635b-71e2-4f7c-9fcc-b6d2e9803c09 {{(pid=117873) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 22 10:20:29.368790 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [None req-d4ecdfa3-2d8f-4b91-b690-3c884a96767c tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] 10.222.0.43 "DELETE /compute/v2.1/servers/a5d1635b-71e2-4f7c-9fcc-b6d2e9803c09/os-volume_attachments/9dc1e900-f57d-4e74-adc1-a224c83aba05" status: 202 len: 0 microversion: 2.1 time: 0.172163 Jun 22 10:20:29.369384 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 310/631] 10.222.0.43 () {58 vars in 1415 bytes} [Wed Jun 22 10:20:29 2022] DELETE /compute/v2.1/servers/a5d1635b-71e2-4f7c-9fcc-b6d2e9803c09/os-volume_attachments/9dc1e900-f57d-4e74-adc1-a224c83aba05 => generated 0 bytes in 174 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 22 10:20:29.378309 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-822be6c3-34f5-4a45-9cea-bbd6c3f5e816 tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Calling method '>' {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:20:29.379228 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.compute.api [None req-822be6c3-34f5-4a45-9cea-bbd6c3f5e816 tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] [instance: a5d1635b-71e2-4f7c-9fcc-b6d2e9803c09] Fetching instance by UUID {{(pid=117874) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:20:29.386805 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-822be6c3-34f5-4a45-9cea-bbd6c3f5e816 tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:20:29.387227 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-822be6c3-34f5-4a45-9cea-bbd6c3f5e816 tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:20:29.388195 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-822be6c3-34f5-4a45-9cea-bbd6c3f5e816 tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:20:29.388678 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-822be6c3-34f5-4a45-9cea-bbd6c3f5e816 tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:20:29.419781 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [None req-822be6c3-34f5-4a45-9cea-bbd6c3f5e816 tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] 10.222.0.43 "GET /compute/v2.1/servers/a5d1635b-71e2-4f7c-9fcc-b6d2e9803c09/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046031 Jun 22 10:20:29.420349 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 322/632] 10.222.0.43 () {58 vars in 1301 bytes} [Wed Jun 22 10:20:29 2022] GET /compute/v2.1/servers/a5d1635b-71e2-4f7c-9fcc-b6d2e9803c09/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 10:20:30.433290 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-2ff1a5c9-9123-4750-9d75-07685f215993 tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Calling method '>' {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:20:30.434388 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.compute.api [None req-2ff1a5c9-9123-4750-9d75-07685f215993 tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] [instance: a5d1635b-71e2-4f7c-9fcc-b6d2e9803c09] Fetching instance by UUID {{(pid=117873) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:20:30.440872 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-2ff1a5c9-9123-4750-9d75-07685f215993 tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:20:30.441315 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-2ff1a5c9-9123-4750-9d75-07685f215993 tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:20:30.442109 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-2ff1a5c9-9123-4750-9d75-07685f215993 tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:20:30.442542 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-2ff1a5c9-9123-4750-9d75-07685f215993 tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:20:30.472078 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [None req-2ff1a5c9-9123-4750-9d75-07685f215993 tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] 10.222.0.43 "GET /compute/v2.1/servers/a5d1635b-71e2-4f7c-9fcc-b6d2e9803c09/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043547 Jun 22 10:20:30.472656 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 311/633] 10.222.0.43 () {58 vars in 1301 bytes} [Wed Jun 22 10:20:30 2022] GET /compute/v2.1/servers/a5d1635b-71e2-4f7c-9fcc-b6d2e9803c09/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 22 10:20:30.530656 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-cbb25671-72d7-41c6-91af-d6d28b07567d tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Calling method '>' {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:20:30.531178 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.compute.api [None req-cbb25671-72d7-41c6-91af-d6d28b07567d tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] [instance: a5d1635b-71e2-4f7c-9fcc-b6d2e9803c09] Fetching instance by UUID {{(pid=117874) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:20:30.538432 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-cbb25671-72d7-41c6-91af-d6d28b07567d tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:20:30.538892 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-cbb25671-72d7-41c6-91af-d6d28b07567d tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:20:30.539662 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-cbb25671-72d7-41c6-91af-d6d28b07567d tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:20:30.540101 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-cbb25671-72d7-41c6-91af-d6d28b07567d tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:20:30.565641 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.compute.api [None req-cbb25671-72d7-41c6-91af-d6d28b07567d tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] [instance: a5d1635b-71e2-4f7c-9fcc-b6d2e9803c09] Going to try to terminate instance {{(pid=117874) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 22 10:20:30.622851 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG dbcounter [-] [117874] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=117874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:20:30.654862 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [None req-cbb25671-72d7-41c6-91af-d6d28b07567d tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] 10.222.0.43 "DELETE /compute/v2.1/servers/a5d1635b-71e2-4f7c-9fcc-b6d2e9803c09" status: 204 len: 0 microversion: 2.1 time: 0.126893 Jun 22 10:20:30.657463 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 323/634] 10.222.0.43 () {58 vars in 1238 bytes} [Wed Jun 22 10:20:30 2022] DELETE /compute/v2.1/servers/a5d1635b-71e2-4f7c-9fcc-b6d2e9803c09 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 22 10:20:30.667005 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-8a6985bf-e578-4eb3-be94-e92e93c23dee tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Calling method '>' {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:20:30.667594 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.compute.api [None req-8a6985bf-e578-4eb3-be94-e92e93c23dee tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] [instance: a5d1635b-71e2-4f7c-9fcc-b6d2e9803c09] Fetching instance by UUID {{(pid=117873) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:20:30.673831 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-8a6985bf-e578-4eb3-be94-e92e93c23dee tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:20:30.674276 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-8a6985bf-e578-4eb3-be94-e92e93c23dee tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:20:30.675142 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-8a6985bf-e578-4eb3-be94-e92e93c23dee tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:20:30.675574 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-8a6985bf-e578-4eb3-be94-e92e93c23dee tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:20:30.820689 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.policy [None req-8a6985bf-e578-4eb3-be94-e92e93c23dee tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7be3d844dcee4d19966fc7944463a0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78629282e2b74418a2c1cdac32576ef1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117873) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:20:30.828423 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [None req-8a6985bf-e578-4eb3-be94-e92e93c23dee tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] 10.222.0.43 "GET /compute/v2.1/servers/a5d1635b-71e2-4f7c-9fcc-b6d2e9803c09" status: 200 len: 1679 microversion: 2.1 time: 0.165338 Jun 22 10:20:30.829495 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 312/635] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:20:30 2022] GET /compute/v2.1/servers/a5d1635b-71e2-4f7c-9fcc-b6d2e9803c09 => generated 1679 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:20:31.846966 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-fa2b7576-f5ba-487e-bba1-bd73e4071a10 tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Calling method '>' {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:20:31.847654 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.compute.api [None req-fa2b7576-f5ba-487e-bba1-bd73e4071a10 tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] [instance: a5d1635b-71e2-4f7c-9fcc-b6d2e9803c09] Fetching instance by UUID {{(pid=117874) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:20:31.854411 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-fa2b7576-f5ba-487e-bba1-bd73e4071a10 tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:20:31.854858 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-fa2b7576-f5ba-487e-bba1-bd73e4071a10 tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:20:31.855615 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-fa2b7576-f5ba-487e-bba1-bd73e4071a10 tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:20:31.856047 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-fa2b7576-f5ba-487e-bba1-bd73e4071a10 tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:20:31.987538 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.policy [None req-fa2b7576-f5ba-487e-bba1-bd73e4071a10 tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7be3d844dcee4d19966fc7944463a0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78629282e2b74418a2c1cdac32576ef1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117874) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:20:31.995207 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [None req-fa2b7576-f5ba-487e-bba1-bd73e4071a10 tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] 10.222.0.43 "GET /compute/v2.1/servers/a5d1635b-71e2-4f7c-9fcc-b6d2e9803c09" status: 200 len: 1679 microversion: 2.1 time: 0.153018 Jun 22 10:20:31.995767 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 324/636] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:20:31 2022] GET /compute/v2.1/servers/a5d1635b-71e2-4f7c-9fcc-b6d2e9803c09 => generated 1679 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:20:33.012495 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-699fc5c8-0b94-46a5-b4e4-8d3730d672c3 tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Calling method '>' {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:20:33.013196 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.compute.api [None req-699fc5c8-0b94-46a5-b4e4-8d3730d672c3 tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] [instance: a5d1635b-71e2-4f7c-9fcc-b6d2e9803c09] Fetching instance by UUID {{(pid=117873) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:20:33.020825 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-699fc5c8-0b94-46a5-b4e4-8d3730d672c3 tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:20:33.021374 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-699fc5c8-0b94-46a5-b4e4-8d3730d672c3 tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:20:33.022235 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-699fc5c8-0b94-46a5-b4e4-8d3730d672c3 tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:20:33.022668 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-699fc5c8-0b94-46a5-b4e4-8d3730d672c3 tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:20:33.175342 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.policy [None req-699fc5c8-0b94-46a5-b4e4-8d3730d672c3 tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7be3d844dcee4d19966fc7944463a0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78629282e2b74418a2c1cdac32576ef1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117873) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:20:33.183616 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [None req-699fc5c8-0b94-46a5-b4e4-8d3730d672c3 tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] 10.222.0.43 "GET /compute/v2.1/servers/a5d1635b-71e2-4f7c-9fcc-b6d2e9803c09" status: 200 len: 1679 microversion: 2.1 time: 0.174993 Jun 22 10:20:33.184211 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 313/637] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:20:33 2022] GET /compute/v2.1/servers/a5d1635b-71e2-4f7c-9fcc-b6d2e9803c09 => generated 1679 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:20:33.428400 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [req-f757b9ce-afe0-439b-84d9-a30d0bcea6af req-f89b68e4-439b-42ec-87a0-0d36ac9498d1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a5d1635b-71e2-4f7c-9fcc-b6d2e9803c09", "name": "network-vif-deleted", "tag": "ae353570-1e3f-4fc2-8d0b-cfa07619e042"}]} {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:20:33.437144 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [req-f757b9ce-afe0-439b-84d9-a30d0bcea6af req-f89b68e4-439b-42ec-87a0-0d36ac9498d1 service nova] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:20:33.438330 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [req-f757b9ce-afe0-439b-84d9-a30d0bcea6af req-f89b68e4-439b-42ec-87a0-0d36ac9498d1 service nova] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:20:33.450097 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.compute.server_external_events [req-f757b9ce-afe0-439b-84d9-a30d0bcea6af req-f89b68e4-439b-42ec-87a0-0d36ac9498d1 service nova] Creating event network-vif-deleted:ae353570-1e3f-4fc2-8d0b-cfa07619e042 for instance a5d1635b-71e2-4f7c-9fcc-b6d2e9803c09 on hv-cinder-84713 Jun 22 10:20:33.455924 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [req-f757b9ce-afe0-439b-84d9-a30d0bcea6af req-f89b68e4-439b-42ec-87a0-0d36ac9498d1 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031108 Jun 22 10:20:33.456717 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 325/638] 10.222.0.43 () {64 vars in 1317 bytes} [Wed Jun 22 10:20:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 10:20:34.201068 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-37ff2adb-d0f5-4dbb-9edf-c65336044577 tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Calling method '>' {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:20:34.201720 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.compute.api [None req-37ff2adb-d0f5-4dbb-9edf-c65336044577 tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] [instance: a5d1635b-71e2-4f7c-9fcc-b6d2e9803c09] Fetching instance by UUID {{(pid=117873) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:20:34.209279 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-37ff2adb-d0f5-4dbb-9edf-c65336044577 tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:20:34.209766 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-37ff2adb-d0f5-4dbb-9edf-c65336044577 tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:20:34.210534 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-37ff2adb-d0f5-4dbb-9edf-c65336044577 tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:20:34.210973 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-37ff2adb-d0f5-4dbb-9edf-c65336044577 tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:20:34.226175 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.wsgi [None req-37ff2adb-d0f5-4dbb-9edf-c65336044577 tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] HTTP exception thrown: Instance a5d1635b-71e2-4f7c-9fcc-b6d2e9803c09 could not be found. Jun 22 10:20:34.228215 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-37ff2adb-d0f5-4dbb-9edf-c65336044577 tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Request method failure captured: Jun 22 10:20:34.228215 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: request: GET /compute/v2.1/servers/a5d1635b-71e2-4f7c-9fcc-b6d2e9803c09 HTTP/1.1 Jun 22 10:20:34.228215 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: Accept: application/json Jun 22 10:20:34.228215 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: Accept-Encoding: identity Jun 22 10:20:34.228215 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: Connection: close Jun 22 10:20:34.228215 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: Content-Length: 0 Jun 22 10:20:34.228215 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: Content-Type: application/json Jun 22 10:20:34.228215 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: Host: 10.222.0.43 Jun 22 10:20:34.228215 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: Openstack-System-Scope: None Jun 22 10:20:34.228215 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: User-Agent: python-urllib3/1.26.9 Jun 22 10:20:34.228215 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-Auth-Token: gAAAAABisuvUpGkoSsQ9d1KNFPX834O5Ed4reiDCWeVnTPicJ3T1CXVLNJjI8u1aloRBXjMgN_RPq4rTUmL5P2islljUOvvHIwLebG3DYtPiBpBpjPn3C8o_VLQB3yNvqrLTJBaPVXC7QVZTOTIWPKqjtW_CrQ0ZdCwS1UGZXZ6Doixu1TJW9Cg Jun 22 10:20:34.228215 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-Domain-Id: None Jun 22 10:20:34.228215 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-Domain-Name: None Jun 22 10:20:34.228215 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-Identity-Status: Confirmed Jun 22 10:20:34.228215 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-Is-Admin-Project: True Jun 22 10:20:34.228215 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-Project-Domain-Id: default Jun 22 10:20:34.228215 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-Project-Domain-Name: Default Jun 22 10:20:34.228215 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-Project-Id: 78629282e2b74418a2c1cdac32576ef1 Jun 22 10:20:34.228215 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-Project-Name: tempest-AttachVolumeNegativeTest-73508829 Jun 22 10:20:34.228215 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-Role: reader,member Jun 22 10:20:34.228215 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-Roles: reader,member Jun 22 10:20:34.229555 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/78629282e2b74418a2c1cdac32576ef1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/78629282e2b74418a2c1cdac32576ef1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_78629282e2b74418a2c1cdac32576ef1", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/78629282e2b74418a2c1cdac32576ef1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}] Jun 22 10:20:34.229555 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-Tenant: tempest-AttachVolumeNegativeTest-73508829 Jun 22 10:20:34.229555 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-Tenant-Id: 78629282e2b74418a2c1cdac32576ef1 Jun 22 10:20:34.229555 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-73508829 Jun 22 10:20:34.229555 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-User: tempest-AttachVolumeNegativeTest-73508829-project Jun 22 10:20:34.229555 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-User-Domain-Id: default Jun 22 10:20:34.229555 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-User-Domain-Name: Default Jun 22 10:20:34.229555 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-User-Id: 7be3d844dcee4d19966fc7944463a0bc Jun 22 10:20:34.229555 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-User-Name: tempest-AttachVolumeNegativeTest-73508829-project Jun 22 10:20:34.229555 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: method: > Jun 22 10:20:34.229555 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: exception: Instance a5d1635b-71e2-4f7c-9fcc-b6d2e9803c09 could not be found. Jun 22 10:20:34.229555 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: action_args: {'id': 'a5d1635b-71e2-4f7c-9fcc-b6d2e9803c09'} Jun 22 10:20:34.230375 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 10:20:34.230375 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:20:34.230375 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 22 10:20:34.230375 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 22 10:20:34.230375 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 22 10:20:34.230375 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 22 10:20:34.230375 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 22 10:20:34.230375 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 22 10:20:34.230375 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 22 10:20:34.230375 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 22 10:20:34.230375 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a5d1635b-71e2-4f7c-9fcc-b6d2e9803c09 could not be found. Jun 22 10:20:34.230375 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi Jun 22 10:20:34.230375 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 10:20:34.230375 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi Jun 22 10:20:34.230375 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:20:34.230375 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 10:20:34.230375 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 10:20:34.230375 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 10:20:34.230375 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 10:20:34.230375 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 10:20:34.231507 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 10:20:34.231507 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 22 10:20:34.231507 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 22 10:20:34.231507 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 22 10:20:34.231507 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 22 10:20:34.231507 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 22 10:20:34.231507 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 22 10:20:34.231507 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a5d1635b-71e2-4f7c-9fcc-b6d2e9803c09 could not be found. Jun 22 10:20:34.231507 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi Jun 22 10:20:34.231507 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 10:20:34.231507 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi Jun 22 10:20:34.231507 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:20:34.231507 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 10:20:34.231507 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 10:20:34.231507 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 10:20:34.231507 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 10:20:34.231507 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a5d1635b-71e2-4f7c-9fcc-b6d2e9803c09 could not be found. Jun 22 10:20:34.231507 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi Jun 22 10:20:34.232579 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-37ff2adb-d0f5-4dbb-9edf-c65336044577 tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Returning 404 to user: Instance a5d1635b-71e2-4f7c-9fcc-b6d2e9803c09 could not be found. {{(pid=117873) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 10:20:34.232579 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [None req-37ff2adb-d0f5-4dbb-9edf-c65336044577 tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] 10.222.0.43 "GET /compute/v2.1/servers/a5d1635b-71e2-4f7c-9fcc-b6d2e9803c09" status: 404 len: 111 microversion: 2.1 time: 0.032505 Jun 22 10:20:34.232579 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 314/639] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:20:34 2022] GET /compute/v2.1/servers/a5d1635b-71e2-4f7c-9fcc-b6d2e9803c09 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 22 10:20:34.239255 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-3db46ddd-86f0-4ed9-b98e-bc36416dc5f5 tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Calling method '.version_select at 0x7f36bdbfd5e0>' {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:20:34.257808 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [None req-3db46ddd-86f0-4ed9-b98e-bc36416dc5f5 tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] 10.222.0.43 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-34517634" status: 202 len: 0 microversion: 2.1 time: 0.022709 Jun 22 10:20:34.258404 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 326/640] 10.222.0.43 () {58 vars in 1214 bytes} [Wed Jun 22 10:20:34 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-34517634 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 22 10:20:34.908576 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-4ae9e761-0e76-4110-9fcc-ba07d9d58427 tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Action: 'create', calling method: .version_select at 0x7f36be407c10>, body: {"keypair": {"name": "tempest-keypair-1678991820", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPbEnW/Bl5SyVov6BDloig+htmFiaTKDe5M1YuR1SVAeJxR3WcAj6vMXpwd0IxwFcrhCxVspOgylwvVfiZ9pXacaYnh/fOQoppa3BYLUuOQ+9DY+bXCowTt3TWTTIWXYvA=="}} {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:20:34.922936 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.quota [None req-4ae9e761-0e76-4110-9fcc-ba07d9d58427 tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Getting quotas for project 78629282e2b74418a2c1cdac32576ef1. Resources: {'key_pairs'} {{(pid=117873) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 22 10:20:34.926805 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.quota [None req-4ae9e761-0e76-4110-9fcc-ba07d9d58427 tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Getting quotas for user 7be3d844dcee4d19966fc7944463a0bc and project 78629282e2b74418a2c1cdac32576ef1. Resources: {'key_pairs'} {{(pid=117873) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 22 10:20:34.949510 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [None req-4ae9e761-0e76-4110-9fcc-ba07d9d58427 tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.045276 Jun 22 10:20:34.950137 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 315/641] 10.222.0.43 () {60 vars in 1158 bytes} [Wed Jun 22 10:20:34 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 10:20:36.287025 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-306d326b-a77b-4cf3-9f71-20bf93d812ce tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1259276517", "imageRef": "22d2c064-5bf7-438e-bbb7-47259e4bdab5", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "8bc94bec-5b18-4b15-a531-8b4a0778b280"}], "security_groups": [{"name": "tempest-securitygroup--1510603155"}], "key_name": "tempest-keypair-1678991820", "user_data": "}} {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:20:36.293732 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG dbcounter [-] [117874] Writing DB stats nova_api:SELECT=42,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=117874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:20:36.396758 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.network.neutron [None req-306d326b-a77b-4cf3-9f71-20bf93d812ce tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] validate_networks() for [('8bc94bec-5b18-4b15-a531-8b4a0778b280', None, None, None, None, None)] {{(pid=117874) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 22 10:20:36.765621 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.virt.hardware [None req-306d326b-a77b-4cf3-9f71-20bf93d812ce tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Flavor limits 0:0:0 {{(pid=117874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 22 10:20:36.766603 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.virt.hardware [None req-306d326b-a77b-4cf3-9f71-20bf93d812ce tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Image limits 0:0:0 {{(pid=117874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 22 10:20:36.767083 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.virt.hardware [None req-306d326b-a77b-4cf3-9f71-20bf93d812ce tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Flavor pref 0:0:0 {{(pid=117874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 22 10:20:36.767496 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.virt.hardware [None req-306d326b-a77b-4cf3-9f71-20bf93d812ce tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Image pref 0:0:0 {{(pid=117874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 22 10:20:36.767925 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.virt.hardware [None req-306d326b-a77b-4cf3-9f71-20bf93d812ce tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 22 10:20:36.776748 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-306d326b-a77b-4cf3-9f71-20bf93d812ce tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:20:36.777201 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-306d326b-a77b-4cf3-9f71-20bf93d812ce tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:20:36.778027 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-306d326b-a77b-4cf3-9f71-20bf93d812ce tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:20:36.778468 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-306d326b-a77b-4cf3-9f71-20bf93d812ce tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:20:36.797408 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.quota [None req-306d326b-a77b-4cf3-9f71-20bf93d812ce tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Getting quotas for project 78629282e2b74418a2c1cdac32576ef1. Resources: {'instances', 'cores', 'ram'} {{(pid=117874) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 22 10:20:36.801602 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.quota [None req-306d326b-a77b-4cf3-9f71-20bf93d812ce tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Getting quotas for user 7be3d844dcee4d19966fc7944463a0bc and project 78629282e2b74418a2c1cdac32576ef1. Resources: {'instances', 'cores', 'ram'} {{(pid=117874) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 22 10:20:36.813116 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.compute.api [None req-306d326b-a77b-4cf3-9f71-20bf93d812ce tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Going to run 1 instances... {{(pid=117874) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 22 10:20:36.815590 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.compute.api [None req-306d326b-a77b-4cf3-9f71-20bf93d812ce tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] [instance: 982a8b14-2931-49ee-bc63-124bb37fb8c4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='22d2c064-5bf7-438e-bbb7-47259e4bdab5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117874) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 22 10:20:36.862485 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [None req-306d326b-a77b-4cf3-9f71-20bf93d812ce tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.580970 Jun 22 10:20:36.863346 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 327/642] 10.222.0.43 () {60 vars in 1146 bytes} [Wed Jun 22 10:20:36 2022] POST /compute/v2.1/servers => generated 402 bytes in 582 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 22 10:20:36.873556 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-0575d842-85c2-490b-8e68-2054d4a51f08 tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Calling method '>' {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:20:36.874299 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.compute.api [None req-0575d842-85c2-490b-8e68-2054d4a51f08 tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] [instance: 982a8b14-2931-49ee-bc63-124bb37fb8c4] Fetching instance by UUID {{(pid=117873) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:20:36.939609 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.policy [None req-0575d842-85c2-490b-8e68-2054d4a51f08 tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7be3d844dcee4d19966fc7944463a0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78629282e2b74418a2c1cdac32576ef1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117873) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:20:36.948492 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [None req-0575d842-85c2-490b-8e68-2054d4a51f08 tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] 10.222.0.43 "GET /compute/v2.1/servers/982a8b14-2931-49ee-bc63-124bb37fb8c4" status: 200 len: 1242 microversion: 2.1 time: 0.078349 Jun 22 10:20:36.952058 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 316/643] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:20:36 2022] GET /compute/v2.1/servers/982a8b14-2931-49ee-bc63-124bb37fb8c4 => generated 1242 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:20:37.889215 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-11477b91-7264-464d-bcbc-7bc5230301a7 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Calling method '>' {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:20:37.889827 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.compute.api [None req-11477b91-7264-464d-bcbc-7bc5230301a7 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] [instance: 86a421a6-9b8c-40a9-ab7e-30b74c7bd0f3] Fetching instance by UUID {{(pid=117874) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:20:37.898240 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-11477b91-7264-464d-bcbc-7bc5230301a7 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:20:37.899027 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-11477b91-7264-464d-bcbc-7bc5230301a7 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:20:37.899808 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-11477b91-7264-464d-bcbc-7bc5230301a7 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:20:37.900239 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-11477b91-7264-464d-bcbc-7bc5230301a7 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:20:37.968954 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-39d35113-4682-4cf6-9dc9-daa79201b9f4 tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Calling method '>' {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:20:37.969987 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.compute.api [None req-39d35113-4682-4cf6-9dc9-daa79201b9f4 tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] [instance: 982a8b14-2931-49ee-bc63-124bb37fb8c4] Fetching instance by UUID {{(pid=117873) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:20:37.978951 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-39d35113-4682-4cf6-9dc9-daa79201b9f4 tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:20:37.979768 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-39d35113-4682-4cf6-9dc9-daa79201b9f4 tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:20:37.980709 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-39d35113-4682-4cf6-9dc9-daa79201b9f4 tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:20:37.981332 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-39d35113-4682-4cf6-9dc9-daa79201b9f4 tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:20:37.987529 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG dbcounter [-] [117873] Writing DB stats nova_cell1:SELECT=79,nova_cell1:INSERT=1 {{(pid=117873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:20:38.054771 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.policy [None req-39d35113-4682-4cf6-9dc9-daa79201b9f4 tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7be3d844dcee4d19966fc7944463a0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78629282e2b74418a2c1cdac32576ef1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117873) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:20:38.066001 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [None req-39d35113-4682-4cf6-9dc9-daa79201b9f4 tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] 10.222.0.43 "GET /compute/v2.1/servers/982a8b14-2931-49ee-bc63-124bb37fb8c4" status: 200 len: 1312 microversion: 2.1 time: 0.101391 Jun 22 10:20:38.068953 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 317/644] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:20:37 2022] GET /compute/v2.1/servers/982a8b14-2931-49ee-bc63-124bb37fb8c4 => generated 1312 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 10:20:38.146192 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.objects.instance [None req-11477b91-7264-464d-bcbc-7bc5230301a7 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lazy-loading 'services' on Instance uuid 86a421a6-9b8c-40a9-ab7e-30b74c7bd0f3 {{(pid=117874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 22 10:20:38.224020 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [None req-11477b91-7264-464d-bcbc-7bc5230301a7 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] 10.222.0.43 "DELETE /compute/v2.1/servers/86a421a6-9b8c-40a9-ab7e-30b74c7bd0f3/os-volume_attachments/b6734bf6-cc80-4200-81e5-88d794ca04e8" status: 202 len: 0 microversion: 2.1 time: 0.339309 Jun 22 10:20:38.224639 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 328/645] 10.222.0.43 () {58 vars in 1415 bytes} [Wed Jun 22 10:20:37 2022] DELETE /compute/v2.1/servers/86a421a6-9b8c-40a9-ab7e-30b74c7bd0f3/os-volume_attachments/b6734bf6-cc80-4200-81e5-88d794ca04e8 => generated 0 bytes in 341 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 22 10:20:38.237113 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-481ca273-4427-47cd-8b58-0602dc23766e tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Calling method '>' {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:20:38.244779 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.compute.api [None req-481ca273-4427-47cd-8b58-0602dc23766e tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] [instance: 86a421a6-9b8c-40a9-ab7e-30b74c7bd0f3] Fetching instance by UUID {{(pid=117873) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:20:38.252547 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-481ca273-4427-47cd-8b58-0602dc23766e tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:20:38.253025 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-481ca273-4427-47cd-8b58-0602dc23766e tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:20:38.254144 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-481ca273-4427-47cd-8b58-0602dc23766e tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:20:38.254607 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-481ca273-4427-47cd-8b58-0602dc23766e tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:20:38.287746 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [None req-481ca273-4427-47cd-8b58-0602dc23766e tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] 10.222.0.43 "GET /compute/v2.1/servers/86a421a6-9b8c-40a9-ab7e-30b74c7bd0f3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055146 Jun 22 10:20:38.288316 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 318/646] 10.222.0.43 () {58 vars in 1301 bytes} [Wed Jun 22 10:20:38 2022] GET /compute/v2.1/servers/86a421a6-9b8c-40a9-ab7e-30b74c7bd0f3/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 10:20:39.086498 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-e63da09c-8a96-4859-a669-c8fd9dfb7dbc tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Calling method '>' {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:20:39.087347 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.compute.api [None req-e63da09c-8a96-4859-a669-c8fd9dfb7dbc tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] [instance: 982a8b14-2931-49ee-bc63-124bb37fb8c4] Fetching instance by UUID {{(pid=117874) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:20:39.094362 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-e63da09c-8a96-4859-a669-c8fd9dfb7dbc tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:20:39.094824 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-e63da09c-8a96-4859-a669-c8fd9dfb7dbc tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:20:39.095795 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-e63da09c-8a96-4859-a669-c8fd9dfb7dbc tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:20:39.096386 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-e63da09c-8a96-4859-a669-c8fd9dfb7dbc tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:20:39.291303 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.policy [None req-e63da09c-8a96-4859-a669-c8fd9dfb7dbc tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7be3d844dcee4d19966fc7944463a0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78629282e2b74418a2c1cdac32576ef1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117874) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:20:39.299264 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [None req-e63da09c-8a96-4859-a669-c8fd9dfb7dbc tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] 10.222.0.43 "GET /compute/v2.1/servers/982a8b14-2931-49ee-bc63-124bb37fb8c4" status: 200 len: 1368 microversion: 2.1 time: 0.218427 Jun 22 10:20:39.302459 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-42a8baf7-9149-44f3-9292-79062388f1e7 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Calling method '>' {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:20:39.305002 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.compute.api [None req-42a8baf7-9149-44f3-9292-79062388f1e7 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] [instance: 86a421a6-9b8c-40a9-ab7e-30b74c7bd0f3] Fetching instance by UUID {{(pid=117873) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:20:39.308864 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 329/647] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:20:39 2022] GET /compute/v2.1/servers/982a8b14-2931-49ee-bc63-124bb37fb8c4 => generated 1368 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 10:20:39.317326 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-42a8baf7-9149-44f3-9292-79062388f1e7 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:20:39.318108 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-42a8baf7-9149-44f3-9292-79062388f1e7 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:20:39.319151 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-42a8baf7-9149-44f3-9292-79062388f1e7 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:20:39.319544 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-42a8baf7-9149-44f3-9292-79062388f1e7 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:20:39.356421 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [None req-42a8baf7-9149-44f3-9292-79062388f1e7 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] 10.222.0.43 "GET /compute/v2.1/servers/86a421a6-9b8c-40a9-ab7e-30b74c7bd0f3/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.061585 Jun 22 10:20:39.357063 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 319/648] 10.222.0.43 () {58 vars in 1301 bytes} [Wed Jun 22 10:20:39 2022] GET /compute/v2.1/servers/86a421a6-9b8c-40a9-ab7e-30b74c7bd0f3/os-volume_attachments => generated 25 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 22 10:20:39.429717 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [req-e5896cca-e3ff-4625-925e-fa8b1fc52453 req-31677b68-5c4a-4a76-b180-94f5d58dfd7d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "982a8b14-2931-49ee-bc63-124bb37fb8c4", "tag": "14658931-09ac-4ec1-9e21-53442e71aacc"}]} {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:20:39.443028 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [req-e5896cca-e3ff-4625-925e-fa8b1fc52453 req-31677b68-5c4a-4a76-b180-94f5d58dfd7d service nova] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:20:39.443811 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [req-e5896cca-e3ff-4625-925e-fa8b1fc52453 req-31677b68-5c4a-4a76-b180-94f5d58dfd7d service nova] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:20:39.447393 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-c442b495-942d-41d1-9ce9-c90c9b53689b tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Calling method '>' {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:20:39.447909 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.compute.api [None req-c442b495-942d-41d1-9ce9-c90c9b53689b tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] [instance: 86a421a6-9b8c-40a9-ab7e-30b74c7bd0f3] Fetching instance by UUID {{(pid=117873) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:20:39.459787 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-c442b495-942d-41d1-9ce9-c90c9b53689b tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:20:39.460253 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-c442b495-942d-41d1-9ce9-c90c9b53689b tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:20:39.461036 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-c442b495-942d-41d1-9ce9-c90c9b53689b tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:20:39.461479 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-c442b495-942d-41d1-9ce9-c90c9b53689b tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:20:39.461944 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.compute.server_external_events [req-e5896cca-e3ff-4625-925e-fa8b1fc52453 req-31677b68-5c4a-4a76-b180-94f5d58dfd7d service nova] Creating event network-changed:14658931-09ac-4ec1-9e21-53442e71aacc for instance 982a8b14-2931-49ee-bc63-124bb37fb8c4 on hv-cinder-84713 Jun 22 10:20:39.467651 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [req-e5896cca-e3ff-4625-925e-fa8b1fc52453 req-31677b68-5c4a-4a76-b180-94f5d58dfd7d service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047185 Jun 22 10:20:39.468493 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 330/649] 10.222.0.43 () {64 vars in 1317 bytes} [Wed Jun 22 10:20:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 10:20:39.491874 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.compute.api [None req-c442b495-942d-41d1-9ce9-c90c9b53689b tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] [instance: 86a421a6-9b8c-40a9-ab7e-30b74c7bd0f3] Going to try to terminate instance {{(pid=117873) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 22 10:20:39.587169 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [None req-c442b495-942d-41d1-9ce9-c90c9b53689b tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] 10.222.0.43 "DELETE /compute/v2.1/servers/86a421a6-9b8c-40a9-ab7e-30b74c7bd0f3" status: 204 len: 0 microversion: 2.1 time: 0.149236 Jun 22 10:20:39.589430 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 320/650] 10.222.0.43 () {58 vars in 1238 bytes} [Wed Jun 22 10:20:39 2022] DELETE /compute/v2.1/servers/86a421a6-9b8c-40a9-ab7e-30b74c7bd0f3 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 22 10:20:39.598971 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-9d28a9ef-90f4-47ce-964c-73668e31b194 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Calling method '>' {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:20:39.600222 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.compute.api [None req-9d28a9ef-90f4-47ce-964c-73668e31b194 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] [instance: 86a421a6-9b8c-40a9-ab7e-30b74c7bd0f3] Fetching instance by UUID {{(pid=117874) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:20:39.607583 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-9d28a9ef-90f4-47ce-964c-73668e31b194 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:20:39.608386 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-9d28a9ef-90f4-47ce-964c-73668e31b194 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:20:39.609509 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-9d28a9ef-90f4-47ce-964c-73668e31b194 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:20:39.610205 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-9d28a9ef-90f4-47ce-964c-73668e31b194 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:20:39.767573 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.policy [None req-9d28a9ef-90f4-47ce-964c-73668e31b194 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d7292401816437fba46d073c4746e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3277b9cbc4b4a8bbacee8440cea1ed2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117874) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:20:39.775420 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [None req-9d28a9ef-90f4-47ce-964c-73668e31b194 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] 10.222.0.43 "GET /compute/v2.1/servers/86a421a6-9b8c-40a9-ab7e-30b74c7bd0f3" status: 200 len: 1691 microversion: 2.1 time: 0.181350 Jun 22 10:20:39.776007 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 331/651] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:20:39 2022] GET /compute/v2.1/servers/86a421a6-9b8c-40a9-ab7e-30b74c7bd0f3 => generated 1691 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:20:40.317244 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-13ca506e-4610-4f46-abfc-18d8980f463d tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Calling method '>' {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:20:40.318015 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.compute.api [None req-13ca506e-4610-4f46-abfc-18d8980f463d tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] [instance: 982a8b14-2931-49ee-bc63-124bb37fb8c4] Fetching instance by UUID {{(pid=117873) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:20:40.324756 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-13ca506e-4610-4f46-abfc-18d8980f463d tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:20:40.325198 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-13ca506e-4610-4f46-abfc-18d8980f463d tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:20:40.326005 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-13ca506e-4610-4f46-abfc-18d8980f463d tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:20:40.326461 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-13ca506e-4610-4f46-abfc-18d8980f463d tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:20:40.462359 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.policy [None req-13ca506e-4610-4f46-abfc-18d8980f463d tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7be3d844dcee4d19966fc7944463a0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78629282e2b74418a2c1cdac32576ef1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117873) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:20:40.469817 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [None req-13ca506e-4610-4f46-abfc-18d8980f463d tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] 10.222.0.43 "GET /compute/v2.1/servers/982a8b14-2931-49ee-bc63-124bb37fb8c4" status: 200 len: 1368 microversion: 2.1 time: 0.157212 Jun 22 10:20:40.470397 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 321/652] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:20:40 2022] GET /compute/v2.1/servers/982a8b14-2931-49ee-bc63-124bb37fb8c4 => generated 1368 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:20:40.762725 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-cccd3293-7dd2-435a-b708-7ebc1d1a9563 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Calling method '>' {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:20:40.763715 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.compute.api [None req-cccd3293-7dd2-435a-b708-7ebc1d1a9563 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] [instance: eb851ab6-0e89-41d2-be52-d76cdc8644d6] Fetching instance by UUID {{(pid=117874) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:20:40.770773 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-cccd3293-7dd2-435a-b708-7ebc1d1a9563 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:20:40.771222 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-cccd3293-7dd2-435a-b708-7ebc1d1a9563 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:20:40.771971 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-cccd3293-7dd2-435a-b708-7ebc1d1a9563 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:20:40.772398 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-cccd3293-7dd2-435a-b708-7ebc1d1a9563 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:20:40.792902 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-e563ee8b-2924-4488-a386-ddd7d34ae779 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Calling method '>' {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:20:40.793505 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.compute.api [None req-e563ee8b-2924-4488-a386-ddd7d34ae779 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] [instance: 86a421a6-9b8c-40a9-ab7e-30b74c7bd0f3] Fetching instance by UUID {{(pid=117873) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:20:40.800353 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-e563ee8b-2924-4488-a386-ddd7d34ae779 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:20:40.800799 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-e563ee8b-2924-4488-a386-ddd7d34ae779 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:20:40.801553 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-e563ee8b-2924-4488-a386-ddd7d34ae779 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:20:40.802225 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-e563ee8b-2924-4488-a386-ddd7d34ae779 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:20:40.804523 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [None req-cccd3293-7dd2-435a-b708-7ebc1d1a9563 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] 10.222.0.43 "GET /compute/v2.1/servers/eb851ab6-0e89-41d2-be52-d76cdc8644d6/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045652 Jun 22 10:20:40.805089 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 332/653] 10.222.0.43 () {58 vars in 1301 bytes} [Wed Jun 22 10:20:40 2022] GET /compute/v2.1/servers/eb851ab6-0e89-41d2-be52-d76cdc8644d6/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 22 10:20:40.864505 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-289c920c-208b-4e45-918f-49200ce2a248 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Calling method '>' {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:20:40.865122 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.compute.api [None req-289c920c-208b-4e45-918f-49200ce2a248 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] [instance: eb851ab6-0e89-41d2-be52-d76cdc8644d6] Fetching instance by UUID {{(pid=117874) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:20:40.871525 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-289c920c-208b-4e45-918f-49200ce2a248 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:20:40.871968 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-289c920c-208b-4e45-918f-49200ce2a248 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:20:40.872723 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-289c920c-208b-4e45-918f-49200ce2a248 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:20:40.873152 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-289c920c-208b-4e45-918f-49200ce2a248 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:20:40.905916 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.compute.api [None req-289c920c-208b-4e45-918f-49200ce2a248 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] [instance: eb851ab6-0e89-41d2-be52-d76cdc8644d6] Going to try to terminate instance {{(pid=117874) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 22 10:20:41.012103 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [None req-289c920c-208b-4e45-918f-49200ce2a248 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] 10.222.0.43 "DELETE /compute/v2.1/servers/eb851ab6-0e89-41d2-be52-d76cdc8644d6" status: 204 len: 0 microversion: 2.1 time: 0.151262 Jun 22 10:20:41.012652 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.policy [None req-e563ee8b-2924-4488-a386-ddd7d34ae779 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d7292401816437fba46d073c4746e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3277b9cbc4b4a8bbacee8440cea1ed2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117873) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:20:41.012902 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 333/654] 10.222.0.43 () {58 vars in 1238 bytes} [Wed Jun 22 10:20:40 2022] DELETE /compute/v2.1/servers/eb851ab6-0e89-41d2-be52-d76cdc8644d6 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 22 10:20:41.021659 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [None req-e563ee8b-2924-4488-a386-ddd7d34ae779 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] 10.222.0.43 "GET /compute/v2.1/servers/86a421a6-9b8c-40a9-ab7e-30b74c7bd0f3" status: 200 len: 1691 microversion: 2.1 time: 0.232516 Jun 22 10:20:41.021907 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-58168fe5-e3e1-4240-a547-05221a6dc1b0 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Calling method '>' {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:20:41.022319 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 322/655] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:20:40 2022] GET /compute/v2.1/servers/86a421a6-9b8c-40a9-ab7e-30b74c7bd0f3 => generated 1691 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 10:20:41.022476 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.compute.api [None req-58168fe5-e3e1-4240-a547-05221a6dc1b0 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] [instance: eb851ab6-0e89-41d2-be52-d76cdc8644d6] Fetching instance by UUID {{(pid=117874) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:20:41.028609 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-58168fe5-e3e1-4240-a547-05221a6dc1b0 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:20:41.029061 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-58168fe5-e3e1-4240-a547-05221a6dc1b0 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:20:41.029864 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-58168fe5-e3e1-4240-a547-05221a6dc1b0 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:20:41.030306 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-58168fe5-e3e1-4240-a547-05221a6dc1b0 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:20:41.175582 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.policy [None req-58168fe5-e3e1-4240-a547-05221a6dc1b0 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78fe3fc4334c43d7a5ef6d70f9f57523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad52333bcbec425089c44c3e55df97ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117874) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:20:41.183120 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [None req-58168fe5-e3e1-4240-a547-05221a6dc1b0 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] 10.222.0.43 "GET /compute/v2.1/servers/eb851ab6-0e89-41d2-be52-d76cdc8644d6" status: 200 len: 1674 microversion: 2.1 time: 0.165439 Jun 22 10:20:41.183696 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 334/656] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:20:41 2022] GET /compute/v2.1/servers/eb851ab6-0e89-41d2-be52-d76cdc8644d6 => generated 1674 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 10:20:41.496499 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-9c8011b6-83fd-4556-b5cd-4181b632c597 tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Calling method '>' {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:20:41.497088 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.compute.api [None req-9c8011b6-83fd-4556-b5cd-4181b632c597 tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] [instance: 982a8b14-2931-49ee-bc63-124bb37fb8c4] Fetching instance by UUID {{(pid=117873) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:20:41.504655 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-9c8011b6-83fd-4556-b5cd-4181b632c597 tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:20:41.505101 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-9c8011b6-83fd-4556-b5cd-4181b632c597 tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:20:41.505915 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-9c8011b6-83fd-4556-b5cd-4181b632c597 tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:20:41.506401 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-9c8011b6-83fd-4556-b5cd-4181b632c597 tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:20:41.644322 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.policy [None req-9c8011b6-83fd-4556-b5cd-4181b632c597 tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7be3d844dcee4d19966fc7944463a0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78629282e2b74418a2c1cdac32576ef1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117873) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:20:41.651801 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [None req-9c8011b6-83fd-4556-b5cd-4181b632c597 tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] 10.222.0.43 "GET /compute/v2.1/servers/982a8b14-2931-49ee-bc63-124bb37fb8c4" status: 200 len: 1368 microversion: 2.1 time: 0.159158 Jun 22 10:20:41.652493 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 323/657] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:20:41 2022] GET /compute/v2.1/servers/982a8b14-2931-49ee-bc63-124bb37fb8c4 => generated 1368 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:20:42.038995 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-87282f6c-0028-44c4-b48d-18fae7bdd452 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Calling method '>' {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:20:42.039759 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.compute.api [None req-87282f6c-0028-44c4-b48d-18fae7bdd452 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] [instance: 86a421a6-9b8c-40a9-ab7e-30b74c7bd0f3] Fetching instance by UUID {{(pid=117874) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:20:42.047715 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-87282f6c-0028-44c4-b48d-18fae7bdd452 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:20:42.048164 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-87282f6c-0028-44c4-b48d-18fae7bdd452 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:20:42.048947 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-87282f6c-0028-44c4-b48d-18fae7bdd452 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:20:42.049387 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-87282f6c-0028-44c4-b48d-18fae7bdd452 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:20:42.180536 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.policy [None req-87282f6c-0028-44c4-b48d-18fae7bdd452 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d7292401816437fba46d073c4746e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3277b9cbc4b4a8bbacee8440cea1ed2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117874) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:20:42.187989 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [None req-87282f6c-0028-44c4-b48d-18fae7bdd452 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] 10.222.0.43 "GET /compute/v2.1/servers/86a421a6-9b8c-40a9-ab7e-30b74c7bd0f3" status: 200 len: 1691 microversion: 2.1 time: 0.153355 Jun 22 10:20:42.188587 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 335/658] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:20:42 2022] GET /compute/v2.1/servers/86a421a6-9b8c-40a9-ab7e-30b74c7bd0f3 => generated 1691 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:20:42.202287 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-8dd35d80-ff4e-4723-b263-c1faf80846f5 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Calling method '>' {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:20:42.202900 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.compute.api [None req-8dd35d80-ff4e-4723-b263-c1faf80846f5 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] [instance: eb851ab6-0e89-41d2-be52-d76cdc8644d6] Fetching instance by UUID {{(pid=117873) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:20:42.210045 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-8dd35d80-ff4e-4723-b263-c1faf80846f5 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:20:42.210496 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-8dd35d80-ff4e-4723-b263-c1faf80846f5 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:20:42.211255 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-8dd35d80-ff4e-4723-b263-c1faf80846f5 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:20:42.211696 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-8dd35d80-ff4e-4723-b263-c1faf80846f5 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:20:42.352179 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.policy [None req-8dd35d80-ff4e-4723-b263-c1faf80846f5 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78fe3fc4334c43d7a5ef6d70f9f57523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad52333bcbec425089c44c3e55df97ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117873) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:20:42.362362 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [None req-8dd35d80-ff4e-4723-b263-c1faf80846f5 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] 10.222.0.43 "GET /compute/v2.1/servers/eb851ab6-0e89-41d2-be52-d76cdc8644d6" status: 200 len: 1674 microversion: 2.1 time: 0.163883 Jun 22 10:20:42.362948 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 324/659] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:20:42 2022] GET /compute/v2.1/servers/eb851ab6-0e89-41d2-be52-d76cdc8644d6 => generated 1674 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:20:42.669698 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-f4498a2b-1a03-4698-88aa-810c9152f8de tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Calling method '>' {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:20:42.670318 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.compute.api [None req-f4498a2b-1a03-4698-88aa-810c9152f8de tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] [instance: 982a8b14-2931-49ee-bc63-124bb37fb8c4] Fetching instance by UUID {{(pid=117874) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:20:42.677040 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-f4498a2b-1a03-4698-88aa-810c9152f8de tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:20:42.677483 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-f4498a2b-1a03-4698-88aa-810c9152f8de tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:20:42.678272 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-f4498a2b-1a03-4698-88aa-810c9152f8de tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:20:42.678698 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-f4498a2b-1a03-4698-88aa-810c9152f8de tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:20:42.810568 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.policy [None req-f4498a2b-1a03-4698-88aa-810c9152f8de tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7be3d844dcee4d19966fc7944463a0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78629282e2b74418a2c1cdac32576ef1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117874) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:20:42.819207 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [None req-f4498a2b-1a03-4698-88aa-810c9152f8de tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] 10.222.0.43 "GET /compute/v2.1/servers/982a8b14-2931-49ee-bc63-124bb37fb8c4" status: 200 len: 1368 microversion: 2.1 time: 0.153461 Jun 22 10:20:42.819780 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 336/660] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:20:42 2022] GET /compute/v2.1/servers/982a8b14-2931-49ee-bc63-124bb37fb8c4 => generated 1368 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 10:20:43.205213 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-2fdb883e-68e9-48f3-9259-28f8e1e3125c tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Calling method '>' {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:20:43.205883 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.compute.api [None req-2fdb883e-68e9-48f3-9259-28f8e1e3125c tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] [instance: 86a421a6-9b8c-40a9-ab7e-30b74c7bd0f3] Fetching instance by UUID {{(pid=117873) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:20:43.212843 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-2fdb883e-68e9-48f3-9259-28f8e1e3125c tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:20:43.213285 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-2fdb883e-68e9-48f3-9259-28f8e1e3125c tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:20:43.214089 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-2fdb883e-68e9-48f3-9259-28f8e1e3125c tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:20:43.214525 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-2fdb883e-68e9-48f3-9259-28f8e1e3125c tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:20:43.360883 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.policy [None req-2fdb883e-68e9-48f3-9259-28f8e1e3125c tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d7292401816437fba46d073c4746e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3277b9cbc4b4a8bbacee8440cea1ed2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117873) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:20:43.368413 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [None req-2fdb883e-68e9-48f3-9259-28f8e1e3125c tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] 10.222.0.43 "GET /compute/v2.1/servers/86a421a6-9b8c-40a9-ab7e-30b74c7bd0f3" status: 200 len: 1691 microversion: 2.1 time: 0.167732 Jun 22 10:20:43.368988 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 325/661] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:20:43 2022] GET /compute/v2.1/servers/86a421a6-9b8c-40a9-ab7e-30b74c7bd0f3 => generated 1691 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:20:43.383078 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-0ee64402-2be1-496a-bdb1-1d4e8f5ca686 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Calling method '>' {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:20:43.383687 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.compute.api [None req-0ee64402-2be1-496a-bdb1-1d4e8f5ca686 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] [instance: eb851ab6-0e89-41d2-be52-d76cdc8644d6] Fetching instance by UUID {{(pid=117874) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:20:43.391140 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-0ee64402-2be1-496a-bdb1-1d4e8f5ca686 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:20:43.391595 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-0ee64402-2be1-496a-bdb1-1d4e8f5ca686 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:20:43.392347 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-0ee64402-2be1-496a-bdb1-1d4e8f5ca686 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:20:43.392778 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-0ee64402-2be1-496a-bdb1-1d4e8f5ca686 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:20:43.523341 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.policy [None req-0ee64402-2be1-496a-bdb1-1d4e8f5ca686 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78fe3fc4334c43d7a5ef6d70f9f57523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad52333bcbec425089c44c3e55df97ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117874) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:20:43.530947 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [None req-0ee64402-2be1-496a-bdb1-1d4e8f5ca686 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] 10.222.0.43 "GET /compute/v2.1/servers/eb851ab6-0e89-41d2-be52-d76cdc8644d6" status: 200 len: 1674 microversion: 2.1 time: 0.151680 Jun 22 10:20:43.531692 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 337/662] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:20:43 2022] GET /compute/v2.1/servers/eb851ab6-0e89-41d2-be52-d76cdc8644d6 => generated 1674 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:20:43.836363 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-1115793b-96d2-4223-ba25-b30be262fbb4 tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Calling method '>' {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:20:43.836966 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.compute.api [None req-1115793b-96d2-4223-ba25-b30be262fbb4 tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] [instance: 982a8b14-2931-49ee-bc63-124bb37fb8c4] Fetching instance by UUID {{(pid=117873) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:20:43.843052 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-1115793b-96d2-4223-ba25-b30be262fbb4 tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:20:43.843996 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-1115793b-96d2-4223-ba25-b30be262fbb4 tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:20:43.844803 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-1115793b-96d2-4223-ba25-b30be262fbb4 tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:20:43.845235 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-1115793b-96d2-4223-ba25-b30be262fbb4 tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:20:43.977102 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.policy [None req-1115793b-96d2-4223-ba25-b30be262fbb4 tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7be3d844dcee4d19966fc7944463a0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78629282e2b74418a2c1cdac32576ef1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117873) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:20:43.985325 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [None req-1115793b-96d2-4223-ba25-b30be262fbb4 tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] 10.222.0.43 "GET /compute/v2.1/servers/982a8b14-2931-49ee-bc63-124bb37fb8c4" status: 200 len: 1368 microversion: 2.1 time: 0.152821 Jun 22 10:20:43.985923 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 326/663] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:20:43 2022] GET /compute/v2.1/servers/982a8b14-2931-49ee-bc63-124bb37fb8c4 => generated 1368 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 10:20:44.385875 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-e78a442b-0994-4379-8f34-4d7908126d07 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Calling method '>' {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:20:44.386437 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.compute.api [None req-e78a442b-0994-4379-8f34-4d7908126d07 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] [instance: 86a421a6-9b8c-40a9-ab7e-30b74c7bd0f3] Fetching instance by UUID {{(pid=117874) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:20:44.393440 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-e78a442b-0994-4379-8f34-4d7908126d07 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:20:44.393911 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-e78a442b-0994-4379-8f34-4d7908126d07 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:20:44.394668 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-e78a442b-0994-4379-8f34-4d7908126d07 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:20:44.395101 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-e78a442b-0994-4379-8f34-4d7908126d07 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:20:44.528954 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.policy [None req-e78a442b-0994-4379-8f34-4d7908126d07 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d7292401816437fba46d073c4746e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3277b9cbc4b4a8bbacee8440cea1ed2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117874) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:20:44.538599 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [None req-e78a442b-0994-4379-8f34-4d7908126d07 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] 10.222.0.43 "GET /compute/v2.1/servers/86a421a6-9b8c-40a9-ab7e-30b74c7bd0f3" status: 200 len: 1691 microversion: 2.1 time: 0.156322 Jun 22 10:20:44.539673 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 338/664] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:20:44 2022] GET /compute/v2.1/servers/86a421a6-9b8c-40a9-ab7e-30b74c7bd0f3 => generated 1691 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:20:44.549493 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-bf2636ff-4aa0-4766-89ee-f44dffda3123 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Calling method '>' {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:20:44.550134 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.compute.api [None req-bf2636ff-4aa0-4766-89ee-f44dffda3123 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] [instance: eb851ab6-0e89-41d2-be52-d76cdc8644d6] Fetching instance by UUID {{(pid=117873) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:20:44.556781 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-bf2636ff-4aa0-4766-89ee-f44dffda3123 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:20:44.557230 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-bf2636ff-4aa0-4766-89ee-f44dffda3123 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:20:44.558139 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-bf2636ff-4aa0-4766-89ee-f44dffda3123 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:20:44.558573 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-bf2636ff-4aa0-4766-89ee-f44dffda3123 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:20:44.688130 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.policy [None req-bf2636ff-4aa0-4766-89ee-f44dffda3123 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78fe3fc4334c43d7a5ef6d70f9f57523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad52333bcbec425089c44c3e55df97ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117873) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:20:44.695678 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [None req-bf2636ff-4aa0-4766-89ee-f44dffda3123 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] 10.222.0.43 "GET /compute/v2.1/servers/eb851ab6-0e89-41d2-be52-d76cdc8644d6" status: 200 len: 1674 microversion: 2.1 time: 0.150631 Jun 22 10:20:44.696240 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 327/665] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:20:44 2022] GET /compute/v2.1/servers/eb851ab6-0e89-41d2-be52-d76cdc8644d6 => generated 1674 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:20:45.002685 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-e57574d5-7f28-4985-b9c8-848fd37234a0 tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Calling method '>' {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:20:45.003292 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.compute.api [None req-e57574d5-7f28-4985-b9c8-848fd37234a0 tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] [instance: 982a8b14-2931-49ee-bc63-124bb37fb8c4] Fetching instance by UUID {{(pid=117874) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:20:45.009479 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-e57574d5-7f28-4985-b9c8-848fd37234a0 tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:20:45.009974 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-e57574d5-7f28-4985-b9c8-848fd37234a0 tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:20:45.010731 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-e57574d5-7f28-4985-b9c8-848fd37234a0 tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:20:45.011157 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-e57574d5-7f28-4985-b9c8-848fd37234a0 tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:20:45.146150 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.policy [None req-e57574d5-7f28-4985-b9c8-848fd37234a0 tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7be3d844dcee4d19966fc7944463a0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78629282e2b74418a2c1cdac32576ef1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117874) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:20:45.153617 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [None req-e57574d5-7f28-4985-b9c8-848fd37234a0 tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] 10.222.0.43 "GET /compute/v2.1/servers/982a8b14-2931-49ee-bc63-124bb37fb8c4" status: 200 len: 1368 microversion: 2.1 time: 0.155529 Jun 22 10:20:45.154214 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 339/666] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:20:44 2022] GET /compute/v2.1/servers/982a8b14-2931-49ee-bc63-124bb37fb8c4 => generated 1368 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:20:45.556205 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-078c6cba-d3f9-4b6c-a841-70f50bb7e50a tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Calling method '>' {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:20:45.556734 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.compute.api [None req-078c6cba-d3f9-4b6c-a841-70f50bb7e50a tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] [instance: 86a421a6-9b8c-40a9-ab7e-30b74c7bd0f3] Fetching instance by UUID {{(pid=117873) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:20:45.559159 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG dbcounter [-] [117873] Writing DB stats nova_api:SELECT=64,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=117873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:20:45.564928 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-078c6cba-d3f9-4b6c-a841-70f50bb7e50a tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:20:45.565367 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-078c6cba-d3f9-4b6c-a841-70f50bb7e50a tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:20:45.566219 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-078c6cba-d3f9-4b6c-a841-70f50bb7e50a tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:20:45.566648 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-078c6cba-d3f9-4b6c-a841-70f50bb7e50a tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:20:45.705720 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.policy [None req-078c6cba-d3f9-4b6c-a841-70f50bb7e50a tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d7292401816437fba46d073c4746e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3277b9cbc4b4a8bbacee8440cea1ed2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117873) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:20:45.712943 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-61fa4005-533d-4436-aa16-b6c3c207cf05 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Calling method '>' {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:20:45.713764 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.compute.api [None req-61fa4005-533d-4436-aa16-b6c3c207cf05 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] [instance: eb851ab6-0e89-41d2-be52-d76cdc8644d6] Fetching instance by UUID {{(pid=117874) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:20:45.714148 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [None req-078c6cba-d3f9-4b6c-a841-70f50bb7e50a tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] 10.222.0.43 "GET /compute/v2.1/servers/86a421a6-9b8c-40a9-ab7e-30b74c7bd0f3" status: 200 len: 1691 microversion: 2.1 time: 0.161694 Jun 22 10:20:45.714790 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 328/667] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:20:45 2022] GET /compute/v2.1/servers/86a421a6-9b8c-40a9-ab7e-30b74c7bd0f3 => generated 1691 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:20:45.720271 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-61fa4005-533d-4436-aa16-b6c3c207cf05 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:20:45.720713 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-61fa4005-533d-4436-aa16-b6c3c207cf05 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:20:45.721486 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-61fa4005-533d-4436-aa16-b6c3c207cf05 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:20:45.722985 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-61fa4005-533d-4436-aa16-b6c3c207cf05 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:20:45.855420 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.policy [None req-61fa4005-533d-4436-aa16-b6c3c207cf05 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78fe3fc4334c43d7a5ef6d70f9f57523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad52333bcbec425089c44c3e55df97ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117874) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:20:45.863773 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [None req-61fa4005-533d-4436-aa16-b6c3c207cf05 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] 10.222.0.43 "GET /compute/v2.1/servers/eb851ab6-0e89-41d2-be52-d76cdc8644d6" status: 200 len: 1674 microversion: 2.1 time: 0.155212 Jun 22 10:20:45.864352 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 340/668] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:20:45 2022] GET /compute/v2.1/servers/eb851ab6-0e89-41d2-be52-d76cdc8644d6 => generated 1674 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 10:20:46.170947 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-a6b78fdd-2037-4051-8c9f-7c46af2d22b5 tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Calling method '>' {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:20:46.171827 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.compute.api [None req-a6b78fdd-2037-4051-8c9f-7c46af2d22b5 tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] [instance: 982a8b14-2931-49ee-bc63-124bb37fb8c4] Fetching instance by UUID {{(pid=117873) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:20:46.178598 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-a6b78fdd-2037-4051-8c9f-7c46af2d22b5 tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:20:46.179281 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-a6b78fdd-2037-4051-8c9f-7c46af2d22b5 tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:20:46.180085 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-a6b78fdd-2037-4051-8c9f-7c46af2d22b5 tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:20:46.180521 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-a6b78fdd-2037-4051-8c9f-7c46af2d22b5 tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:20:46.331024 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.policy [None req-a6b78fdd-2037-4051-8c9f-7c46af2d22b5 tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7be3d844dcee4d19966fc7944463a0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78629282e2b74418a2c1cdac32576ef1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117873) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:20:46.338619 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [None req-a6b78fdd-2037-4051-8c9f-7c46af2d22b5 tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] 10.222.0.43 "GET /compute/v2.1/servers/982a8b14-2931-49ee-bc63-124bb37fb8c4" status: 200 len: 1368 microversion: 2.1 time: 0.171478 Jun 22 10:20:46.339196 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 329/669] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:20:46 2022] GET /compute/v2.1/servers/982a8b14-2931-49ee-bc63-124bb37fb8c4 => generated 1368 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:20:46.730866 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-03e87669-5429-4a2b-b717-f63b7771e06b tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Calling method '>' {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:20:46.732027 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.compute.api [None req-03e87669-5429-4a2b-b717-f63b7771e06b tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] [instance: 86a421a6-9b8c-40a9-ab7e-30b74c7bd0f3] Fetching instance by UUID {{(pid=117874) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:20:46.739794 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-03e87669-5429-4a2b-b717-f63b7771e06b tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:20:46.740243 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-03e87669-5429-4a2b-b717-f63b7771e06b tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:20:46.741001 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-03e87669-5429-4a2b-b717-f63b7771e06b tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:20:46.741632 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-03e87669-5429-4a2b-b717-f63b7771e06b tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:20:46.746890 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG dbcounter [-] [117874] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=117874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:20:46.787228 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG dbcounter [-] [117874] Writing DB stats nova_cell0:SELECT=2 {{(pid=117874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:20:46.809165 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.policy [None req-03e87669-5429-4a2b-b717-f63b7771e06b tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d7292401816437fba46d073c4746e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3277b9cbc4b4a8bbacee8440cea1ed2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117874) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:20:46.811365 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG dbcounter [-] [117874] Writing DB stats nova_cell0:SELECT=6 {{(pid=117874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:20:46.818831 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [None req-03e87669-5429-4a2b-b717-f63b7771e06b tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] 10.222.0.43 "GET /compute/v2.1/servers/86a421a6-9b8c-40a9-ab7e-30b74c7bd0f3" status: 200 len: 1623 microversion: 2.1 time: 0.092092 Jun 22 10:20:46.819729 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 341/670] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:20:46 2022] GET /compute/v2.1/servers/86a421a6-9b8c-40a9-ab7e-30b74c7bd0f3 => generated 1623 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:20:46.883450 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-3d41a9ab-072a-43ae-9540-9a1ee218a974 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Calling method '>' {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:20:46.885174 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.compute.api [None req-3d41a9ab-072a-43ae-9540-9a1ee218a974 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] [instance: eb851ab6-0e89-41d2-be52-d76cdc8644d6] Fetching instance by UUID {{(pid=117873) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:20:46.900893 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-3d41a9ab-072a-43ae-9540-9a1ee218a974 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:20:46.910508 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-3d41a9ab-072a-43ae-9540-9a1ee218a974 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:20:46.911817 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-3d41a9ab-072a-43ae-9540-9a1ee218a974 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:20:46.913132 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-3d41a9ab-072a-43ae-9540-9a1ee218a974 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:20:46.928994 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [req-b4b2374f-0999-43cf-aff0-d7c534fd3d51 req-92d6e957-e214-412c-ac72-a79360c2327f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eb851ab6-0e89-41d2-be52-d76cdc8644d6", "name": "network-vif-deleted", "tag": "d017dd0e-ef63-4ffa-af06-35b32a6bf63f"}]} {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:20:46.941734 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [req-b4b2374f-0999-43cf-aff0-d7c534fd3d51 req-92d6e957-e214-412c-ac72-a79360c2327f service nova] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:20:46.942655 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [req-b4b2374f-0999-43cf-aff0-d7c534fd3d51 req-92d6e957-e214-412c-ac72-a79360c2327f service nova] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:20:46.983212 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.compute.server_external_events [req-b4b2374f-0999-43cf-aff0-d7c534fd3d51 req-92d6e957-e214-412c-ac72-a79360c2327f service nova] Creating event network-vif-deleted:d017dd0e-ef63-4ffa-af06-35b32a6bf63f for instance eb851ab6-0e89-41d2-be52-d76cdc8644d6 on hv-cinder-84713 Jun 22 10:20:46.991108 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG dbcounter [-] [117873] Writing DB stats nova_cell0:SELECT=6 {{(pid=117873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:20:47.006160 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [req-b4b2374f-0999-43cf-aff0-d7c534fd3d51 req-92d6e957-e214-412c-ac72-a79360c2327f service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076547 Jun 22 10:20:47.007105 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 342/671] 10.222.0.43 () {64 vars in 1317 bytes} [Wed Jun 22 10:20:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 22 10:20:47.076263 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.policy [None req-3d41a9ab-072a-43ae-9540-9a1ee218a974 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78fe3fc4334c43d7a5ef6d70f9f57523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad52333bcbec425089c44c3e55df97ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117873) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:20:47.089905 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [None req-3d41a9ab-072a-43ae-9540-9a1ee218a974 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] 10.222.0.43 "GET /compute/v2.1/servers/eb851ab6-0e89-41d2-be52-d76cdc8644d6" status: 200 len: 1607 microversion: 2.1 time: 0.212131 Jun 22 10:20:47.103329 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 330/672] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:20:46 2022] GET /compute/v2.1/servers/eb851ab6-0e89-41d2-be52-d76cdc8644d6 => generated 1607 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:20:47.357303 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-351f26c6-fd5e-4248-ad94-687cb6fdadc4 tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Calling method '>' {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:20:47.358246 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.compute.api [None req-351f26c6-fd5e-4248-ad94-687cb6fdadc4 tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] [instance: 982a8b14-2931-49ee-bc63-124bb37fb8c4] Fetching instance by UUID {{(pid=117874) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:20:47.364945 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-351f26c6-fd5e-4248-ad94-687cb6fdadc4 tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:20:47.365394 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-351f26c6-fd5e-4248-ad94-687cb6fdadc4 tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:20:47.366195 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-351f26c6-fd5e-4248-ad94-687cb6fdadc4 tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:20:47.366624 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-351f26c6-fd5e-4248-ad94-687cb6fdadc4 tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:20:47.518681 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.policy [None req-351f26c6-fd5e-4248-ad94-687cb6fdadc4 tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7be3d844dcee4d19966fc7944463a0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78629282e2b74418a2c1cdac32576ef1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117874) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:20:47.532324 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [None req-351f26c6-fd5e-4248-ad94-687cb6fdadc4 tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] 10.222.0.43 "GET /compute/v2.1/servers/982a8b14-2931-49ee-bc63-124bb37fb8c4" status: 200 len: 1368 microversion: 2.1 time: 0.177626 Jun 22 10:20:47.534005 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 343/673] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:20:47 2022] GET /compute/v2.1/servers/982a8b14-2931-49ee-bc63-124bb37fb8c4 => generated 1368 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:20:47.836099 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-7d375ed9-53dd-483d-903e-ce0e575291a5 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Calling method '>' {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:20:47.836713 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.compute.api [None req-7d375ed9-53dd-483d-903e-ce0e575291a5 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] [instance: 86a421a6-9b8c-40a9-ab7e-30b74c7bd0f3] Fetching instance by UUID {{(pid=117873) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:20:47.844394 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-7d375ed9-53dd-483d-903e-ce0e575291a5 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:20:47.844865 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-7d375ed9-53dd-483d-903e-ce0e575291a5 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:20:47.849548 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-7d375ed9-53dd-483d-903e-ce0e575291a5 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:20:47.850048 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-7d375ed9-53dd-483d-903e-ce0e575291a5 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:20:47.911726 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-7d375ed9-53dd-483d-903e-ce0e575291a5 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:20:47.912831 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-7d375ed9-53dd-483d-903e-ce0e575291a5 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:20:47.913502 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.objects.instance [None req-7d375ed9-53dd-483d-903e-ce0e575291a5 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lazy-loading 'fault' on Instance uuid 86a421a6-9b8c-40a9-ab7e-30b74c7bd0f3 {{(pid=117873) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 22 10:20:47.982250 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.policy [None req-7d375ed9-53dd-483d-903e-ce0e575291a5 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d7292401816437fba46d073c4746e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3277b9cbc4b4a8bbacee8440cea1ed2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117873) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:20:47.986763 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG dbcounter [-] [117873] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:20:47.998146 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [None req-7d375ed9-53dd-483d-903e-ce0e575291a5 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] 10.222.0.43 "GET /compute/v2.1/servers/86a421a6-9b8c-40a9-ab7e-30b74c7bd0f3" status: 200 len: 1336 microversion: 2.1 time: 0.165575 Jun 22 10:20:47.999597 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 331/674] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:20:47 2022] GET /compute/v2.1/servers/86a421a6-9b8c-40a9-ab7e-30b74c7bd0f3 => generated 1336 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:20:48.119059 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-adbba512-4b4d-42a2-84a0-3b572a8fbb74 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Calling method '>' {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:20:48.119752 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.compute.api [None req-adbba512-4b4d-42a2-84a0-3b572a8fbb74 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] [instance: eb851ab6-0e89-41d2-be52-d76cdc8644d6] Fetching instance by UUID {{(pid=117874) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:20:48.131708 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-adbba512-4b4d-42a2-84a0-3b572a8fbb74 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:20:48.133835 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-adbba512-4b4d-42a2-84a0-3b572a8fbb74 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:20:48.134912 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-adbba512-4b4d-42a2-84a0-3b572a8fbb74 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:20:48.135573 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-adbba512-4b4d-42a2-84a0-3b572a8fbb74 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:20:48.154562 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.wsgi [None req-adbba512-4b4d-42a2-84a0-3b572a8fbb74 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] HTTP exception thrown: Instance eb851ab6-0e89-41d2-be52-d76cdc8644d6 could not be found. Jun 22 10:20:48.156771 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-adbba512-4b4d-42a2-84a0-3b572a8fbb74 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Request method failure captured: Jun 22 10:20:48.156771 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: request: GET /compute/v2.1/servers/eb851ab6-0e89-41d2-be52-d76cdc8644d6 HTTP/1.1 Jun 22 10:20:48.156771 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: Accept: application/json Jun 22 10:20:48.156771 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: Accept-Encoding: identity Jun 22 10:20:48.156771 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: Connection: close Jun 22 10:20:48.156771 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: Content-Length: 0 Jun 22 10:20:48.156771 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: Content-Type: application/json Jun 22 10:20:48.156771 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: Host: 10.222.0.43 Jun 22 10:20:48.156771 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: Openstack-System-Scope: None Jun 22 10:20:48.156771 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: User-Agent: python-urllib3/1.26.9 Jun 22 10:20:48.156771 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-Auth-Token: gAAAAABisuvm1HC5vURYGMHfhINNIY8dTNOSFMPEl0C8lmgixL-5gwhHJAyz_bxTDEMKLYHp_kBtrSYxzku6NejXNaLgya7bmqZ35QgSXSflYBmbpUiQTFVxrG4p6pERG6W27K0HsTOZ4plGpZPukHTNXTIrCder10qUDxudU2mAH2u7vnZVtg8 Jun 22 10:20:48.156771 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-Domain-Id: None Jun 22 10:20:48.156771 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-Domain-Name: None Jun 22 10:20:48.156771 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-Identity-Status: Confirmed Jun 22 10:20:48.156771 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-Is-Admin-Project: True Jun 22 10:20:48.156771 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-Project-Domain-Id: default Jun 22 10:20:48.156771 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-Project-Domain-Name: Default Jun 22 10:20:48.156771 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-Project-Id: ad52333bcbec425089c44c3e55df97ff Jun 22 10:20:48.156771 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-Project-Name: tempest-AttachVolumeTestJSON-1901268930 Jun 22 10:20:48.156771 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-Role: reader,member Jun 22 10:20:48.156771 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-Roles: reader,member Jun 22 10:20:48.158446 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/ad52333bcbec425089c44c3e55df97ff"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/ad52333bcbec425089c44c3e55df97ff"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_ad52333bcbec425089c44c3e55df97ff", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/ad52333bcbec425089c44c3e55df97ff"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}] Jun 22 10:20:48.158446 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-Tenant: tempest-AttachVolumeTestJSON-1901268930 Jun 22 10:20:48.158446 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-Tenant-Id: ad52333bcbec425089c44c3e55df97ff Jun 22 10:20:48.158446 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1901268930 Jun 22 10:20:48.158446 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-User: tempest-AttachVolumeTestJSON-1901268930-project Jun 22 10:20:48.158446 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-User-Domain-Id: default Jun 22 10:20:48.158446 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-User-Domain-Name: Default Jun 22 10:20:48.158446 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-User-Id: 78fe3fc4334c43d7a5ef6d70f9f57523 Jun 22 10:20:48.158446 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-User-Name: tempest-AttachVolumeTestJSON-1901268930-project Jun 22 10:20:48.158446 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: method: > Jun 22 10:20:48.158446 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: exception: Instance eb851ab6-0e89-41d2-be52-d76cdc8644d6 could not be found. Jun 22 10:20:48.158446 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: action_args: {'id': 'eb851ab6-0e89-41d2-be52-d76cdc8644d6'} Jun 22 10:20:48.159272 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 10:20:48.159272 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:20:48.159272 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 22 10:20:48.159272 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 22 10:20:48.159272 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 22 10:20:48.159272 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 22 10:20:48.159272 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 22 10:20:48.159272 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 22 10:20:48.159272 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 22 10:20:48.159272 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 22 10:20:48.159272 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eb851ab6-0e89-41d2-be52-d76cdc8644d6 could not be found. Jun 22 10:20:48.159272 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi Jun 22 10:20:48.159272 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 10:20:48.159272 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi Jun 22 10:20:48.159272 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:20:48.159272 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 10:20:48.159272 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 10:20:48.159272 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 10:20:48.159272 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 10:20:48.159272 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 10:20:48.160991 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 10:20:48.160991 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 22 10:20:48.160991 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 22 10:20:48.160991 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 22 10:20:48.160991 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 22 10:20:48.160991 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 22 10:20:48.160991 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 22 10:20:48.160991 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eb851ab6-0e89-41d2-be52-d76cdc8644d6 could not be found. Jun 22 10:20:48.160991 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi Jun 22 10:20:48.160991 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 10:20:48.160991 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi Jun 22 10:20:48.160991 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:20:48.160991 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 10:20:48.160991 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 10:20:48.160991 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 10:20:48.160991 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 10:20:48.160991 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eb851ab6-0e89-41d2-be52-d76cdc8644d6 could not be found. Jun 22 10:20:48.160991 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi Jun 22 10:20:48.162111 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-adbba512-4b4d-42a2-84a0-3b572a8fbb74 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Returning 404 to user: Instance eb851ab6-0e89-41d2-be52-d76cdc8644d6 could not be found. {{(pid=117874) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 10:20:48.162111 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [None req-adbba512-4b4d-42a2-84a0-3b572a8fbb74 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] 10.222.0.43 "GET /compute/v2.1/servers/eb851ab6-0e89-41d2-be52-d76cdc8644d6" status: 404 len: 111 microversion: 2.1 time: 0.052166 Jun 22 10:20:48.163331 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 344/675] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:20:48 2022] GET /compute/v2.1/servers/eb851ab6-0e89-41d2-be52-d76cdc8644d6 => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 22 10:20:48.167964 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-65308dce-a521-4602-9169-f1bbfbbae58f tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Calling method '.version_select at 0x7f36be3f5e50>' {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:20:48.195102 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [None req-65308dce-a521-4602-9169-f1bbfbbae58f tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] 10.222.0.43 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1521054167" status: 202 len: 0 microversion: 2.1 time: 0.031300 Jun 22 10:20:48.196002 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 332/676] 10.222.0.43 () {58 vars in 1220 bytes} [Wed Jun 22 10:20:48 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1521054167 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 22 10:20:48.550998 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-d7a42028-f172-4d7f-a58d-6f9d18c2a575 tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Calling method '>' {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:20:48.551666 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.compute.api [None req-d7a42028-f172-4d7f-a58d-6f9d18c2a575 tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] [instance: 982a8b14-2931-49ee-bc63-124bb37fb8c4] Fetching instance by UUID {{(pid=117874) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:20:48.559975 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-d7a42028-f172-4d7f-a58d-6f9d18c2a575 tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:20:48.560425 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-d7a42028-f172-4d7f-a58d-6f9d18c2a575 tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:20:48.561238 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-d7a42028-f172-4d7f-a58d-6f9d18c2a575 tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:20:48.561674 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-d7a42028-f172-4d7f-a58d-6f9d18c2a575 tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:20:48.771266 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.policy [None req-d7a42028-f172-4d7f-a58d-6f9d18c2a575 tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7be3d844dcee4d19966fc7944463a0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78629282e2b74418a2c1cdac32576ef1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117874) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:20:48.779587 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [None req-d7a42028-f172-4d7f-a58d-6f9d18c2a575 tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] 10.222.0.43 "GET /compute/v2.1/servers/982a8b14-2931-49ee-bc63-124bb37fb8c4" status: 200 len: 1368 microversion: 2.1 time: 0.233484 Jun 22 10:20:48.780118 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 345/677] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:20:48 2022] GET /compute/v2.1/servers/982a8b14-2931-49ee-bc63-124bb37fb8c4 => generated 1368 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:20:49.017898 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-831e327d-dc9f-4100-bf49-e064b5af8aef tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Calling method '>' {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:20:49.018506 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.compute.api [None req-831e327d-dc9f-4100-bf49-e064b5af8aef tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] [instance: 86a421a6-9b8c-40a9-ab7e-30b74c7bd0f3] Fetching instance by UUID {{(pid=117873) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:20:49.025505 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-831e327d-dc9f-4100-bf49-e064b5af8aef tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:20:49.026716 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-831e327d-dc9f-4100-bf49-e064b5af8aef tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:20:49.027746 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-831e327d-dc9f-4100-bf49-e064b5af8aef tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:20:49.028184 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-831e327d-dc9f-4100-bf49-e064b5af8aef tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:20:49.031190 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-879a4181-163c-40db-a6b7-e9e45c2635b0 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Action: 'create', calling method: .version_select at 0x7f36bdd679d0>, body: {"keypair": {"name": "tempest-keypair-282820695", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAuDhSS/tyVaDC7TFR6ObPeZITOq1q98oSwGGcUZADwi/DKRIQMco6BOYf8LGaKpVvk7z4LESrlkZOTB8YKmCwBWIUnSLRFZ2ahYBcuHKG2hincayELA3x3euT8Rd0nmkA=="}} {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:20:49.042279 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.wsgi [None req-831e327d-dc9f-4100-bf49-e064b5af8aef tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] HTTP exception thrown: Instance 86a421a6-9b8c-40a9-ab7e-30b74c7bd0f3 could not be found. Jun 22 10:20:49.043906 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-831e327d-dc9f-4100-bf49-e064b5af8aef tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Request method failure captured: Jun 22 10:20:49.043906 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: request: GET /compute/v2.1/servers/86a421a6-9b8c-40a9-ab7e-30b74c7bd0f3 HTTP/1.1 Jun 22 10:20:49.043906 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: Accept: application/json Jun 22 10:20:49.043906 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: Accept-Encoding: identity Jun 22 10:20:49.043906 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: Connection: close Jun 22 10:20:49.043906 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: Content-Length: 0 Jun 22 10:20:49.043906 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: Content-Type: application/json Jun 22 10:20:49.043906 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: Host: 10.222.0.43 Jun 22 10:20:49.043906 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: Openstack-System-Scope: None Jun 22 10:20:49.043906 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: User-Agent: python-urllib3/1.26.9 Jun 22 10:20:49.043906 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-Auth-Token: gAAAAABisuvjVgSjiKizNMOSSpCqXljNGSFOhAJqDEs6LcefAlRz8CAyn7YtQIZuzfdzoXcb1I3sPaeBjRE3nGlR4nfnglF3o0W8ZwIXa-t2T7Kvu9u_9tTAcMDpcQ53GMtzR-i0HixNHH9XjiiRNTwzoo0r6BKSTSNuiStSMHwEgpkRgSyLC2I Jun 22 10:20:49.043906 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-Domain-Id: None Jun 22 10:20:49.043906 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-Domain-Name: None Jun 22 10:20:49.043906 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-Identity-Status: Confirmed Jun 22 10:20:49.043906 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-Is-Admin-Project: True Jun 22 10:20:49.043906 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-Project-Domain-Id: default Jun 22 10:20:49.043906 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-Project-Domain-Name: Default Jun 22 10:20:49.043906 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-Project-Id: c3277b9cbc4b4a8bbacee8440cea1ed2 Jun 22 10:20:49.043906 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-2023039799 Jun 22 10:20:49.043906 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-Role: reader,member Jun 22 10:20:49.043906 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-Roles: reader,member Jun 22 10:20:49.045511 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/c3277b9cbc4b4a8bbacee8440cea1ed2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/c3277b9cbc4b4a8bbacee8440cea1ed2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_c3277b9cbc4b4a8bbacee8440cea1ed2", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/c3277b9cbc4b4a8bbacee8440cea1ed2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}] Jun 22 10:20:49.045511 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-Tenant: tempest-ServerRescueNegativeTestJSON-2023039799 Jun 22 10:20:49.045511 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-Tenant-Id: c3277b9cbc4b4a8bbacee8440cea1ed2 Jun 22 10:20:49.045511 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-2023039799 Jun 22 10:20:49.045511 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-User: tempest-ServerRescueNegativeTestJSON-2023039799-project Jun 22 10:20:49.045511 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-User-Domain-Id: default Jun 22 10:20:49.045511 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-User-Domain-Name: Default Jun 22 10:20:49.045511 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-User-Id: 0d7292401816437fba46d073c4746e45 Jun 22 10:20:49.045511 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-User-Name: tempest-ServerRescueNegativeTestJSON-2023039799-project Jun 22 10:20:49.045511 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: method: > Jun 22 10:20:49.045511 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: exception: Instance 86a421a6-9b8c-40a9-ab7e-30b74c7bd0f3 could not be found. Jun 22 10:20:49.045511 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: action_args: {'id': '86a421a6-9b8c-40a9-ab7e-30b74c7bd0f3'} Jun 22 10:20:49.046424 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 10:20:49.046424 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:20:49.046424 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 22 10:20:49.046424 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 22 10:20:49.046424 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 22 10:20:49.046424 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 22 10:20:49.046424 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 22 10:20:49.046424 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 22 10:20:49.046424 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 22 10:20:49.046424 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 22 10:20:49.046424 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 86a421a6-9b8c-40a9-ab7e-30b74c7bd0f3 could not be found. Jun 22 10:20:49.046424 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi Jun 22 10:20:49.046424 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 10:20:49.046424 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi Jun 22 10:20:49.046424 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:20:49.046424 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 10:20:49.046424 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 10:20:49.046424 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 10:20:49.046424 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 10:20:49.046424 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 10:20:49.047806 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 10:20:49.047806 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 22 10:20:49.047806 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 22 10:20:49.047806 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 22 10:20:49.047806 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 22 10:20:49.047806 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 22 10:20:49.047806 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 22 10:20:49.047806 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 86a421a6-9b8c-40a9-ab7e-30b74c7bd0f3 could not be found. Jun 22 10:20:49.047806 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi Jun 22 10:20:49.047806 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 10:20:49.047806 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi Jun 22 10:20:49.047806 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:20:49.047806 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 10:20:49.047806 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 10:20:49.047806 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 10:20:49.047806 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 10:20:49.047806 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 86a421a6-9b8c-40a9-ab7e-30b74c7bd0f3 could not be found. Jun 22 10:20:49.047806 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi Jun 22 10:20:49.049039 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.quota [None req-879a4181-163c-40db-a6b7-e9e45c2635b0 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Getting quotas for project ad52333bcbec425089c44c3e55df97ff. Resources: {'key_pairs'} {{(pid=117874) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 22 10:20:49.049039 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.quota [None req-879a4181-163c-40db-a6b7-e9e45c2635b0 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Getting quotas for user 78fe3fc4334c43d7a5ef6d70f9f57523 and project ad52333bcbec425089c44c3e55df97ff. Resources: {'key_pairs'} {{(pid=117874) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 22 10:20:49.049847 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-831e327d-dc9f-4100-bf49-e064b5af8aef tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Returning 404 to user: Instance 86a421a6-9b8c-40a9-ab7e-30b74c7bd0f3 could not be found. {{(pid=117873) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 10:20:49.050674 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [None req-831e327d-dc9f-4100-bf49-e064b5af8aef tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] 10.222.0.43 "GET /compute/v2.1/servers/86a421a6-9b8c-40a9-ab7e-30b74c7bd0f3" status: 404 len: 111 microversion: 2.1 time: 0.038862 Jun 22 10:20:49.051221 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 333/678] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:20:49 2022] GET /compute/v2.1/servers/86a421a6-9b8c-40a9-ab7e-30b74c7bd0f3 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 22 10:20:49.059209 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-abff0dfa-df08-427e-bf7e-b0c7c55c1cc5 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Calling method '.version_select at 0x7f36be491280>' {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:20:49.072764 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [None req-879a4181-163c-40db-a6b7-e9e45c2635b0 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.045012 Jun 22 10:20:49.073503 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 346/679] 10.222.0.43 () {60 vars in 1158 bytes} [Wed Jun 22 10:20:49 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 22 10:20:49.081454 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [None req-abff0dfa-df08-427e-bf7e-b0c7c55c1cc5 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] 10.222.0.43 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1141776868" status: 202 len: 0 microversion: 2.1 time: 0.025707 Jun 22 10:20:49.082085 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 334/680] 10.222.0.43 () {58 vars in 1220 bytes} [Wed Jun 22 10:20:49 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1141776868 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 22 10:20:49.274230 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [req-bc85116a-ce94-44ed-9927-9d99bfb7f85a req-eb02c5ea-8059-4ea6-9d55-adedb26b0749 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "86a421a6-9b8c-40a9-ab7e-30b74c7bd0f3", "name": "network-vif-deleted", "tag": "b3cb81b4-fc19-4acc-bb84-84c1f3b739b7"}]} {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:20:49.285472 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [req-bc85116a-ce94-44ed-9927-9d99bfb7f85a req-eb02c5ea-8059-4ea6-9d55-adedb26b0749 service nova] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:20:49.286636 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [req-bc85116a-ce94-44ed-9927-9d99bfb7f85a req-eb02c5ea-8059-4ea6-9d55-adedb26b0749 service nova] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:20:49.298884 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.compute.server_external_events [req-bc85116a-ce94-44ed-9927-9d99bfb7f85a req-eb02c5ea-8059-4ea6-9d55-adedb26b0749 service nova] Creating event network-vif-deleted:b3cb81b4-fc19-4acc-bb84-84c1f3b739b7 for instance 86a421a6-9b8c-40a9-ab7e-30b74c7bd0f3 on hv-cinder-84713 Jun 22 10:20:49.303885 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [req-bc85116a-ce94-44ed-9927-9d99bfb7f85a req-eb02c5ea-8059-4ea6-9d55-adedb26b0749 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038641 Jun 22 10:20:49.304567 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 347/681] 10.222.0.43 () {64 vars in 1317 bytes} [Wed Jun 22 10:20:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 22 10:20:49.734289 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [req-e93dba79-86d2-4042-919e-4be34f35819b req-471b7797-36c3-4804-9575-9fcc3e848a15 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "982a8b14-2931-49ee-bc63-124bb37fb8c4", "name": "network-vif-plugged", "status": "completed", "tag": "14658931-09ac-4ec1-9e21-53442e71aacc"}]} {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:20:49.744077 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [req-e93dba79-86d2-4042-919e-4be34f35819b req-471b7797-36c3-4804-9575-9fcc3e848a15 service nova] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:20:49.744432 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [req-e93dba79-86d2-4042-919e-4be34f35819b req-471b7797-36c3-4804-9575-9fcc3e848a15 service nova] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:20:49.762875 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.compute.server_external_events [req-e93dba79-86d2-4042-919e-4be34f35819b req-471b7797-36c3-4804-9575-9fcc3e848a15 service nova] Creating event network-vif-plugged:14658931-09ac-4ec1-9e21-53442e71aacc for instance 982a8b14-2931-49ee-bc63-124bb37fb8c4 on hv-cinder-84713 Jun 22 10:20:49.770322 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [req-e93dba79-86d2-4042-919e-4be34f35819b req-471b7797-36c3-4804-9575-9fcc3e848a15 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043866 Jun 22 10:20:49.771276 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 335/682] 10.222.0.43 () {64 vars in 1317 bytes} [Wed Jun 22 10:20:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 10:20:49.798304 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-6ca8b15e-de29-4cd8-93f7-9a80a805e648 tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Calling method '>' {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:20:49.799169 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.compute.api [None req-6ca8b15e-de29-4cd8-93f7-9a80a805e648 tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] [instance: 982a8b14-2931-49ee-bc63-124bb37fb8c4] Fetching instance by UUID {{(pid=117874) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:20:49.806665 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-6ca8b15e-de29-4cd8-93f7-9a80a805e648 tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:20:49.807923 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-6ca8b15e-de29-4cd8-93f7-9a80a805e648 tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:20:49.808972 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-6ca8b15e-de29-4cd8-93f7-9a80a805e648 tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:20:49.809627 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-6ca8b15e-de29-4cd8-93f7-9a80a805e648 tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:20:50.013116 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.policy [None req-6ca8b15e-de29-4cd8-93f7-9a80a805e648 tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7be3d844dcee4d19966fc7944463a0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78629282e2b74418a2c1cdac32576ef1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117874) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:20:50.022594 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [None req-6ca8b15e-de29-4cd8-93f7-9a80a805e648 tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] 10.222.0.43 "GET /compute/v2.1/servers/982a8b14-2931-49ee-bc63-124bb37fb8c4" status: 200 len: 1368 microversion: 2.1 time: 0.229071 Jun 22 10:20:50.023649 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 348/683] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:20:49 2022] GET /compute/v2.1/servers/982a8b14-2931-49ee-bc63-124bb37fb8c4 => generated 1368 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:20:50.547936 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-48257601-26c8-460d-9914-f77d227b3398 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1032365936", "imageRef": "22d2c064-5bf7-438e-bbb7-47259e4bdab5", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "f4e78d1e-cabc-488a-aae3-f9e986faebb4"}], "security_groups": [{"name": "tempest-securitygroup--1527014971"}], "key_name": "tempest-keypair-282820695", "user_data": "}} {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:20:50.649625 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.network.neutron [None req-48257601-26c8-460d-9914-f77d227b3398 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] validate_networks() for [('f4e78d1e-cabc-488a-aae3-f9e986faebb4', None, None, None, None, None)] {{(pid=117873) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 22 10:20:51.040667 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-5de673d6-c678-456c-8678-22256e508ca6 tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Calling method '>' {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:20:51.041287 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.compute.api [None req-5de673d6-c678-456c-8678-22256e508ca6 tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] [instance: 982a8b14-2931-49ee-bc63-124bb37fb8c4] Fetching instance by UUID {{(pid=117874) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:20:51.048422 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-5de673d6-c678-456c-8678-22256e508ca6 tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:20:51.048876 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-5de673d6-c678-456c-8678-22256e508ca6 tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:20:51.049794 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-5de673d6-c678-456c-8678-22256e508ca6 tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:20:51.050240 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-5de673d6-c678-456c-8678-22256e508ca6 tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:20:51.247796 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.policy [None req-5de673d6-c678-456c-8678-22256e508ca6 tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7be3d844dcee4d19966fc7944463a0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78629282e2b74418a2c1cdac32576ef1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117874) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:20:51.256349 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [None req-5de673d6-c678-456c-8678-22256e508ca6 tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] 10.222.0.43 "GET /compute/v2.1/servers/982a8b14-2931-49ee-bc63-124bb37fb8c4" status: 200 len: 1368 microversion: 2.1 time: 0.219741 Jun 22 10:20:51.257020 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 349/684] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:20:51 2022] GET /compute/v2.1/servers/982a8b14-2931-49ee-bc63-124bb37fb8c4 => generated 1368 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:20:51.335862 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.virt.hardware [None req-48257601-26c8-460d-9914-f77d227b3398 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Flavor limits 0:0:0 {{(pid=117873) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 22 10:20:51.336281 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.virt.hardware [None req-48257601-26c8-460d-9914-f77d227b3398 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Image limits 0:0:0 {{(pid=117873) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 22 10:20:51.336749 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.virt.hardware [None req-48257601-26c8-460d-9914-f77d227b3398 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Flavor pref 0:0:0 {{(pid=117873) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 22 10:20:51.337152 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.virt.hardware [None req-48257601-26c8-460d-9914-f77d227b3398 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Image pref 0:0:0 {{(pid=117873) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 22 10:20:51.337562 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.virt.hardware [None req-48257601-26c8-460d-9914-f77d227b3398 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117873) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 22 10:20:51.346985 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-48257601-26c8-460d-9914-f77d227b3398 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:20:51.347432 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-48257601-26c8-460d-9914-f77d227b3398 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:20:51.348219 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-48257601-26c8-460d-9914-f77d227b3398 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:20:51.348650 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-48257601-26c8-460d-9914-f77d227b3398 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:20:51.366191 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.quota [None req-48257601-26c8-460d-9914-f77d227b3398 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Getting quotas for project ad52333bcbec425089c44c3e55df97ff. Resources: {'instances', 'cores', 'ram'} {{(pid=117873) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 22 10:20:51.370116 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.quota [None req-48257601-26c8-460d-9914-f77d227b3398 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Getting quotas for user 78fe3fc4334c43d7a5ef6d70f9f57523 and project ad52333bcbec425089c44c3e55df97ff. Resources: {'instances', 'cores', 'ram'} {{(pid=117873) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 22 10:20:51.382850 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.compute.api [None req-48257601-26c8-460d-9914-f77d227b3398 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Going to run 1 instances... {{(pid=117873) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 22 10:20:51.385254 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.compute.api [None req-48257601-26c8-460d-9914-f77d227b3398 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] [instance: edabe652-f189-4feb-89b8-6bc768c1669d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='22d2c064-5bf7-438e-bbb7-47259e4bdab5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117873) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 22 10:20:51.431002 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [None req-48257601-26c8-460d-9914-f77d227b3398 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.888173 Jun 22 10:20:51.431652 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 336/685] 10.222.0.43 () {60 vars in 1146 bytes} [Wed Jun 22 10:20:50 2022] POST /compute/v2.1/servers => generated 402 bytes in 890 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 22 10:20:51.442532 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-eaa3a224-f447-41e6-b7d7-22c5dcd626a4 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Calling method '>' {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:20:51.443216 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.compute.api [None req-eaa3a224-f447-41e6-b7d7-22c5dcd626a4 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] [instance: edabe652-f189-4feb-89b8-6bc768c1669d] Fetching instance by UUID {{(pid=117874) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:20:51.505248 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.policy [None req-eaa3a224-f447-41e6-b7d7-22c5dcd626a4 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78fe3fc4334c43d7a5ef6d70f9f57523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad52333bcbec425089c44c3e55df97ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117874) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:20:51.512629 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [None req-eaa3a224-f447-41e6-b7d7-22c5dcd626a4 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] 10.222.0.43 "GET /compute/v2.1/servers/edabe652-f189-4feb-89b8-6bc768c1669d" status: 200 len: 1237 microversion: 2.1 time: 0.074095 Jun 22 10:20:51.513680 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 350/686] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:20:51 2022] GET /compute/v2.1/servers/edabe652-f189-4feb-89b8-6bc768c1669d => generated 1237 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:20:52.059097 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-6c971bce-d6a3-47da-b3b0-77fae1d7a459 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Calling method '>' {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:20:52.059637 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.compute.api [None req-6c971bce-d6a3-47da-b3b0-77fae1d7a459 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] [instance: 9f07e4bb-f4e9-428e-8feb-db50b3ff2109] Fetching instance by UUID {{(pid=117873) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:20:52.067229 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-6c971bce-d6a3-47da-b3b0-77fae1d7a459 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:20:52.067754 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-6c971bce-d6a3-47da-b3b0-77fae1d7a459 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:20:52.068584 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-6c971bce-d6a3-47da-b3b0-77fae1d7a459 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:20:52.069086 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-6c971bce-d6a3-47da-b3b0-77fae1d7a459 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:20:52.097402 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.compute.api [None req-6c971bce-d6a3-47da-b3b0-77fae1d7a459 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] [instance: 9f07e4bb-f4e9-428e-8feb-db50b3ff2109] Going to try to terminate instance {{(pid=117873) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 22 10:20:52.178520 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [None req-6c971bce-d6a3-47da-b3b0-77fae1d7a459 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] 10.222.0.43 "DELETE /compute/v2.1/servers/9f07e4bb-f4e9-428e-8feb-db50b3ff2109" status: 204 len: 0 microversion: 2.1 time: 0.123499 Jun 22 10:20:52.179087 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 337/687] 10.222.0.43 () {58 vars in 1238 bytes} [Wed Jun 22 10:20:52 2022] DELETE /compute/v2.1/servers/9f07e4bb-f4e9-428e-8feb-db50b3ff2109 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 22 10:20:52.187154 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-2f567113-d834-4bfa-a8cd-5f5c347299b3 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Calling method '>' {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:20:52.187753 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.compute.api [None req-2f567113-d834-4bfa-a8cd-5f5c347299b3 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] [instance: 9f07e4bb-f4e9-428e-8feb-db50b3ff2109] Fetching instance by UUID {{(pid=117874) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:20:52.195247 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-2f567113-d834-4bfa-a8cd-5f5c347299b3 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:20:52.195698 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-2f567113-d834-4bfa-a8cd-5f5c347299b3 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:20:52.196465 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-2f567113-d834-4bfa-a8cd-5f5c347299b3 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:20:52.196905 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-2f567113-d834-4bfa-a8cd-5f5c347299b3 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:20:52.274193 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-97df8139-7128-44b5-9cdf-1059daddd81f tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Calling method '>' {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:20:52.274815 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.compute.api [None req-97df8139-7128-44b5-9cdf-1059daddd81f tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] [instance: 982a8b14-2931-49ee-bc63-124bb37fb8c4] Fetching instance by UUID {{(pid=117873) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:20:52.281504 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-97df8139-7128-44b5-9cdf-1059daddd81f tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:20:52.282008 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-97df8139-7128-44b5-9cdf-1059daddd81f tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:20:52.282781 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-97df8139-7128-44b5-9cdf-1059daddd81f tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:20:52.283212 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-97df8139-7128-44b5-9cdf-1059daddd81f tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:20:52.340343 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.policy [None req-2f567113-d834-4bfa-a8cd-5f5c347299b3 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d7292401816437fba46d073c4746e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3277b9cbc4b4a8bbacee8440cea1ed2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117874) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:20:52.348423 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [None req-2f567113-d834-4bfa-a8cd-5f5c347299b3 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] 10.222.0.43 "GET /compute/v2.1/servers/9f07e4bb-f4e9-428e-8feb-db50b3ff2109" status: 200 len: 1507 microversion: 2.1 time: 0.165145 Jun 22 10:20:52.349099 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 351/688] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:20:52 2022] GET /compute/v2.1/servers/9f07e4bb-f4e9-428e-8feb-db50b3ff2109 => generated 1507 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:20:52.423204 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.policy [None req-97df8139-7128-44b5-9cdf-1059daddd81f tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7be3d844dcee4d19966fc7944463a0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78629282e2b74418a2c1cdac32576ef1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117873) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:20:52.432867 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [None req-97df8139-7128-44b5-9cdf-1059daddd81f tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] 10.222.0.43 "GET /compute/v2.1/servers/982a8b14-2931-49ee-bc63-124bb37fb8c4" status: 200 len: 1558 microversion: 2.1 time: 0.163048 Jun 22 10:20:52.433452 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 338/689] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:20:52 2022] GET /compute/v2.1/servers/982a8b14-2931-49ee-bc63-124bb37fb8c4 => generated 1558 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 10:20:52.449864 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-c3bf3882-dba1-4d16-9baa-a2085cd7857f tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Calling method '>' {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:20:52.450388 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.compute.api [None req-c3bf3882-dba1-4d16-9baa-a2085cd7857f tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] [instance: 982a8b14-2931-49ee-bc63-124bb37fb8c4] Fetching instance by UUID {{(pid=117874) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:20:52.456367 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-c3bf3882-dba1-4d16-9baa-a2085cd7857f tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:20:52.456826 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-c3bf3882-dba1-4d16-9baa-a2085cd7857f tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:20:52.457649 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-c3bf3882-dba1-4d16-9baa-a2085cd7857f tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:20:52.458125 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-c3bf3882-dba1-4d16-9baa-a2085cd7857f tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:20:52.529851 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-a09a6fea-638f-438d-ab29-8e990383fb60 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Calling method '>' {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:20:52.530477 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.compute.api [None req-a09a6fea-638f-438d-ab29-8e990383fb60 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] [instance: edabe652-f189-4feb-89b8-6bc768c1669d] Fetching instance by UUID {{(pid=117873) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:20:52.536973 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-a09a6fea-638f-438d-ab29-8e990383fb60 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:20:52.537426 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-a09a6fea-638f-438d-ab29-8e990383fb60 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:20:52.538232 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-a09a6fea-638f-438d-ab29-8e990383fb60 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:20:52.538660 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-a09a6fea-638f-438d-ab29-8e990383fb60 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:20:52.539147 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [None req-c3bf3882-dba1-4d16-9baa-a2085cd7857f tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] 10.222.0.43 "GET /compute/v2.1/servers/982a8b14-2931-49ee-bc63-124bb37fb8c4/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.093123 Jun 22 10:20:52.539760 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 352/690] 10.222.0.43 () {58 vars in 1274 bytes} [Wed Jun 22 10:20:52 2022] GET /compute/v2.1/servers/982a8b14-2931-49ee-bc63-124bb37fb8c4/os-interface => generated 285 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 10:20:52.621383 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.policy [None req-a09a6fea-638f-438d-ab29-8e990383fb60 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78fe3fc4334c43d7a5ef6d70f9f57523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad52333bcbec425089c44c3e55df97ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117873) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:20:52.629366 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [None req-a09a6fea-638f-438d-ab29-8e990383fb60 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] 10.222.0.43 "GET /compute/v2.1/servers/edabe652-f189-4feb-89b8-6bc768c1669d" status: 200 len: 1297 microversion: 2.1 time: 0.103447 Jun 22 10:20:52.629972 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 339/691] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:20:52 2022] GET /compute/v2.1/servers/edabe652-f189-4feb-89b8-6bc768c1669d => generated 1297 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 10:20:53.366220 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-aa294340-30f5-49e1-8f62-18bb29cdc961 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Calling method '>' {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:20:53.366830 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.compute.api [None req-aa294340-30f5-49e1-8f62-18bb29cdc961 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] [instance: 9f07e4bb-f4e9-428e-8feb-db50b3ff2109] Fetching instance by UUID {{(pid=117874) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:20:53.373013 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-aa294340-30f5-49e1-8f62-18bb29cdc961 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:20:53.373468 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-aa294340-30f5-49e1-8f62-18bb29cdc961 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:20:53.374284 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-aa294340-30f5-49e1-8f62-18bb29cdc961 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:20:53.374842 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-aa294340-30f5-49e1-8f62-18bb29cdc961 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:20:53.563390 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [req-29ed46d8-44f4-4974-8790-fd57c916d28d req-770dac0a-164e-4260-adc5-65dba2fc51b8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "982a8b14-2931-49ee-bc63-124bb37fb8c4", "tag": "14658931-09ac-4ec1-9e21-53442e71aacc"}]} {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:20:53.572550 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [req-29ed46d8-44f4-4974-8790-fd57c916d28d req-770dac0a-164e-4260-adc5-65dba2fc51b8 service nova] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:20:53.573120 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [req-29ed46d8-44f4-4974-8790-fd57c916d28d req-770dac0a-164e-4260-adc5-65dba2fc51b8 service nova] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:20:53.575800 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.policy [None req-aa294340-30f5-49e1-8f62-18bb29cdc961 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d7292401816437fba46d073c4746e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3277b9cbc4b4a8bbacee8440cea1ed2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117874) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:20:53.584079 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [None req-aa294340-30f5-49e1-8f62-18bb29cdc961 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] 10.222.0.43 "GET /compute/v2.1/servers/9f07e4bb-f4e9-428e-8feb-db50b3ff2109" status: 200 len: 1507 microversion: 2.1 time: 0.222155 Jun 22 10:20:53.594110 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 353/692] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:20:53 2022] GET /compute/v2.1/servers/9f07e4bb-f4e9-428e-8feb-db50b3ff2109 => generated 1507 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:20:53.594268 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.compute.server_external_events [req-29ed46d8-44f4-4974-8790-fd57c916d28d req-770dac0a-164e-4260-adc5-65dba2fc51b8 service nova] Creating event network-changed:14658931-09ac-4ec1-9e21-53442e71aacc for instance 982a8b14-2931-49ee-bc63-124bb37fb8c4 on hv-cinder-84713 Jun 22 10:20:53.596727 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [req-29ed46d8-44f4-4974-8790-fd57c916d28d req-770dac0a-164e-4260-adc5-65dba2fc51b8 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036931 Jun 22 10:20:53.597266 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 340/693] 10.222.0.43 () {64 vars in 1317 bytes} [Wed Jun 22 10:20:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 10:20:53.646283 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-62ce622a-316c-42f9-888d-e7495f4f33b7 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Calling method '>' {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:20:53.647006 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.compute.api [None req-62ce622a-316c-42f9-888d-e7495f4f33b7 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] [instance: edabe652-f189-4feb-89b8-6bc768c1669d] Fetching instance by UUID {{(pid=117874) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:20:53.652944 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-62ce622a-316c-42f9-888d-e7495f4f33b7 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:20:53.653384 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-62ce622a-316c-42f9-888d-e7495f4f33b7 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:20:53.654168 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-62ce622a-316c-42f9-888d-e7495f4f33b7 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:20:53.654590 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-62ce622a-316c-42f9-888d-e7495f4f33b7 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:20:53.715034 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.policy [None req-62ce622a-316c-42f9-888d-e7495f4f33b7 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78fe3fc4334c43d7a5ef6d70f9f57523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad52333bcbec425089c44c3e55df97ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117874) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:20:53.723183 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [None req-62ce622a-316c-42f9-888d-e7495f4f33b7 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] 10.222.0.43 "GET /compute/v2.1/servers/edabe652-f189-4feb-89b8-6bc768c1669d" status: 200 len: 1297 microversion: 2.1 time: 0.080708 Jun 22 10:20:53.723752 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 354/694] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:20:53 2022] GET /compute/v2.1/servers/edabe652-f189-4feb-89b8-6bc768c1669d => generated 1297 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:20:54.602174 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-afd83b85-2ac0-4c72-a2a8-7d146a210138 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Calling method '>' {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:20:54.603794 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.compute.api [None req-afd83b85-2ac0-4c72-a2a8-7d146a210138 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] [instance: 9f07e4bb-f4e9-428e-8feb-db50b3ff2109] Fetching instance by UUID {{(pid=117873) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:20:54.611871 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-afd83b85-2ac0-4c72-a2a8-7d146a210138 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:20:54.612416 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-afd83b85-2ac0-4c72-a2a8-7d146a210138 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:20:54.613524 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-afd83b85-2ac0-4c72-a2a8-7d146a210138 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:20:54.613811 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-afd83b85-2ac0-4c72-a2a8-7d146a210138 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:20:54.740232 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-b253ec6e-b2be-407d-a83f-9056571cc66d tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Calling method '>' {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:20:54.740843 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.compute.api [None req-b253ec6e-b2be-407d-a83f-9056571cc66d tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] [instance: edabe652-f189-4feb-89b8-6bc768c1669d] Fetching instance by UUID {{(pid=117874) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:20:54.747380 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-b253ec6e-b2be-407d-a83f-9056571cc66d tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:20:54.747823 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-b253ec6e-b2be-407d-a83f-9056571cc66d tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:20:54.748587 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-b253ec6e-b2be-407d-a83f-9056571cc66d tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:20:54.749025 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-b253ec6e-b2be-407d-a83f-9056571cc66d tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:20:54.769332 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.policy [None req-afd83b85-2ac0-4c72-a2a8-7d146a210138 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d7292401816437fba46d073c4746e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3277b9cbc4b4a8bbacee8440cea1ed2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117873) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:20:54.777054 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [None req-afd83b85-2ac0-4c72-a2a8-7d146a210138 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] 10.222.0.43 "GET /compute/v2.1/servers/9f07e4bb-f4e9-428e-8feb-db50b3ff2109" status: 200 len: 1507 microversion: 2.1 time: 0.179142 Jun 22 10:20:54.777632 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 341/695] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:20:54 2022] GET /compute/v2.1/servers/9f07e4bb-f4e9-428e-8feb-db50b3ff2109 => generated 1507 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:20:54.820454 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.policy [None req-b253ec6e-b2be-407d-a83f-9056571cc66d tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78fe3fc4334c43d7a5ef6d70f9f57523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad52333bcbec425089c44c3e55df97ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117874) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:20:54.828841 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [None req-b253ec6e-b2be-407d-a83f-9056571cc66d tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] 10.222.0.43 "GET /compute/v2.1/servers/edabe652-f189-4feb-89b8-6bc768c1669d" status: 200 len: 1295 microversion: 2.1 time: 0.092485 Jun 22 10:20:54.829418 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 355/696] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:20:54 2022] GET /compute/v2.1/servers/edabe652-f189-4feb-89b8-6bc768c1669d => generated 1295 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 10:20:55.655542 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-f8dbf1b2-ba7b-4a71-bf55-e21d25c7378f tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Calling method '>' {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:20:55.656499 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.compute.api [None req-f8dbf1b2-ba7b-4a71-bf55-e21d25c7378f tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] [instance: b357b60f-93be-4898-a651-4a407a7dc490] Fetching instance by UUID {{(pid=117873) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:20:55.662414 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-f8dbf1b2-ba7b-4a71-bf55-e21d25c7378f tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:20:55.662853 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-f8dbf1b2-ba7b-4a71-bf55-e21d25c7378f tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:20:55.663607 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-f8dbf1b2-ba7b-4a71-bf55-e21d25c7378f tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:20:55.664034 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-f8dbf1b2-ba7b-4a71-bf55-e21d25c7378f tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:20:55.687985 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [None req-f8dbf1b2-ba7b-4a71-bf55-e21d25c7378f tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] 10.222.0.43 "GET /compute/v2.1/servers/b357b60f-93be-4898-a651-4a407a7dc490/ips" status: 200 len: 152 microversion: 2.20 time: 0.095257 Jun 22 10:20:55.688794 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 342/697] 10.222.0.43 () {60 vars in 1288 bytes} [Wed Jun 22 10:20:55 2022] GET /compute/v2.1/servers/b357b60f-93be-4898-a651-4a407a7dc490/ips => generated 152 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 22 10:20:55.794270 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-6f3c30dc-6e9a-4336-ac4d-33ace1ccc845 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Calling method '>' {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:20:55.797578 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.compute.api [None req-6f3c30dc-6e9a-4336-ac4d-33ace1ccc845 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] [instance: 9f07e4bb-f4e9-428e-8feb-db50b3ff2109] Fetching instance by UUID {{(pid=117874) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:20:55.804608 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-6f3c30dc-6e9a-4336-ac4d-33ace1ccc845 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:20:55.805272 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-6f3c30dc-6e9a-4336-ac4d-33ace1ccc845 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:20:55.806232 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-6f3c30dc-6e9a-4336-ac4d-33ace1ccc845 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:20:55.806831 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-6f3c30dc-6e9a-4336-ac4d-33ace1ccc845 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:20:55.848098 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-7df9b6ba-51ce-47fb-a7db-1fe6236f008c tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Calling method '>' {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:20:55.849883 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.compute.api [None req-7df9b6ba-51ce-47fb-a7db-1fe6236f008c tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] [instance: edabe652-f189-4feb-89b8-6bc768c1669d] Fetching instance by UUID {{(pid=117873) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:20:55.860468 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-7df9b6ba-51ce-47fb-a7db-1fe6236f008c tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:20:55.861321 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-7df9b6ba-51ce-47fb-a7db-1fe6236f008c tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:20:55.862478 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-7df9b6ba-51ce-47fb-a7db-1fe6236f008c tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:20:55.863066 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-7df9b6ba-51ce-47fb-a7db-1fe6236f008c tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:20:55.976572 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.policy [None req-7df9b6ba-51ce-47fb-a7db-1fe6236f008c tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78fe3fc4334c43d7a5ef6d70f9f57523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad52333bcbec425089c44c3e55df97ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117873) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:20:55.991020 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [None req-7df9b6ba-51ce-47fb-a7db-1fe6236f008c tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] 10.222.0.43 "GET /compute/v2.1/servers/edabe652-f189-4feb-89b8-6bc768c1669d" status: 200 len: 1295 microversion: 2.1 time: 0.147963 Jun 22 10:20:55.992020 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 343/698] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:20:55 2022] GET /compute/v2.1/servers/edabe652-f189-4feb-89b8-6bc768c1669d => generated 1295 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:20:56.018479 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.policy [None req-6f3c30dc-6e9a-4336-ac4d-33ace1ccc845 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d7292401816437fba46d073c4746e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3277b9cbc4b4a8bbacee8440cea1ed2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117874) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:20:56.027267 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [None req-6f3c30dc-6e9a-4336-ac4d-33ace1ccc845 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] 10.222.0.43 "GET /compute/v2.1/servers/9f07e4bb-f4e9-428e-8feb-db50b3ff2109" status: 200 len: 1507 microversion: 2.1 time: 0.237013 Jun 22 10:20:56.028164 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 356/699] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:20:55 2022] GET /compute/v2.1/servers/9f07e4bb-f4e9-428e-8feb-db50b3ff2109 => generated 1507 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:20:56.248214 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [req-c93144dc-8f86-4ab8-ad4f-980832dbf55e req-f31ee272-f65b-490b-8431-1051ea0f64d1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9f07e4bb-f4e9-428e-8feb-db50b3ff2109", "name": "network-vif-deleted", "tag": "211d6c80-be72-4645-8f0a-ec8e4b68c761"}]} {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:20:56.258368 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [req-c93144dc-8f86-4ab8-ad4f-980832dbf55e req-f31ee272-f65b-490b-8431-1051ea0f64d1 service nova] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:20:56.259243 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [req-c93144dc-8f86-4ab8-ad4f-980832dbf55e req-f31ee272-f65b-490b-8431-1051ea0f64d1 service nova] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:20:56.273301 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.compute.server_external_events [req-c93144dc-8f86-4ab8-ad4f-980832dbf55e req-f31ee272-f65b-490b-8431-1051ea0f64d1 service nova] Creating event network-vif-deleted:211d6c80-be72-4645-8f0a-ec8e4b68c761 for instance 9f07e4bb-f4e9-428e-8feb-db50b3ff2109 on hv-cinder-84713 Jun 22 10:20:56.281426 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [req-c93144dc-8f86-4ab8-ad4f-980832dbf55e req-f31ee272-f65b-490b-8431-1051ea0f64d1 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038645 Jun 22 10:20:56.282340 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 344/700] 10.222.0.43 () {64 vars in 1317 bytes} [Wed Jun 22 10:20:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 22 10:20:57.008495 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-6d35ade4-84d7-4cc5-8303-af423a098972 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Calling method '>' {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:20:57.009818 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.compute.api [None req-6d35ade4-84d7-4cc5-8303-af423a098972 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] [instance: edabe652-f189-4feb-89b8-6bc768c1669d] Fetching instance by UUID {{(pid=117874) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:20:57.017914 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-6d35ade4-84d7-4cc5-8303-af423a098972 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:20:57.018605 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-6d35ade4-84d7-4cc5-8303-af423a098972 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:20:57.019901 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-6d35ade4-84d7-4cc5-8303-af423a098972 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:20:57.020586 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-6d35ade4-84d7-4cc5-8303-af423a098972 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:20:57.044362 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-248686f9-d4f1-4f74-b100-793eeb72b3a3 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Calling method '>' {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:20:57.045678 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.compute.api [None req-248686f9-d4f1-4f74-b100-793eeb72b3a3 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] [instance: 9f07e4bb-f4e9-428e-8feb-db50b3ff2109] Fetching instance by UUID {{(pid=117873) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:20:57.054615 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-248686f9-d4f1-4f74-b100-793eeb72b3a3 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:20:57.057802 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-248686f9-d4f1-4f74-b100-793eeb72b3a3 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:20:57.060086 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-248686f9-d4f1-4f74-b100-793eeb72b3a3 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:20:57.066786 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-248686f9-d4f1-4f74-b100-793eeb72b3a3 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:20:57.089140 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.wsgi [None req-248686f9-d4f1-4f74-b100-793eeb72b3a3 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] HTTP exception thrown: Instance 9f07e4bb-f4e9-428e-8feb-db50b3ff2109 could not be found. Jun 22 10:20:57.091181 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-248686f9-d4f1-4f74-b100-793eeb72b3a3 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Request method failure captured: Jun 22 10:20:57.091181 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: request: GET /compute/v2.1/servers/9f07e4bb-f4e9-428e-8feb-db50b3ff2109 HTTP/1.1 Jun 22 10:20:57.091181 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: Accept: application/json Jun 22 10:20:57.091181 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: Accept-Encoding: identity Jun 22 10:20:57.091181 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: Connection: close Jun 22 10:20:57.091181 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: Content-Length: 0 Jun 22 10:20:57.091181 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: Content-Type: application/json Jun 22 10:20:57.091181 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: Host: 10.222.0.43 Jun 22 10:20:57.091181 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: Openstack-System-Scope: None Jun 22 10:20:57.091181 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: User-Agent: python-urllib3/1.26.9 Jun 22 10:20:57.091181 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-Auth-Token: gAAAAABisuvjVgSjiKizNMOSSpCqXljNGSFOhAJqDEs6LcefAlRz8CAyn7YtQIZuzfdzoXcb1I3sPaeBjRE3nGlR4nfnglF3o0W8ZwIXa-t2T7Kvu9u_9tTAcMDpcQ53GMtzR-i0HixNHH9XjiiRNTwzoo0r6BKSTSNuiStSMHwEgpkRgSyLC2I Jun 22 10:20:57.091181 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-Domain-Id: None Jun 22 10:20:57.091181 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-Domain-Name: None Jun 22 10:20:57.091181 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-Identity-Status: Confirmed Jun 22 10:20:57.091181 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-Is-Admin-Project: True Jun 22 10:20:57.091181 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-Project-Domain-Id: default Jun 22 10:20:57.091181 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-Project-Domain-Name: Default Jun 22 10:20:57.091181 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-Project-Id: c3277b9cbc4b4a8bbacee8440cea1ed2 Jun 22 10:20:57.091181 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-2023039799 Jun 22 10:20:57.091181 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-Role: reader,member Jun 22 10:20:57.091181 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-Roles: reader,member Jun 22 10:20:57.092462 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/c3277b9cbc4b4a8bbacee8440cea1ed2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/c3277b9cbc4b4a8bbacee8440cea1ed2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_c3277b9cbc4b4a8bbacee8440cea1ed2", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/c3277b9cbc4b4a8bbacee8440cea1ed2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}] Jun 22 10:20:57.092462 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-Tenant: tempest-ServerRescueNegativeTestJSON-2023039799 Jun 22 10:20:57.092462 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-Tenant-Id: c3277b9cbc4b4a8bbacee8440cea1ed2 Jun 22 10:20:57.092462 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-2023039799 Jun 22 10:20:57.092462 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-User: tempest-ServerRescueNegativeTestJSON-2023039799-project Jun 22 10:20:57.092462 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-User-Domain-Id: default Jun 22 10:20:57.092462 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-User-Domain-Name: Default Jun 22 10:20:57.092462 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-User-Id: 0d7292401816437fba46d073c4746e45 Jun 22 10:20:57.092462 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-User-Name: tempest-ServerRescueNegativeTestJSON-2023039799-project Jun 22 10:20:57.092462 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: method: > Jun 22 10:20:57.092462 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: exception: Instance 9f07e4bb-f4e9-428e-8feb-db50b3ff2109 could not be found. Jun 22 10:20:57.092462 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: action_args: {'id': '9f07e4bb-f4e9-428e-8feb-db50b3ff2109'} Jun 22 10:20:57.093155 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 10:20:57.093155 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:20:57.093155 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 22 10:20:57.093155 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 22 10:20:57.093155 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 22 10:20:57.093155 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 22 10:20:57.093155 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 22 10:20:57.093155 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 22 10:20:57.093155 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 22 10:20:57.093155 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 22 10:20:57.093155 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9f07e4bb-f4e9-428e-8feb-db50b3ff2109 could not be found. Jun 22 10:20:57.093155 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi Jun 22 10:20:57.093155 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 10:20:57.093155 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi Jun 22 10:20:57.093155 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:20:57.093155 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 10:20:57.093155 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 10:20:57.093155 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 10:20:57.093155 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 10:20:57.093155 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 10:20:57.094344 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 10:20:57.094344 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 22 10:20:57.094344 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 22 10:20:57.094344 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 22 10:20:57.094344 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 22 10:20:57.094344 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 22 10:20:57.094344 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 22 10:20:57.094344 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9f07e4bb-f4e9-428e-8feb-db50b3ff2109 could not be found. Jun 22 10:20:57.094344 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi Jun 22 10:20:57.094344 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 10:20:57.094344 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi Jun 22 10:20:57.094344 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:20:57.094344 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 10:20:57.094344 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 10:20:57.094344 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 10:20:57.094344 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 10:20:57.094344 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9f07e4bb-f4e9-428e-8feb-db50b3ff2109 could not be found. Jun 22 10:20:57.094344 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi Jun 22 10:20:57.097404 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-248686f9-d4f1-4f74-b100-793eeb72b3a3 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Returning 404 to user: Instance 9f07e4bb-f4e9-428e-8feb-db50b3ff2109 could not be found. {{(pid=117873) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 10:20:57.098558 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [None req-248686f9-d4f1-4f74-b100-793eeb72b3a3 tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] 10.222.0.43 "GET /compute/v2.1/servers/9f07e4bb-f4e9-428e-8feb-db50b3ff2109" status: 404 len: 111 microversion: 2.1 time: 0.058313 Jun 22 10:20:57.099396 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 345/701] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:20:57 2022] GET /compute/v2.1/servers/9f07e4bb-f4e9-428e-8feb-db50b3ff2109 => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 22 10:20:57.108901 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-12c255e9-d9af-4828-ad82-5b9f7d47eb0f tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Calling method '>' {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:20:57.112135 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.compute.api [None req-12c255e9-d9af-4828-ad82-5b9f7d47eb0f tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] [instance: a8d495ae-295a-4ffa-a2d9-5774249e687d] Fetching instance by UUID {{(pid=117873) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:20:57.121818 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-12c255e9-d9af-4828-ad82-5b9f7d47eb0f tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:20:57.122271 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-12c255e9-d9af-4828-ad82-5b9f7d47eb0f tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:20:57.123047 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-12c255e9-d9af-4828-ad82-5b9f7d47eb0f tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:20:57.123567 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-12c255e9-d9af-4828-ad82-5b9f7d47eb0f tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:20:57.153176 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.compute.api [None req-12c255e9-d9af-4828-ad82-5b9f7d47eb0f tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] [instance: a8d495ae-295a-4ffa-a2d9-5774249e687d] Going to try to terminate instance {{(pid=117873) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 22 10:20:57.252338 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.policy [None req-6d35ade4-84d7-4cc5-8303-af423a098972 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78fe3fc4334c43d7a5ef6d70f9f57523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad52333bcbec425089c44c3e55df97ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117874) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:20:57.261520 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [None req-6d35ade4-84d7-4cc5-8303-af423a098972 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] 10.222.0.43 "GET /compute/v2.1/servers/edabe652-f189-4feb-89b8-6bc768c1669d" status: 200 len: 1363 microversion: 2.1 time: 0.256778 Jun 22 10:20:57.262930 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 357/702] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:20:57 2022] GET /compute/v2.1/servers/edabe652-f189-4feb-89b8-6bc768c1669d => generated 1363 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:20:57.268633 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [None req-12c255e9-d9af-4828-ad82-5b9f7d47eb0f tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] 10.222.0.43 "DELETE /compute/v2.1/servers/a8d495ae-295a-4ffa-a2d9-5774249e687d" status: 204 len: 0 microversion: 2.1 time: 0.164331 Jun 22 10:20:57.269600 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 346/703] 10.222.0.43 () {58 vars in 1238 bytes} [Wed Jun 22 10:20:57 2022] DELETE /compute/v2.1/servers/a8d495ae-295a-4ffa-a2d9-5774249e687d => generated 0 bytes in 166 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 22 10:20:57.279132 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-878cf280-3662-4e89-af2e-808e35afe39c tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Calling method '>' {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:20:57.279801 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.compute.api [None req-878cf280-3662-4e89-af2e-808e35afe39c tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] [instance: a8d495ae-295a-4ffa-a2d9-5774249e687d] Fetching instance by UUID {{(pid=117874) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:20:57.287387 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-878cf280-3662-4e89-af2e-808e35afe39c tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:20:57.288007 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-878cf280-3662-4e89-af2e-808e35afe39c tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:20:57.288884 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-878cf280-3662-4e89-af2e-808e35afe39c tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:20:57.289396 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-878cf280-3662-4e89-af2e-808e35afe39c tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:20:57.432488 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.policy [None req-878cf280-3662-4e89-af2e-808e35afe39c tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d7292401816437fba46d073c4746e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3277b9cbc4b4a8bbacee8440cea1ed2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117874) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:20:57.441334 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [None req-878cf280-3662-4e89-af2e-808e35afe39c tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] 10.222.0.43 "GET /compute/v2.1/servers/a8d495ae-295a-4ffa-a2d9-5774249e687d" status: 200 len: 1523 microversion: 2.1 time: 0.167433 Jun 22 10:20:57.441920 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 358/704] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:20:57 2022] GET /compute/v2.1/servers/a8d495ae-295a-4ffa-a2d9-5774249e687d => generated 1523 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:20:57.600793 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-2f411594-64a3-4606-bf3a-2ccc91dc1d5c tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:20:57.601403 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.compute.api [None req-2f411594-64a3-4606-bf3a-2ccc91dc1d5c tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] [instance: b357b60f-93be-4898-a651-4a407a7dc490] Fetching instance by UUID {{(pid=117873) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:20:57.607691 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-2f411594-64a3-4606-bf3a-2ccc91dc1d5c tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:20:57.608131 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-2f411594-64a3-4606-bf3a-2ccc91dc1d5c tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:20:57.609506 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-2f411594-64a3-4606-bf3a-2ccc91dc1d5c tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:20:57.609977 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-2f411594-64a3-4606-bf3a-2ccc91dc1d5c tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:20:57.632795 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.objects.instance [None req-2f411594-64a3-4606-bf3a-2ccc91dc1d5c tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lazy-loading 'flavor' on Instance uuid b357b60f-93be-4898-a651-4a407a7dc490 {{(pid=117873) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 22 10:20:57.888252 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [None req-2f411594-64a3-4606-bf3a-2ccc91dc1d5c tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] 10.222.0.43 "POST /compute/v2.1/servers/b357b60f-93be-4898-a651-4a407a7dc490/action" status: 202 len: 0 microversion: 2.20 time: 0.291554 Jun 22 10:20:57.888863 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 347/705] 10.222.0.43 () {62 vars in 1318 bytes} [Wed Jun 22 10:20:57 2022] POST /compute/v2.1/servers/b357b60f-93be-4898-a651-4a407a7dc490/action => generated 0 bytes in 293 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 22 10:20:57.897583 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-b89bad39-f863-4c38-960a-8fcd6f3c6bc3 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Calling method '>' {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:20:57.898392 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.compute.api [None req-b89bad39-f863-4c38-960a-8fcd6f3c6bc3 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] [instance: b357b60f-93be-4898-a651-4a407a7dc490] Fetching instance by UUID {{(pid=117874) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:20:57.906408 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-b89bad39-f863-4c38-960a-8fcd6f3c6bc3 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:20:57.906852 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-b89bad39-f863-4c38-960a-8fcd6f3c6bc3 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:20:57.907617 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-b89bad39-f863-4c38-960a-8fcd6f3c6bc3 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:20:57.908053 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-b89bad39-f863-4c38-960a-8fcd6f3c6bc3 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:20:58.035545 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.policy [None req-b89bad39-f863-4c38-960a-8fcd6f3c6bc3 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75753b29a78640df9622d4e2655baf9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee9d603d9cc4a8797f55d544f189720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117874) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:20:58.043622 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.policy [None req-b89bad39-f863-4c38-960a-8fcd6f3c6bc3 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75753b29a78640df9622d4e2655baf9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee9d603d9cc4a8797f55d544f189720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117874) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:20:58.045103 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.policy [None req-b89bad39-f863-4c38-960a-8fcd6f3c6bc3 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75753b29a78640df9622d4e2655baf9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee9d603d9cc4a8797f55d544f189720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117874) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:20:58.047010 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [None req-b89bad39-f863-4c38-960a-8fcd6f3c6bc3 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] 10.222.0.43 "GET /compute/v2.1/servers/b357b60f-93be-4898-a651-4a407a7dc490" status: 200 len: 1721 microversion: 2.20 time: 0.152958 Jun 22 10:20:58.047566 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 359/706] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jun 22 10:20:57 2022] GET /compute/v2.1/servers/b357b60f-93be-4898-a651-4a407a7dc490 => generated 1721 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 10:20:58.281077 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-01ec7eb0-8677-4884-b954-8fd451af1aa5 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Calling method '>' {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:20:58.281763 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.compute.api [None req-01ec7eb0-8677-4884-b954-8fd451af1aa5 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] [instance: edabe652-f189-4feb-89b8-6bc768c1669d] Fetching instance by UUID {{(pid=117873) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:20:58.288266 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-01ec7eb0-8677-4884-b954-8fd451af1aa5 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:20:58.288543 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-01ec7eb0-8677-4884-b954-8fd451af1aa5 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:20:58.289297 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-01ec7eb0-8677-4884-b954-8fd451af1aa5 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:20:58.289838 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-01ec7eb0-8677-4884-b954-8fd451af1aa5 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:20:58.297402 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [req-f6e0113f-1efb-4aab-b187-e7408257e434 req-c9977d8e-10ed-4780-9635-3fbb725289a3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "edabe652-f189-4feb-89b8-6bc768c1669d", "tag": "181865e7-8701-4ee4-8619-52218e16c189"}]} {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:20:58.300994 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG dbcounter [-] [117874] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=117874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:20:58.306797 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [req-f6e0113f-1efb-4aab-b187-e7408257e434 req-c9977d8e-10ed-4780-9635-3fbb725289a3 service nova] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:20:58.307238 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [req-f6e0113f-1efb-4aab-b187-e7408257e434 req-c9977d8e-10ed-4780-9635-3fbb725289a3 service nova] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:20:58.318862 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.compute.server_external_events [req-f6e0113f-1efb-4aab-b187-e7408257e434 req-c9977d8e-10ed-4780-9635-3fbb725289a3 service nova] Creating event network-changed:181865e7-8701-4ee4-8619-52218e16c189 for instance edabe652-f189-4feb-89b8-6bc768c1669d on hv-cinder-84713 Jun 22 10:20:58.323932 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [req-f6e0113f-1efb-4aab-b187-e7408257e434 req-c9977d8e-10ed-4780-9635-3fbb725289a3 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030194 Jun 22 10:20:58.324536 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 360/707] 10.222.0.43 () {64 vars in 1317 bytes} [Wed Jun 22 10:20:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 22 10:20:58.423775 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.policy [None req-01ec7eb0-8677-4884-b954-8fd451af1aa5 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78fe3fc4334c43d7a5ef6d70f9f57523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad52333bcbec425089c44c3e55df97ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117873) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:20:58.431194 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [None req-01ec7eb0-8677-4884-b954-8fd451af1aa5 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] 10.222.0.43 "GET /compute/v2.1/servers/edabe652-f189-4feb-89b8-6bc768c1669d" status: 200 len: 1363 microversion: 2.1 time: 0.155558 Jun 22 10:20:58.431761 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 348/708] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:20:58 2022] GET /compute/v2.1/servers/edabe652-f189-4feb-89b8-6bc768c1669d => generated 1363 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:20:58.459357 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-81b08cb3-c4af-4e51-a594-1b4d8e15ce0a tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Calling method '>' {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:20:58.460170 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.compute.api [None req-81b08cb3-c4af-4e51-a594-1b4d8e15ce0a tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] [instance: a8d495ae-295a-4ffa-a2d9-5774249e687d] Fetching instance by UUID {{(pid=117874) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:20:58.466922 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-81b08cb3-c4af-4e51-a594-1b4d8e15ce0a tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:20:58.467368 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-81b08cb3-c4af-4e51-a594-1b4d8e15ce0a tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:20:58.468943 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-81b08cb3-c4af-4e51-a594-1b4d8e15ce0a tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:20:58.469347 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-81b08cb3-c4af-4e51-a594-1b4d8e15ce0a tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:20:58.595214 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.policy [None req-81b08cb3-c4af-4e51-a594-1b4d8e15ce0a tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d7292401816437fba46d073c4746e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3277b9cbc4b4a8bbacee8440cea1ed2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117874) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:20:58.602898 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [None req-81b08cb3-c4af-4e51-a594-1b4d8e15ce0a tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] 10.222.0.43 "GET /compute/v2.1/servers/a8d495ae-295a-4ffa-a2d9-5774249e687d" status: 200 len: 1523 microversion: 2.1 time: 0.147965 Jun 22 10:20:58.603468 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 361/709] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:20:58 2022] GET /compute/v2.1/servers/a8d495ae-295a-4ffa-a2d9-5774249e687d => generated 1523 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:20:59.065943 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-87de23b2-ab3c-4133-9e13-15e288a4b3c2 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Calling method '>' {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:20:59.066539 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.compute.api [None req-87de23b2-ab3c-4133-9e13-15e288a4b3c2 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] [instance: b357b60f-93be-4898-a651-4a407a7dc490] Fetching instance by UUID {{(pid=117873) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:20:59.072513 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-87de23b2-ab3c-4133-9e13-15e288a4b3c2 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:20:59.072955 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-87de23b2-ab3c-4133-9e13-15e288a4b3c2 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:20:59.073711 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-87de23b2-ab3c-4133-9e13-15e288a4b3c2 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:20:59.074149 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-87de23b2-ab3c-4133-9e13-15e288a4b3c2 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:20:59.089226 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG dbcounter [-] [117873] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=117873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:20:59.208092 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.policy [None req-87de23b2-ab3c-4133-9e13-15e288a4b3c2 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75753b29a78640df9622d4e2655baf9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee9d603d9cc4a8797f55d544f189720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117873) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:20:59.217459 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.policy [None req-87de23b2-ab3c-4133-9e13-15e288a4b3c2 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75753b29a78640df9622d4e2655baf9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee9d603d9cc4a8797f55d544f189720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117873) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:20:59.219652 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.policy [None req-87de23b2-ab3c-4133-9e13-15e288a4b3c2 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75753b29a78640df9622d4e2655baf9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee9d603d9cc4a8797f55d544f189720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117873) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:20:59.220804 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [None req-87de23b2-ab3c-4133-9e13-15e288a4b3c2 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] 10.222.0.43 "GET /compute/v2.1/servers/b357b60f-93be-4898-a651-4a407a7dc490" status: 200 len: 1721 microversion: 2.20 time: 0.158851 Jun 22 10:20:59.221363 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 349/710] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jun 22 10:20:59 2022] GET /compute/v2.1/servers/b357b60f-93be-4898-a651-4a407a7dc490 => generated 1721 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 10:20:59.448292 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-a9561a88-4415-47fb-b741-2eb40f81ddab tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Calling method '>' {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:20:59.448933 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.compute.api [None req-a9561a88-4415-47fb-b741-2eb40f81ddab tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] [instance: edabe652-f189-4feb-89b8-6bc768c1669d] Fetching instance by UUID {{(pid=117874) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:20:59.456689 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-a9561a88-4415-47fb-b741-2eb40f81ddab tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:20:59.457133 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-a9561a88-4415-47fb-b741-2eb40f81ddab tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:20:59.458043 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-a9561a88-4415-47fb-b741-2eb40f81ddab tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:20:59.458498 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-a9561a88-4415-47fb-b741-2eb40f81ddab tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:20:59.588867 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.policy [None req-a9561a88-4415-47fb-b741-2eb40f81ddab tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78fe3fc4334c43d7a5ef6d70f9f57523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad52333bcbec425089c44c3e55df97ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117874) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:20:59.592458 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG dbcounter [-] [117874] Writing DB stats nova_cell1:SELECT=100 {{(pid=117874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:20:59.597603 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [None req-a9561a88-4415-47fb-b741-2eb40f81ddab tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] 10.222.0.43 "GET /compute/v2.1/servers/edabe652-f189-4feb-89b8-6bc768c1669d" status: 200 len: 1363 microversion: 2.1 time: 0.153184 Jun 22 10:20:59.598199 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 362/711] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:20:59 2022] GET /compute/v2.1/servers/edabe652-f189-4feb-89b8-6bc768c1669d => generated 1363 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:20:59.619283 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-9b57e7c1-01ff-488a-8562-dede005e8b8f tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Calling method '>' {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:20:59.619883 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.compute.api [None req-9b57e7c1-01ff-488a-8562-dede005e8b8f tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] [instance: a8d495ae-295a-4ffa-a2d9-5774249e687d] Fetching instance by UUID {{(pid=117873) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:20:59.626925 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-9b57e7c1-01ff-488a-8562-dede005e8b8f tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:20:59.627364 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-9b57e7c1-01ff-488a-8562-dede005e8b8f tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:20:59.628100 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-9b57e7c1-01ff-488a-8562-dede005e8b8f tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:20:59.628527 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-9b57e7c1-01ff-488a-8562-dede005e8b8f tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:20:59.755378 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.policy [None req-9b57e7c1-01ff-488a-8562-dede005e8b8f tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d7292401816437fba46d073c4746e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3277b9cbc4b4a8bbacee8440cea1ed2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117873) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:20:59.767633 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [None req-9b57e7c1-01ff-488a-8562-dede005e8b8f tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] 10.222.0.43 "GET /compute/v2.1/servers/a8d495ae-295a-4ffa-a2d9-5774249e687d" status: 200 len: 1523 microversion: 2.1 time: 0.152013 Jun 22 10:20:59.768258 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 350/712] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:20:59 2022] GET /compute/v2.1/servers/a8d495ae-295a-4ffa-a2d9-5774249e687d => generated 1523 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:21:00.241139 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-f588d42b-7532-4b55-be5e-40a9b337fa26 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Calling method '>' {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:21:00.241762 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.compute.api [None req-f588d42b-7532-4b55-be5e-40a9b337fa26 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] [instance: b357b60f-93be-4898-a651-4a407a7dc490] Fetching instance by UUID {{(pid=117874) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:21:00.247712 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-f588d42b-7532-4b55-be5e-40a9b337fa26 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:00.248155 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-f588d42b-7532-4b55-be5e-40a9b337fa26 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:00.248897 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-f588d42b-7532-4b55-be5e-40a9b337fa26 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:00.250082 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-f588d42b-7532-4b55-be5e-40a9b337fa26 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:00.385568 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.policy [None req-f588d42b-7532-4b55-be5e-40a9b337fa26 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75753b29a78640df9622d4e2655baf9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee9d603d9cc4a8797f55d544f189720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117874) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:21:00.393682 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.policy [None req-f588d42b-7532-4b55-be5e-40a9b337fa26 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75753b29a78640df9622d4e2655baf9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee9d603d9cc4a8797f55d544f189720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117874) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:21:00.395184 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.policy [None req-f588d42b-7532-4b55-be5e-40a9b337fa26 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75753b29a78640df9622d4e2655baf9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee9d603d9cc4a8797f55d544f189720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117874) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:21:00.396317 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [None req-f588d42b-7532-4b55-be5e-40a9b337fa26 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] 10.222.0.43 "GET /compute/v2.1/servers/b357b60f-93be-4898-a651-4a407a7dc490" status: 200 len: 1721 microversion: 2.20 time: 0.159337 Jun 22 10:21:00.396869 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 363/713] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jun 22 10:21:00 2022] GET /compute/v2.1/servers/b357b60f-93be-4898-a651-4a407a7dc490 => generated 1721 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 22 10:21:00.615607 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-81f7e638-a247-4979-bfb0-0b95c1929352 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Calling method '>' {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:21:00.616215 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.compute.api [None req-81f7e638-a247-4979-bfb0-0b95c1929352 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] [instance: edabe652-f189-4feb-89b8-6bc768c1669d] Fetching instance by UUID {{(pid=117873) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:21:00.622154 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-81f7e638-a247-4979-bfb0-0b95c1929352 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:00.622718 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-81f7e638-a247-4979-bfb0-0b95c1929352 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:00.623347 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-81f7e638-a247-4979-bfb0-0b95c1929352 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:00.623777 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-81f7e638-a247-4979-bfb0-0b95c1929352 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:00.757460 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.policy [None req-81f7e638-a247-4979-bfb0-0b95c1929352 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78fe3fc4334c43d7a5ef6d70f9f57523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad52333bcbec425089c44c3e55df97ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117873) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:21:00.764970 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [None req-81f7e638-a247-4979-bfb0-0b95c1929352 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] 10.222.0.43 "GET /compute/v2.1/servers/edabe652-f189-4feb-89b8-6bc768c1669d" status: 200 len: 1363 microversion: 2.1 time: 0.153088 Jun 22 10:21:00.765543 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 351/714] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:21:00 2022] GET /compute/v2.1/servers/edabe652-f189-4feb-89b8-6bc768c1669d => generated 1363 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:21:00.785046 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-f5be3e9e-9263-4817-b79e-9e1de55c41cf tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Calling method '>' {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:21:00.785651 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.compute.api [None req-f5be3e9e-9263-4817-b79e-9e1de55c41cf tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] [instance: a8d495ae-295a-4ffa-a2d9-5774249e687d] Fetching instance by UUID {{(pid=117874) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:21:00.792075 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-f5be3e9e-9263-4817-b79e-9e1de55c41cf tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:00.792520 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-f5be3e9e-9263-4817-b79e-9e1de55c41cf tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:00.793278 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-f5be3e9e-9263-4817-b79e-9e1de55c41cf tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:00.793735 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-f5be3e9e-9263-4817-b79e-9e1de55c41cf tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:00.936196 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.policy [None req-f5be3e9e-9263-4817-b79e-9e1de55c41cf tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d7292401816437fba46d073c4746e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3277b9cbc4b4a8bbacee8440cea1ed2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117874) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:21:00.944466 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [None req-f5be3e9e-9263-4817-b79e-9e1de55c41cf tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] 10.222.0.43 "GET /compute/v2.1/servers/a8d495ae-295a-4ffa-a2d9-5774249e687d" status: 200 len: 1523 microversion: 2.1 time: 0.164077 Jun 22 10:21:00.945035 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 364/715] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:21:00 2022] GET /compute/v2.1/servers/a8d495ae-295a-4ffa-a2d9-5774249e687d => generated 1523 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:21:01.101817 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [req-1ce6c354-2c5f-4fe5-8fbf-565bb990a0ae req-ae91c0d0-931f-48ca-8fcd-1f2f6eeb4769 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a8d495ae-295a-4ffa-a2d9-5774249e687d", "name": "network-vif-deleted", "tag": "fae1b3df-59c5-40aa-9acc-2d668ec3c54d"}]} {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:21:01.110861 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [req-1ce6c354-2c5f-4fe5-8fbf-565bb990a0ae req-ae91c0d0-931f-48ca-8fcd-1f2f6eeb4769 service nova] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:01.111299 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [req-1ce6c354-2c5f-4fe5-8fbf-565bb990a0ae req-ae91c0d0-931f-48ca-8fcd-1f2f6eeb4769 service nova] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:01.122071 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.compute.server_external_events [req-1ce6c354-2c5f-4fe5-8fbf-565bb990a0ae req-ae91c0d0-931f-48ca-8fcd-1f2f6eeb4769 service nova] Creating event network-vif-deleted:fae1b3df-59c5-40aa-9acc-2d668ec3c54d for instance a8d495ae-295a-4ffa-a2d9-5774249e687d on hv-cinder-84713 Jun 22 10:21:01.127824 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [req-1ce6c354-2c5f-4fe5-8fbf-565bb990a0ae req-ae91c0d0-931f-48ca-8fcd-1f2f6eeb4769 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029807 Jun 22 10:21:01.128412 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 352/716] 10.222.0.43 () {64 vars in 1317 bytes} [Wed Jun 22 10:21:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 10:21:01.414655 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-2dc449ea-d372-41c0-97d6-a429f0231345 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Calling method '>' {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:21:01.415284 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.compute.api [None req-2dc449ea-d372-41c0-97d6-a429f0231345 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] [instance: b357b60f-93be-4898-a651-4a407a7dc490] Fetching instance by UUID {{(pid=117874) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:21:01.422174 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-2dc449ea-d372-41c0-97d6-a429f0231345 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:01.422690 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-2dc449ea-d372-41c0-97d6-a429f0231345 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:01.423455 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-2dc449ea-d372-41c0-97d6-a429f0231345 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:01.423881 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-2dc449ea-d372-41c0-97d6-a429f0231345 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:01.511869 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG dbcounter [-] [117874] Writing DB stats nova_cell0:SELECT=6 {{(pid=117874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:21:01.558960 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.policy [None req-2dc449ea-d372-41c0-97d6-a429f0231345 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75753b29a78640df9622d4e2655baf9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee9d603d9cc4a8797f55d544f189720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117874) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:21:01.567185 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.policy [None req-2dc449ea-d372-41c0-97d6-a429f0231345 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75753b29a78640df9622d4e2655baf9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee9d603d9cc4a8797f55d544f189720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117874) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:21:01.568670 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.policy [None req-2dc449ea-d372-41c0-97d6-a429f0231345 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75753b29a78640df9622d4e2655baf9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee9d603d9cc4a8797f55d544f189720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117874) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:21:01.569837 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [None req-2dc449ea-d372-41c0-97d6-a429f0231345 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] 10.222.0.43 "GET /compute/v2.1/servers/b357b60f-93be-4898-a651-4a407a7dc490" status: 200 len: 1721 microversion: 2.20 time: 0.159054 Jun 22 10:21:01.570396 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 365/717] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jun 22 10:21:01 2022] GET /compute/v2.1/servers/b357b60f-93be-4898-a651-4a407a7dc490 => generated 1721 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 10:21:01.783046 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-79fd6331-4e49-479f-a250-a726579c7ff1 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Calling method '>' {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:21:01.783806 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.compute.api [None req-79fd6331-4e49-479f-a250-a726579c7ff1 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] [instance: edabe652-f189-4feb-89b8-6bc768c1669d] Fetching instance by UUID {{(pid=117873) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:21:01.785937 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG dbcounter [-] [117873] Writing DB stats nova_cell0:SELECT=2 {{(pid=117873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:21:01.787021 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG dbcounter [-] [117873] Writing DB stats nova_cell0:SELECT=6 {{(pid=117873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:21:01.793627 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-79fd6331-4e49-479f-a250-a726579c7ff1 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:01.794097 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-79fd6331-4e49-479f-a250-a726579c7ff1 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:01.794851 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-79fd6331-4e49-479f-a250-a726579c7ff1 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:01.795279 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-79fd6331-4e49-479f-a250-a726579c7ff1 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:01.933631 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.policy [None req-79fd6331-4e49-479f-a250-a726579c7ff1 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78fe3fc4334c43d7a5ef6d70f9f57523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad52333bcbec425089c44c3e55df97ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117873) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:21:01.941738 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [None req-79fd6331-4e49-479f-a250-a726579c7ff1 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] 10.222.0.43 "GET /compute/v2.1/servers/edabe652-f189-4feb-89b8-6bc768c1669d" status: 200 len: 1363 microversion: 2.1 time: 0.163705 Jun 22 10:21:01.942297 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 353/718] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:21:01 2022] GET /compute/v2.1/servers/edabe652-f189-4feb-89b8-6bc768c1669d => generated 1363 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:21:01.961451 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-941fe346-e92a-466f-813c-c27381361c6b tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Calling method '>' {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:21:01.962016 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.compute.api [None req-941fe346-e92a-466f-813c-c27381361c6b tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] [instance: a8d495ae-295a-4ffa-a2d9-5774249e687d] Fetching instance by UUID {{(pid=117874) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:21:01.968628 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-941fe346-e92a-466f-813c-c27381361c6b tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:01.969082 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-941fe346-e92a-466f-813c-c27381361c6b tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:01.969871 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-941fe346-e92a-466f-813c-c27381361c6b tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:01.970344 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-941fe346-e92a-466f-813c-c27381361c6b tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:02.006255 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-941fe346-e92a-466f-813c-c27381361c6b tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:02.006717 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-941fe346-e92a-466f-813c-c27381361c6b tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:02.007163 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.objects.instance [None req-941fe346-e92a-466f-813c-c27381361c6b tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lazy-loading 'fault' on Instance uuid a8d495ae-295a-4ffa-a2d9-5774249e687d {{(pid=117874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 22 10:21:02.049846 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.policy [None req-941fe346-e92a-466f-813c-c27381361c6b tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d7292401816437fba46d073c4746e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3277b9cbc4b4a8bbacee8440cea1ed2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117874) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:21:02.057286 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [None req-941fe346-e92a-466f-813c-c27381361c6b tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] 10.222.0.43 "GET /compute/v2.1/servers/a8d495ae-295a-4ffa-a2d9-5774249e687d" status: 200 len: 1312 microversion: 2.1 time: 0.099735 Jun 22 10:21:02.057885 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 366/719] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:21:01 2022] GET /compute/v2.1/servers/a8d495ae-295a-4ffa-a2d9-5774249e687d => generated 1312 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:21:02.588303 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-be09d8e5-f80f-4744-b379-f9b7ee508bf3 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Calling method '>' {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:21:02.588823 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.compute.api [None req-be09d8e5-f80f-4744-b379-f9b7ee508bf3 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] [instance: b357b60f-93be-4898-a651-4a407a7dc490] Fetching instance by UUID {{(pid=117873) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:21:02.595363 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-be09d8e5-f80f-4744-b379-f9b7ee508bf3 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:02.595812 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-be09d8e5-f80f-4744-b379-f9b7ee508bf3 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:02.596686 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-be09d8e5-f80f-4744-b379-f9b7ee508bf3 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:02.597130 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-be09d8e5-f80f-4744-b379-f9b7ee508bf3 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:02.731375 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.policy [None req-be09d8e5-f80f-4744-b379-f9b7ee508bf3 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75753b29a78640df9622d4e2655baf9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee9d603d9cc4a8797f55d544f189720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117873) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:21:02.739856 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.policy [None req-be09d8e5-f80f-4744-b379-f9b7ee508bf3 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75753b29a78640df9622d4e2655baf9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee9d603d9cc4a8797f55d544f189720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117873) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:21:02.741353 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.policy [None req-be09d8e5-f80f-4744-b379-f9b7ee508bf3 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75753b29a78640df9622d4e2655baf9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee9d603d9cc4a8797f55d544f189720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117873) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:21:02.742544 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [None req-be09d8e5-f80f-4744-b379-f9b7ee508bf3 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] 10.222.0.43 "GET /compute/v2.1/servers/b357b60f-93be-4898-a651-4a407a7dc490" status: 200 len: 1721 microversion: 2.20 time: 0.158355 Jun 22 10:21:02.743106 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 354/720] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jun 22 10:21:02 2022] GET /compute/v2.1/servers/b357b60f-93be-4898-a651-4a407a7dc490 => generated 1721 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 10:21:02.958987 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-c6c078c7-561d-4d53-afbd-17907321370d tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Calling method '>' {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:21:02.959627 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.compute.api [None req-c6c078c7-561d-4d53-afbd-17907321370d tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] [instance: edabe652-f189-4feb-89b8-6bc768c1669d] Fetching instance by UUID {{(pid=117874) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:21:02.966208 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-c6c078c7-561d-4d53-afbd-17907321370d tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:02.966782 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-c6c078c7-561d-4d53-afbd-17907321370d tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:02.967401 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-c6c078c7-561d-4d53-afbd-17907321370d tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:02.968464 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-c6c078c7-561d-4d53-afbd-17907321370d tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:03.077402 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-c8d89a78-8550-460b-a51b-edff56120ecd tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Calling method '>' {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:21:03.078491 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.compute.api [None req-c8d89a78-8550-460b-a51b-edff56120ecd tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] [instance: a8d495ae-295a-4ffa-a2d9-5774249e687d] Fetching instance by UUID {{(pid=117873) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:21:03.088454 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-c8d89a78-8550-460b-a51b-edff56120ecd tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:03.089123 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-c8d89a78-8550-460b-a51b-edff56120ecd tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:03.090375 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-c8d89a78-8550-460b-a51b-edff56120ecd tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:03.091031 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-c8d89a78-8550-460b-a51b-edff56120ecd tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:03.112258 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.wsgi [None req-c8d89a78-8550-460b-a51b-edff56120ecd tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] HTTP exception thrown: Instance a8d495ae-295a-4ffa-a2d9-5774249e687d could not be found. Jun 22 10:21:03.113118 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.policy [None req-c6c078c7-561d-4d53-afbd-17907321370d tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78fe3fc4334c43d7a5ef6d70f9f57523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad52333bcbec425089c44c3e55df97ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117874) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:21:03.114282 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-c8d89a78-8550-460b-a51b-edff56120ecd tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Request method failure captured: Jun 22 10:21:03.114282 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: request: GET /compute/v2.1/servers/a8d495ae-295a-4ffa-a2d9-5774249e687d HTTP/1.1 Jun 22 10:21:03.114282 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: Accept: application/json Jun 22 10:21:03.114282 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: Accept-Encoding: identity Jun 22 10:21:03.114282 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: Connection: close Jun 22 10:21:03.114282 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: Content-Length: 0 Jun 22 10:21:03.114282 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: Content-Type: application/json Jun 22 10:21:03.114282 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: Host: 10.222.0.43 Jun 22 10:21:03.114282 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: Openstack-System-Scope: None Jun 22 10:21:03.114282 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: User-Agent: python-urllib3/1.26.9 Jun 22 10:21:03.114282 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-Auth-Token: gAAAAABisuvjVgSjiKizNMOSSpCqXljNGSFOhAJqDEs6LcefAlRz8CAyn7YtQIZuzfdzoXcb1I3sPaeBjRE3nGlR4nfnglF3o0W8ZwIXa-t2T7Kvu9u_9tTAcMDpcQ53GMtzR-i0HixNHH9XjiiRNTwzoo0r6BKSTSNuiStSMHwEgpkRgSyLC2I Jun 22 10:21:03.114282 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-Domain-Id: None Jun 22 10:21:03.114282 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-Domain-Name: None Jun 22 10:21:03.114282 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-Identity-Status: Confirmed Jun 22 10:21:03.114282 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-Is-Admin-Project: True Jun 22 10:21:03.114282 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-Project-Domain-Id: default Jun 22 10:21:03.114282 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-Project-Domain-Name: Default Jun 22 10:21:03.114282 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-Project-Id: c3277b9cbc4b4a8bbacee8440cea1ed2 Jun 22 10:21:03.114282 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-2023039799 Jun 22 10:21:03.114282 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-Role: reader,member Jun 22 10:21:03.114282 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-Roles: reader,member Jun 22 10:21:03.115771 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/c3277b9cbc4b4a8bbacee8440cea1ed2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/c3277b9cbc4b4a8bbacee8440cea1ed2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_c3277b9cbc4b4a8bbacee8440cea1ed2", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/c3277b9cbc4b4a8bbacee8440cea1ed2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}] Jun 22 10:21:03.115771 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-Tenant: tempest-ServerRescueNegativeTestJSON-2023039799 Jun 22 10:21:03.115771 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-Tenant-Id: c3277b9cbc4b4a8bbacee8440cea1ed2 Jun 22 10:21:03.115771 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-2023039799 Jun 22 10:21:03.115771 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-User: tempest-ServerRescueNegativeTestJSON-2023039799-project Jun 22 10:21:03.115771 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-User-Domain-Id: default Jun 22 10:21:03.115771 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-User-Domain-Name: Default Jun 22 10:21:03.115771 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-User-Id: 0d7292401816437fba46d073c4746e45 Jun 22 10:21:03.115771 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-User-Name: tempest-ServerRescueNegativeTestJSON-2023039799-project Jun 22 10:21:03.115771 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: method: > Jun 22 10:21:03.115771 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: exception: Instance a8d495ae-295a-4ffa-a2d9-5774249e687d could not be found. Jun 22 10:21:03.115771 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: action_args: {'id': 'a8d495ae-295a-4ffa-a2d9-5774249e687d'} Jun 22 10:21:03.116613 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 10:21:03.116613 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:21:03.116613 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 22 10:21:03.116613 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 22 10:21:03.116613 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 22 10:21:03.116613 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 22 10:21:03.116613 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 22 10:21:03.116613 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 22 10:21:03.116613 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 22 10:21:03.116613 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 22 10:21:03.116613 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a8d495ae-295a-4ffa-a2d9-5774249e687d could not be found. Jun 22 10:21:03.116613 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi Jun 22 10:21:03.116613 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 10:21:03.116613 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi Jun 22 10:21:03.116613 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:21:03.116613 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 10:21:03.116613 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 10:21:03.116613 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 10:21:03.116613 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 10:21:03.116613 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 10:21:03.117798 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 10:21:03.117798 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 22 10:21:03.117798 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 22 10:21:03.117798 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 22 10:21:03.117798 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 22 10:21:03.117798 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 22 10:21:03.117798 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 22 10:21:03.117798 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a8d495ae-295a-4ffa-a2d9-5774249e687d could not be found. Jun 22 10:21:03.117798 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi Jun 22 10:21:03.117798 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 10:21:03.117798 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi Jun 22 10:21:03.117798 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:21:03.117798 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 10:21:03.117798 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 10:21:03.117798 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 10:21:03.117798 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 10:21:03.117798 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a8d495ae-295a-4ffa-a2d9-5774249e687d could not be found. Jun 22 10:21:03.117798 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi Jun 22 10:21:03.119121 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-c8d89a78-8550-460b-a51b-edff56120ecd tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] Returning 404 to user: Instance a8d495ae-295a-4ffa-a2d9-5774249e687d could not be found. {{(pid=117873) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 10:21:03.119121 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [None req-c8d89a78-8550-460b-a51b-edff56120ecd tempest-ServerRescueNegativeTestJSON-2023039799 tempest-ServerRescueNegativeTestJSON-2023039799-project] 10.222.0.43 "GET /compute/v2.1/servers/a8d495ae-295a-4ffa-a2d9-5774249e687d" status: 404 len: 111 microversion: 2.1 time: 0.045117 Jun 22 10:21:03.119121 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 355/721] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:21:03 2022] GET /compute/v2.1/servers/a8d495ae-295a-4ffa-a2d9-5774249e687d => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 22 10:21:03.123122 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [None req-c6c078c7-561d-4d53-afbd-17907321370d tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] 10.222.0.43 "GET /compute/v2.1/servers/edabe652-f189-4feb-89b8-6bc768c1669d" status: 200 len: 1363 microversion: 2.1 time: 0.167934 Jun 22 10:21:03.123702 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 367/722] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:21:02 2022] GET /compute/v2.1/servers/edabe652-f189-4feb-89b8-6bc768c1669d => generated 1363 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:21:03.761859 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-999f25df-03c0-4c42-b9c2-3ef20e0cf09e tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Calling method '>' {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:21:03.762497 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.compute.api [None req-999f25df-03c0-4c42-b9c2-3ef20e0cf09e tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] [instance: b357b60f-93be-4898-a651-4a407a7dc490] Fetching instance by UUID {{(pid=117873) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:21:03.769317 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-999f25df-03c0-4c42-b9c2-3ef20e0cf09e tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:03.769861 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-999f25df-03c0-4c42-b9c2-3ef20e0cf09e tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:03.770621 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-999f25df-03c0-4c42-b9c2-3ef20e0cf09e tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:03.771048 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-999f25df-03c0-4c42-b9c2-3ef20e0cf09e tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:03.982571 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.policy [None req-999f25df-03c0-4c42-b9c2-3ef20e0cf09e tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75753b29a78640df9622d4e2655baf9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee9d603d9cc4a8797f55d544f189720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117873) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:21:03.990561 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.policy [None req-999f25df-03c0-4c42-b9c2-3ef20e0cf09e tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75753b29a78640df9622d4e2655baf9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee9d603d9cc4a8797f55d544f189720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117873) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:21:03.992047 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.policy [None req-999f25df-03c0-4c42-b9c2-3ef20e0cf09e tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75753b29a78640df9622d4e2655baf9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee9d603d9cc4a8797f55d544f189720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117873) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:21:03.993194 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [None req-999f25df-03c0-4c42-b9c2-3ef20e0cf09e tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] 10.222.0.43 "GET /compute/v2.1/servers/b357b60f-93be-4898-a651-4a407a7dc490" status: 200 len: 1721 microversion: 2.20 time: 0.235351 Jun 22 10:21:03.993776 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 356/723] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jun 22 10:21:03 2022] GET /compute/v2.1/servers/b357b60f-93be-4898-a651-4a407a7dc490 => generated 1721 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 10:21:04.141429 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-258773de-d40a-4305-8196-58449342536d tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Calling method '>' {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:21:04.142259 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.compute.api [None req-258773de-d40a-4305-8196-58449342536d tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] [instance: edabe652-f189-4feb-89b8-6bc768c1669d] Fetching instance by UUID {{(pid=117874) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:21:04.148565 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-258773de-d40a-4305-8196-58449342536d tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:04.149097 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-258773de-d40a-4305-8196-58449342536d tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:04.150090 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-258773de-d40a-4305-8196-58449342536d tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:04.150527 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-258773de-d40a-4305-8196-58449342536d tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:04.621384 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.policy [None req-258773de-d40a-4305-8196-58449342536d tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78fe3fc4334c43d7a5ef6d70f9f57523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad52333bcbec425089c44c3e55df97ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117874) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:21:04.629559 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [None req-258773de-d40a-4305-8196-58449342536d tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] 10.222.0.43 "GET /compute/v2.1/servers/edabe652-f189-4feb-89b8-6bc768c1669d" status: 200 len: 1363 microversion: 2.1 time: 0.492756 Jun 22 10:21:04.630226 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 368/724] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:21:04 2022] GET /compute/v2.1/servers/edabe652-f189-4feb-89b8-6bc768c1669d => generated 1363 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:21:05.012128 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-558eef54-031d-4c7e-b826-0e7e7b67e1ff tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Calling method '>' {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:21:05.012903 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.compute.api [None req-558eef54-031d-4c7e-b826-0e7e7b67e1ff tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] [instance: b357b60f-93be-4898-a651-4a407a7dc490] Fetching instance by UUID {{(pid=117873) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:21:05.019232 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-558eef54-031d-4c7e-b826-0e7e7b67e1ff tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:05.019910 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-558eef54-031d-4c7e-b826-0e7e7b67e1ff tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:05.020683 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-558eef54-031d-4c7e-b826-0e7e7b67e1ff tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:05.021121 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-558eef54-031d-4c7e-b826-0e7e7b67e1ff tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:05.263417 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.policy [None req-558eef54-031d-4c7e-b826-0e7e7b67e1ff tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75753b29a78640df9622d4e2655baf9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee9d603d9cc4a8797f55d544f189720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117873) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:21:05.272822 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.policy [None req-558eef54-031d-4c7e-b826-0e7e7b67e1ff tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75753b29a78640df9622d4e2655baf9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee9d603d9cc4a8797f55d544f189720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117873) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:21:05.274364 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.policy [None req-558eef54-031d-4c7e-b826-0e7e7b67e1ff tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75753b29a78640df9622d4e2655baf9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee9d603d9cc4a8797f55d544f189720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117873) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:21:05.275695 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [None req-558eef54-031d-4c7e-b826-0e7e7b67e1ff tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] 10.222.0.43 "GET /compute/v2.1/servers/b357b60f-93be-4898-a651-4a407a7dc490" status: 200 len: 1721 microversion: 2.20 time: 0.267263 Jun 22 10:21:05.276450 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 357/725] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jun 22 10:21:05 2022] GET /compute/v2.1/servers/b357b60f-93be-4898-a651-4a407a7dc490 => generated 1721 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 10:21:05.647750 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-fbf15449-223c-407d-af29-c9345c668f6b tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Calling method '>' {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:21:05.648644 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.compute.api [None req-fbf15449-223c-407d-af29-c9345c668f6b tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] [instance: edabe652-f189-4feb-89b8-6bc768c1669d] Fetching instance by UUID {{(pid=117874) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:21:05.655481 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-fbf15449-223c-407d-af29-c9345c668f6b tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:05.655954 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-fbf15449-223c-407d-af29-c9345c668f6b tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:05.658057 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-fbf15449-223c-407d-af29-c9345c668f6b tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:05.658750 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-fbf15449-223c-407d-af29-c9345c668f6b tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:05.762925 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [req-96a08910-07ef-45ba-b6dd-eacc4fd0788a req-2b2299bf-347a-4070-8e93-803f2ec0fc16 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "edabe652-f189-4feb-89b8-6bc768c1669d", "name": "network-vif-plugged", "status": "completed", "tag": "181865e7-8701-4ee4-8619-52218e16c189"}]} {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:21:05.772912 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [req-96a08910-07ef-45ba-b6dd-eacc4fd0788a req-2b2299bf-347a-4070-8e93-803f2ec0fc16 service nova] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:05.773583 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [req-96a08910-07ef-45ba-b6dd-eacc4fd0788a req-2b2299bf-347a-4070-8e93-803f2ec0fc16 service nova] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:05.786303 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.compute.server_external_events [req-96a08910-07ef-45ba-b6dd-eacc4fd0788a req-2b2299bf-347a-4070-8e93-803f2ec0fc16 service nova] Creating event network-vif-plugged:181865e7-8701-4ee4-8619-52218e16c189 for instance edabe652-f189-4feb-89b8-6bc768c1669d on hv-cinder-84713 Jun 22 10:21:05.791173 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [req-96a08910-07ef-45ba-b6dd-eacc4fd0788a req-2b2299bf-347a-4070-8e93-803f2ec0fc16 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032057 Jun 22 10:21:05.791930 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 358/726] 10.222.0.43 () {64 vars in 1317 bytes} [Wed Jun 22 10:21:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 10:21:05.927297 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.policy [None req-fbf15449-223c-407d-af29-c9345c668f6b tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78fe3fc4334c43d7a5ef6d70f9f57523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad52333bcbec425089c44c3e55df97ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117874) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:21:05.935255 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [None req-fbf15449-223c-407d-af29-c9345c668f6b tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] 10.222.0.43 "GET /compute/v2.1/servers/edabe652-f189-4feb-89b8-6bc768c1669d" status: 200 len: 1363 microversion: 2.1 time: 0.292392 Jun 22 10:21:05.936090 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 369/727] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:21:05 2022] GET /compute/v2.1/servers/edabe652-f189-4feb-89b8-6bc768c1669d => generated 1363 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:21:06.298019 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-b5e57671-5791-4b72-af1a-6a441bd10511 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Calling method '>' {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:21:06.301393 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.compute.api [None req-b5e57671-5791-4b72-af1a-6a441bd10511 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] [instance: b357b60f-93be-4898-a651-4a407a7dc490] Fetching instance by UUID {{(pid=117873) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:21:06.313234 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-b5e57671-5791-4b72-af1a-6a441bd10511 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:06.313793 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-b5e57671-5791-4b72-af1a-6a441bd10511 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:06.314631 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-b5e57671-5791-4b72-af1a-6a441bd10511 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:06.315070 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-b5e57671-5791-4b72-af1a-6a441bd10511 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:06.509115 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.policy [None req-b5e57671-5791-4b72-af1a-6a441bd10511 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75753b29a78640df9622d4e2655baf9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee9d603d9cc4a8797f55d544f189720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117873) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:21:06.528430 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.policy [None req-b5e57671-5791-4b72-af1a-6a441bd10511 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75753b29a78640df9622d4e2655baf9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee9d603d9cc4a8797f55d544f189720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117873) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:21:06.534526 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.policy [None req-b5e57671-5791-4b72-af1a-6a441bd10511 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75753b29a78640df9622d4e2655baf9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee9d603d9cc4a8797f55d544f189720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117873) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:21:06.536143 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [None req-b5e57671-5791-4b72-af1a-6a441bd10511 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] 10.222.0.43 "GET /compute/v2.1/servers/b357b60f-93be-4898-a651-4a407a7dc490" status: 200 len: 1721 microversion: 2.20 time: 0.246242 Jun 22 10:21:06.538160 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 359/728] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jun 22 10:21:06 2022] GET /compute/v2.1/servers/b357b60f-93be-4898-a651-4a407a7dc490 => generated 1721 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 22 10:21:06.955045 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-7c8b9e80-dc4e-463d-888e-2f1ebdb4c3ee tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Calling method '>' {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:21:06.955658 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.compute.api [None req-7c8b9e80-dc4e-463d-888e-2f1ebdb4c3ee tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] [instance: edabe652-f189-4feb-89b8-6bc768c1669d] Fetching instance by UUID {{(pid=117874) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:21:06.963017 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-7c8b9e80-dc4e-463d-888e-2f1ebdb4c3ee tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:06.963465 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-7c8b9e80-dc4e-463d-888e-2f1ebdb4c3ee tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:06.964237 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-7c8b9e80-dc4e-463d-888e-2f1ebdb4c3ee tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:06.964672 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-7c8b9e80-dc4e-463d-888e-2f1ebdb4c3ee tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:07.142966 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.policy [None req-7c8b9e80-dc4e-463d-888e-2f1ebdb4c3ee tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78fe3fc4334c43d7a5ef6d70f9f57523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad52333bcbec425089c44c3e55df97ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117874) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:21:07.151752 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [None req-7c8b9e80-dc4e-463d-888e-2f1ebdb4c3ee tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] 10.222.0.43 "GET /compute/v2.1/servers/edabe652-f189-4feb-89b8-6bc768c1669d" status: 200 len: 1363 microversion: 2.1 time: 0.201282 Jun 22 10:21:07.152408 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 370/729] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:21:06 2022] GET /compute/v2.1/servers/edabe652-f189-4feb-89b8-6bc768c1669d => generated 1363 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:21:07.557982 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-8e8215a4-33be-4fce-9c23-0805aec921e2 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Calling method '>' {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:21:07.558607 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.compute.api [None req-8e8215a4-33be-4fce-9c23-0805aec921e2 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] [instance: b357b60f-93be-4898-a651-4a407a7dc490] Fetching instance by UUID {{(pid=117873) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:21:07.565712 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-8e8215a4-33be-4fce-9c23-0805aec921e2 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:07.566151 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-8e8215a4-33be-4fce-9c23-0805aec921e2 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:07.566912 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-8e8215a4-33be-4fce-9c23-0805aec921e2 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:07.567345 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-8e8215a4-33be-4fce-9c23-0805aec921e2 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:07.715376 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.policy [None req-8e8215a4-33be-4fce-9c23-0805aec921e2 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75753b29a78640df9622d4e2655baf9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee9d603d9cc4a8797f55d544f189720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117873) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:21:07.724092 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.policy [None req-8e8215a4-33be-4fce-9c23-0805aec921e2 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75753b29a78640df9622d4e2655baf9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee9d603d9cc4a8797f55d544f189720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117873) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:21:07.725579 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.policy [None req-8e8215a4-33be-4fce-9c23-0805aec921e2 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75753b29a78640df9622d4e2655baf9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee9d603d9cc4a8797f55d544f189720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117873) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:21:07.726756 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [None req-8e8215a4-33be-4fce-9c23-0805aec921e2 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] 10.222.0.43 "GET /compute/v2.1/servers/b357b60f-93be-4898-a651-4a407a7dc490" status: 200 len: 1721 microversion: 2.20 time: 0.172701 Jun 22 10:21:07.727550 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 360/730] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jun 22 10:21:07 2022] GET /compute/v2.1/servers/b357b60f-93be-4898-a651-4a407a7dc490 => generated 1721 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 10:21:08.168670 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-d44a6b57-135b-466a-9229-808732679066 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Calling method '>' {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:21:08.169411 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.compute.api [None req-d44a6b57-135b-466a-9229-808732679066 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] [instance: edabe652-f189-4feb-89b8-6bc768c1669d] Fetching instance by UUID {{(pid=117874) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:21:08.176544 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-d44a6b57-135b-466a-9229-808732679066 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:08.177016 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-d44a6b57-135b-466a-9229-808732679066 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:08.177789 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-d44a6b57-135b-466a-9229-808732679066 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:08.178229 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-d44a6b57-135b-466a-9229-808732679066 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:08.313102 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.policy [None req-d44a6b57-135b-466a-9229-808732679066 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78fe3fc4334c43d7a5ef6d70f9f57523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad52333bcbec425089c44c3e55df97ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117874) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:21:08.320905 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [None req-d44a6b57-135b-466a-9229-808732679066 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] 10.222.0.43 "GET /compute/v2.1/servers/edabe652-f189-4feb-89b8-6bc768c1669d" status: 200 len: 1549 microversion: 2.1 time: 0.155815 Jun 22 10:21:08.321366 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 371/731] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:21:08 2022] GET /compute/v2.1/servers/edabe652-f189-4feb-89b8-6bc768c1669d => generated 1549 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:21:08.339051 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-bb9efcb3-c7e4-4b2e-a399-831a3d67019a tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Calling method '>' {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:21:08.339656 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.compute.api [None req-bb9efcb3-c7e4-4b2e-a399-831a3d67019a tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] [instance: edabe652-f189-4feb-89b8-6bc768c1669d] Fetching instance by UUID {{(pid=117873) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:21:08.342202 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG dbcounter [-] [117873] Writing DB stats nova_api:SELECT=93,nova_api:DELETE=2,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=117873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:21:08.347846 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-bb9efcb3-c7e4-4b2e-a399-831a3d67019a tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:08.348289 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-bb9efcb3-c7e4-4b2e-a399-831a3d67019a tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:08.349036 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-bb9efcb3-c7e4-4b2e-a399-831a3d67019a tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:08.349675 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-bb9efcb3-c7e4-4b2e-a399-831a3d67019a tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:08.438506 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [None req-bb9efcb3-c7e4-4b2e-a399-831a3d67019a tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] 10.222.0.43 "GET /compute/v2.1/servers/edabe652-f189-4feb-89b8-6bc768c1669d/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.104152 Jun 22 10:21:08.439188 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 361/732] 10.222.0.43 () {58 vars in 1274 bytes} [Wed Jun 22 10:21:08 2022] GET /compute/v2.1/servers/edabe652-f189-4feb-89b8-6bc768c1669d/os-interface => generated 284 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 10:21:08.746111 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-89fdbd1a-f533-4ab6-a591-fb27ee9d5b15 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Calling method '>' {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:21:08.746940 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.compute.api [None req-89fdbd1a-f533-4ab6-a591-fb27ee9d5b15 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] [instance: b357b60f-93be-4898-a651-4a407a7dc490] Fetching instance by UUID {{(pid=117874) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:21:08.753354 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-89fdbd1a-f533-4ab6-a591-fb27ee9d5b15 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:08.753824 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-89fdbd1a-f533-4ab6-a591-fb27ee9d5b15 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:08.754582 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-89fdbd1a-f533-4ab6-a591-fb27ee9d5b15 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:08.755177 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-89fdbd1a-f533-4ab6-a591-fb27ee9d5b15 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:08.974695 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.policy [None req-89fdbd1a-f533-4ab6-a591-fb27ee9d5b15 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75753b29a78640df9622d4e2655baf9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee9d603d9cc4a8797f55d544f189720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117874) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:21:08.983909 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.policy [None req-89fdbd1a-f533-4ab6-a591-fb27ee9d5b15 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75753b29a78640df9622d4e2655baf9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee9d603d9cc4a8797f55d544f189720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117874) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:21:08.985912 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.policy [None req-89fdbd1a-f533-4ab6-a591-fb27ee9d5b15 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75753b29a78640df9622d4e2655baf9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee9d603d9cc4a8797f55d544f189720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117874) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:21:08.987433 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [None req-89fdbd1a-f533-4ab6-a591-fb27ee9d5b15 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] 10.222.0.43 "GET /compute/v2.1/servers/b357b60f-93be-4898-a651-4a407a7dc490" status: 200 len: 1721 microversion: 2.20 time: 0.245132 Jun 22 10:21:08.987996 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 372/733] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jun 22 10:21:08 2022] GET /compute/v2.1/servers/b357b60f-93be-4898-a651-4a407a7dc490 => generated 1721 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 10:21:09.827490 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [req-0466e6b7-13e8-48a6-b540-da7b1352cc7c req-146de019-fa5c-498b-862b-9fc714c69cc5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "edabe652-f189-4feb-89b8-6bc768c1669d", "tag": "181865e7-8701-4ee4-8619-52218e16c189"}]} {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:21:09.836308 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [req-0466e6b7-13e8-48a6-b540-da7b1352cc7c req-146de019-fa5c-498b-862b-9fc714c69cc5 service nova] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:09.836750 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [req-0466e6b7-13e8-48a6-b540-da7b1352cc7c req-146de019-fa5c-498b-862b-9fc714c69cc5 service nova] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:09.848925 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.compute.server_external_events [req-0466e6b7-13e8-48a6-b540-da7b1352cc7c req-146de019-fa5c-498b-862b-9fc714c69cc5 service nova] Creating event network-changed:181865e7-8701-4ee4-8619-52218e16c189 for instance edabe652-f189-4feb-89b8-6bc768c1669d on hv-cinder-84713 Jun 22 10:21:09.854113 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [req-0466e6b7-13e8-48a6-b540-da7b1352cc7c req-146de019-fa5c-498b-862b-9fc714c69cc5 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031326 Jun 22 10:21:09.854831 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 362/734] 10.222.0.43 () {64 vars in 1317 bytes} [Wed Jun 22 10:21:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 10:21:10.006320 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-38a8a3f8-2bc3-45ee-9434-1e682b672c87 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Calling method '>' {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:21:10.007002 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.compute.api [None req-38a8a3f8-2bc3-45ee-9434-1e682b672c87 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] [instance: b357b60f-93be-4898-a651-4a407a7dc490] Fetching instance by UUID {{(pid=117874) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:21:10.015792 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-38a8a3f8-2bc3-45ee-9434-1e682b672c87 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:10.015792 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-38a8a3f8-2bc3-45ee-9434-1e682b672c87 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:10.018678 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-38a8a3f8-2bc3-45ee-9434-1e682b672c87 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:10.019347 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-38a8a3f8-2bc3-45ee-9434-1e682b672c87 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:10.215825 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.policy [None req-38a8a3f8-2bc3-45ee-9434-1e682b672c87 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75753b29a78640df9622d4e2655baf9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee9d603d9cc4a8797f55d544f189720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117874) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:21:10.229208 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.policy [None req-38a8a3f8-2bc3-45ee-9434-1e682b672c87 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75753b29a78640df9622d4e2655baf9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee9d603d9cc4a8797f55d544f189720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117874) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:21:10.230994 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.policy [None req-38a8a3f8-2bc3-45ee-9434-1e682b672c87 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75753b29a78640df9622d4e2655baf9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee9d603d9cc4a8797f55d544f189720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117874) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:21:10.232387 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [None req-38a8a3f8-2bc3-45ee-9434-1e682b672c87 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] 10.222.0.43 "GET /compute/v2.1/servers/b357b60f-93be-4898-a651-4a407a7dc490" status: 200 len: 1721 microversion: 2.20 time: 0.229841 Jun 22 10:21:10.243190 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 373/735] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jun 22 10:21:10 2022] GET /compute/v2.1/servers/b357b60f-93be-4898-a651-4a407a7dc490 => generated 1721 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 10:21:11.252054 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-255c4be1-4c36-449d-aee8-d1f13ac30948 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Calling method '>' {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:21:11.252725 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.compute.api [None req-255c4be1-4c36-449d-aee8-d1f13ac30948 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] [instance: b357b60f-93be-4898-a651-4a407a7dc490] Fetching instance by UUID {{(pid=117873) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:21:11.259216 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-255c4be1-4c36-449d-aee8-d1f13ac30948 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:11.259687 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-255c4be1-4c36-449d-aee8-d1f13ac30948 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:11.260449 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-255c4be1-4c36-449d-aee8-d1f13ac30948 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:11.260906 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-255c4be1-4c36-449d-aee8-d1f13ac30948 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:11.410999 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.policy [None req-255c4be1-4c36-449d-aee8-d1f13ac30948 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75753b29a78640df9622d4e2655baf9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee9d603d9cc4a8797f55d544f189720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117873) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:21:11.419006 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.policy [None req-255c4be1-4c36-449d-aee8-d1f13ac30948 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75753b29a78640df9622d4e2655baf9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee9d603d9cc4a8797f55d544f189720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117873) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:21:11.421059 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.policy [None req-255c4be1-4c36-449d-aee8-d1f13ac30948 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75753b29a78640df9622d4e2655baf9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee9d603d9cc4a8797f55d544f189720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117873) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:21:11.422961 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [None req-255c4be1-4c36-449d-aee8-d1f13ac30948 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] 10.222.0.43 "GET /compute/v2.1/servers/b357b60f-93be-4898-a651-4a407a7dc490" status: 200 len: 1721 microversion: 2.20 time: 0.175646 Jun 22 10:21:11.433065 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 363/736] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jun 22 10:21:11 2022] GET /compute/v2.1/servers/b357b60f-93be-4898-a651-4a407a7dc490 => generated 1721 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 10:21:12.441407 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-0814480c-08f4-4d54-b863-76284e807e0d tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Calling method '>' {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:21:12.441986 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.compute.api [None req-0814480c-08f4-4d54-b863-76284e807e0d tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] [instance: b357b60f-93be-4898-a651-4a407a7dc490] Fetching instance by UUID {{(pid=117874) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:21:12.449291 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-0814480c-08f4-4d54-b863-76284e807e0d tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:12.450005 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-0814480c-08f4-4d54-b863-76284e807e0d tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:12.450970 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-0814480c-08f4-4d54-b863-76284e807e0d tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:12.451410 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-0814480c-08f4-4d54-b863-76284e807e0d tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:12.588523 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.policy [None req-0814480c-08f4-4d54-b863-76284e807e0d tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75753b29a78640df9622d4e2655baf9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee9d603d9cc4a8797f55d544f189720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117874) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:21:12.601770 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.policy [None req-0814480c-08f4-4d54-b863-76284e807e0d tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75753b29a78640df9622d4e2655baf9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee9d603d9cc4a8797f55d544f189720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117874) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:21:12.601770 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.policy [None req-0814480c-08f4-4d54-b863-76284e807e0d tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75753b29a78640df9622d4e2655baf9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee9d603d9cc4a8797f55d544f189720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117874) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:21:12.602160 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [None req-0814480c-08f4-4d54-b863-76284e807e0d tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] 10.222.0.43 "GET /compute/v2.1/servers/b357b60f-93be-4898-a651-4a407a7dc490" status: 200 len: 1721 microversion: 2.20 time: 0.164808 Jun 22 10:21:12.602981 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 374/737] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jun 22 10:21:12 2022] GET /compute/v2.1/servers/b357b60f-93be-4898-a651-4a407a7dc490 => generated 1721 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 10:21:13.622454 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-e124e815-8ab7-4fdd-ac95-61421d7d5fd2 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Calling method '>' {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:21:13.623153 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.compute.api [None req-e124e815-8ab7-4fdd-ac95-61421d7d5fd2 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] [instance: b357b60f-93be-4898-a651-4a407a7dc490] Fetching instance by UUID {{(pid=117873) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:21:13.629142 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-e124e815-8ab7-4fdd-ac95-61421d7d5fd2 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:13.629582 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-e124e815-8ab7-4fdd-ac95-61421d7d5fd2 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:13.630712 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-e124e815-8ab7-4fdd-ac95-61421d7d5fd2 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:13.630864 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-e124e815-8ab7-4fdd-ac95-61421d7d5fd2 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:13.759626 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.policy [None req-e124e815-8ab7-4fdd-ac95-61421d7d5fd2 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75753b29a78640df9622d4e2655baf9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee9d603d9cc4a8797f55d544f189720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117873) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:21:13.768385 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.policy [None req-e124e815-8ab7-4fdd-ac95-61421d7d5fd2 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75753b29a78640df9622d4e2655baf9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee9d603d9cc4a8797f55d544f189720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117873) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:21:13.769908 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.policy [None req-e124e815-8ab7-4fdd-ac95-61421d7d5fd2 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75753b29a78640df9622d4e2655baf9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee9d603d9cc4a8797f55d544f189720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117873) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:21:13.771067 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [None req-e124e815-8ab7-4fdd-ac95-61421d7d5fd2 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] 10.222.0.43 "GET /compute/v2.1/servers/b357b60f-93be-4898-a651-4a407a7dc490" status: 200 len: 1721 microversion: 2.20 time: 0.153105 Jun 22 10:21:13.771624 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 364/738] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jun 22 10:21:13 2022] GET /compute/v2.1/servers/b357b60f-93be-4898-a651-4a407a7dc490 => generated 1721 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 10:21:14.790088 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-3f2839d0-872d-447a-a650-7351a04532f8 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Calling method '>' {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:21:14.790699 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.compute.api [None req-3f2839d0-872d-447a-a650-7351a04532f8 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] [instance: b357b60f-93be-4898-a651-4a407a7dc490] Fetching instance by UUID {{(pid=117874) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:21:14.797721 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-3f2839d0-872d-447a-a650-7351a04532f8 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:14.798524 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-3f2839d0-872d-447a-a650-7351a04532f8 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:14.799699 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-3f2839d0-872d-447a-a650-7351a04532f8 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:14.800428 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-3f2839d0-872d-447a-a650-7351a04532f8 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:14.940485 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.policy [None req-3f2839d0-872d-447a-a650-7351a04532f8 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75753b29a78640df9622d4e2655baf9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee9d603d9cc4a8797f55d544f189720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117874) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:21:14.948570 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.policy [None req-3f2839d0-872d-447a-a650-7351a04532f8 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75753b29a78640df9622d4e2655baf9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee9d603d9cc4a8797f55d544f189720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117874) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:21:14.950182 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.policy [None req-3f2839d0-872d-447a-a650-7351a04532f8 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75753b29a78640df9622d4e2655baf9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee9d603d9cc4a8797f55d544f189720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117874) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:21:14.951968 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [None req-3f2839d0-872d-447a-a650-7351a04532f8 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] 10.222.0.43 "GET /compute/v2.1/servers/b357b60f-93be-4898-a651-4a407a7dc490" status: 200 len: 1721 microversion: 2.20 time: 0.165146 Jun 22 10:21:14.953154 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 375/739] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jun 22 10:21:14 2022] GET /compute/v2.1/servers/b357b60f-93be-4898-a651-4a407a7dc490 => generated 1721 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 10:21:15.971569 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-c42f90a0-5d00-4be3-845c-b843ebcbd2f7 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Calling method '>' {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:21:15.972194 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.compute.api [None req-c42f90a0-5d00-4be3-845c-b843ebcbd2f7 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] [instance: b357b60f-93be-4898-a651-4a407a7dc490] Fetching instance by UUID {{(pid=117873) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:21:15.978893 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-c42f90a0-5d00-4be3-845c-b843ebcbd2f7 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:15.979331 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-c42f90a0-5d00-4be3-845c-b843ebcbd2f7 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:15.980076 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-c42f90a0-5d00-4be3-845c-b843ebcbd2f7 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:15.980503 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-c42f90a0-5d00-4be3-845c-b843ebcbd2f7 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:16.111516 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.policy [None req-c42f90a0-5d00-4be3-845c-b843ebcbd2f7 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75753b29a78640df9622d4e2655baf9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee9d603d9cc4a8797f55d544f189720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117873) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:21:16.119333 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.policy [None req-c42f90a0-5d00-4be3-845c-b843ebcbd2f7 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75753b29a78640df9622d4e2655baf9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee9d603d9cc4a8797f55d544f189720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117873) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:21:16.120816 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.policy [None req-c42f90a0-5d00-4be3-845c-b843ebcbd2f7 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75753b29a78640df9622d4e2655baf9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee9d603d9cc4a8797f55d544f189720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117873) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:21:16.122048 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [None req-c42f90a0-5d00-4be3-845c-b843ebcbd2f7 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] 10.222.0.43 "GET /compute/v2.1/servers/b357b60f-93be-4898-a651-4a407a7dc490" status: 200 len: 1742 microversion: 2.20 time: 0.154855 Jun 22 10:21:16.122601 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 365/740] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jun 22 10:21:15 2022] GET /compute/v2.1/servers/b357b60f-93be-4898-a651-4a407a7dc490 => generated 1742 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 10:21:17.141050 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-cb6e62b6-3b9e-4117-9adb-961456bda1eb tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Calling method '>' {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:21:17.141790 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.compute.api [None req-cb6e62b6-3b9e-4117-9adb-961456bda1eb tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] [instance: b357b60f-93be-4898-a651-4a407a7dc490] Fetching instance by UUID {{(pid=117874) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:21:17.150392 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-cb6e62b6-3b9e-4117-9adb-961456bda1eb tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:17.150846 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-cb6e62b6-3b9e-4117-9adb-961456bda1eb tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:17.151615 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-cb6e62b6-3b9e-4117-9adb-961456bda1eb tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:17.152053 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-cb6e62b6-3b9e-4117-9adb-961456bda1eb tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:17.284172 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.policy [None req-cb6e62b6-3b9e-4117-9adb-961456bda1eb tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75753b29a78640df9622d4e2655baf9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee9d603d9cc4a8797f55d544f189720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117874) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:21:17.292054 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.policy [None req-cb6e62b6-3b9e-4117-9adb-961456bda1eb tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75753b29a78640df9622d4e2655baf9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee9d603d9cc4a8797f55d544f189720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117874) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:21:17.293538 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.policy [None req-cb6e62b6-3b9e-4117-9adb-961456bda1eb tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75753b29a78640df9622d4e2655baf9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee9d603d9cc4a8797f55d544f189720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117874) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:21:17.294722 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [None req-cb6e62b6-3b9e-4117-9adb-961456bda1eb tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] 10.222.0.43 "GET /compute/v2.1/servers/b357b60f-93be-4898-a651-4a407a7dc490" status: 200 len: 1742 microversion: 2.20 time: 0.158278 Jun 22 10:21:17.295869 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 376/741] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jun 22 10:21:17 2022] GET /compute/v2.1/servers/b357b60f-93be-4898-a651-4a407a7dc490 => generated 1742 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 10:21:18.314575 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-4ebf43c5-0567-4e38-8cb9-aada9ad82cf9 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Calling method '>' {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:21:18.315124 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.compute.api [None req-4ebf43c5-0567-4e38-8cb9-aada9ad82cf9 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] [instance: b357b60f-93be-4898-a651-4a407a7dc490] Fetching instance by UUID {{(pid=117873) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:21:18.321324 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-4ebf43c5-0567-4e38-8cb9-aada9ad82cf9 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:18.321811 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-4ebf43c5-0567-4e38-8cb9-aada9ad82cf9 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:18.322571 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-4ebf43c5-0567-4e38-8cb9-aada9ad82cf9 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:18.323008 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-4ebf43c5-0567-4e38-8cb9-aada9ad82cf9 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:18.460232 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.policy [None req-4ebf43c5-0567-4e38-8cb9-aada9ad82cf9 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75753b29a78640df9622d4e2655baf9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee9d603d9cc4a8797f55d544f189720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117873) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:21:18.468665 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.policy [None req-4ebf43c5-0567-4e38-8cb9-aada9ad82cf9 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75753b29a78640df9622d4e2655baf9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee9d603d9cc4a8797f55d544f189720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117873) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:21:18.470190 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.policy [None req-4ebf43c5-0567-4e38-8cb9-aada9ad82cf9 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75753b29a78640df9622d4e2655baf9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee9d603d9cc4a8797f55d544f189720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117873) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:21:18.471355 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [None req-4ebf43c5-0567-4e38-8cb9-aada9ad82cf9 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] 10.222.0.43 "GET /compute/v2.1/servers/b357b60f-93be-4898-a651-4a407a7dc490" status: 200 len: 1742 microversion: 2.20 time: 0.161563 Jun 22 10:21:18.472100 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 366/742] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jun 22 10:21:18 2022] GET /compute/v2.1/servers/b357b60f-93be-4898-a651-4a407a7dc490 => generated 1742 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 10:21:19.500126 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-69536cec-f2d9-4653-bca3-379b1d5c245d tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Calling method '>' {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:21:19.500726 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.compute.api [None req-69536cec-f2d9-4653-bca3-379b1d5c245d tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] [instance: b357b60f-93be-4898-a651-4a407a7dc490] Fetching instance by UUID {{(pid=117874) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:21:19.507628 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-69536cec-f2d9-4653-bca3-379b1d5c245d tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:19.508331 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-69536cec-f2d9-4653-bca3-379b1d5c245d tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:19.509293 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-69536cec-f2d9-4653-bca3-379b1d5c245d tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:19.510048 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-69536cec-f2d9-4653-bca3-379b1d5c245d tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:19.738611 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.policy [None req-69536cec-f2d9-4653-bca3-379b1d5c245d tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75753b29a78640df9622d4e2655baf9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee9d603d9cc4a8797f55d544f189720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117874) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:21:19.753476 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.policy [None req-69536cec-f2d9-4653-bca3-379b1d5c245d tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75753b29a78640df9622d4e2655baf9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee9d603d9cc4a8797f55d544f189720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117874) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:21:19.755475 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.policy [None req-69536cec-f2d9-4653-bca3-379b1d5c245d tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75753b29a78640df9622d4e2655baf9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee9d603d9cc4a8797f55d544f189720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117874) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:21:19.756804 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [None req-69536cec-f2d9-4653-bca3-379b1d5c245d tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] 10.222.0.43 "GET /compute/v2.1/servers/b357b60f-93be-4898-a651-4a407a7dc490" status: 200 len: 1737 microversion: 2.20 time: 0.261087 Jun 22 10:21:19.758517 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 377/743] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jun 22 10:21:19 2022] GET /compute/v2.1/servers/b357b60f-93be-4898-a651-4a407a7dc490 => generated 1737 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 10:21:19.892951 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [req-42f2e597-fbee-4ddd-92da-8f585ba5266f req-6061c20e-d7f7-4b79-9734-f08a9766aaa2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b357b60f-93be-4898-a651-4a407a7dc490", "name": "network-vif-plugged", "status": "completed", "tag": "41dc4ae0-ddcc-4582-8858-4f23e4695e4a"}]} {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:21:19.909777 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [req-42f2e597-fbee-4ddd-92da-8f585ba5266f req-6061c20e-d7f7-4b79-9734-f08a9766aaa2 service nova] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:19.910442 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [req-42f2e597-fbee-4ddd-92da-8f585ba5266f req-6061c20e-d7f7-4b79-9734-f08a9766aaa2 service nova] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:19.927465 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.compute.server_external_events [req-42f2e597-fbee-4ddd-92da-8f585ba5266f req-6061c20e-d7f7-4b79-9734-f08a9766aaa2 service nova] Creating event network-vif-plugged:41dc4ae0-ddcc-4582-8858-4f23e4695e4a for instance b357b60f-93be-4898-a651-4a407a7dc490 on hv-cinder-84713 Jun 22 10:21:19.939216 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [req-42f2e597-fbee-4ddd-92da-8f585ba5266f req-6061c20e-d7f7-4b79-9734-f08a9766aaa2 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050041 Jun 22 10:21:19.940421 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 367/744] 10.222.0.43 () {64 vars in 1317 bytes} [Wed Jun 22 10:21:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 22 10:21:20.780286 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-cc3395fd-e2b6-4c6c-92a2-a13c1a7e0cad tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Calling method '>' {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:21:20.782822 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.compute.api [None req-cc3395fd-e2b6-4c6c-92a2-a13c1a7e0cad tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] [instance: b357b60f-93be-4898-a651-4a407a7dc490] Fetching instance by UUID {{(pid=117874) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:21:20.791280 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-cc3395fd-e2b6-4c6c-92a2-a13c1a7e0cad tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:20.791860 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-cc3395fd-e2b6-4c6c-92a2-a13c1a7e0cad tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:20.792875 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-cc3395fd-e2b6-4c6c-92a2-a13c1a7e0cad tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:20.793379 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-cc3395fd-e2b6-4c6c-92a2-a13c1a7e0cad tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:20.988878 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.policy [None req-cc3395fd-e2b6-4c6c-92a2-a13c1a7e0cad tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75753b29a78640df9622d4e2655baf9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee9d603d9cc4a8797f55d544f189720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117874) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:21:20.997060 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.policy [None req-cc3395fd-e2b6-4c6c-92a2-a13c1a7e0cad tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75753b29a78640df9622d4e2655baf9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee9d603d9cc4a8797f55d544f189720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117874) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:21:21.000532 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.policy [None req-cc3395fd-e2b6-4c6c-92a2-a13c1a7e0cad tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75753b29a78640df9622d4e2655baf9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee9d603d9cc4a8797f55d544f189720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117874) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:21:21.001818 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [None req-cc3395fd-e2b6-4c6c-92a2-a13c1a7e0cad tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] 10.222.0.43 "GET /compute/v2.1/servers/b357b60f-93be-4898-a651-4a407a7dc490" status: 200 len: 1737 microversion: 2.20 time: 0.227404 Jun 22 10:21:21.002330 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 378/745] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jun 22 10:21:20 2022] GET /compute/v2.1/servers/b357b60f-93be-4898-a651-4a407a7dc490 => generated 1737 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 10:21:22.022567 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-aa4bf68e-a46f-4fce-9885-50f222cf9615 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Calling method '>' {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:21:22.024215 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.compute.api [None req-aa4bf68e-a46f-4fce-9885-50f222cf9615 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] [instance: b357b60f-93be-4898-a651-4a407a7dc490] Fetching instance by UUID {{(pid=117873) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:21:22.038307 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-aa4bf68e-a46f-4fce-9885-50f222cf9615 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:22.039062 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-aa4bf68e-a46f-4fce-9885-50f222cf9615 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:22.040403 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-aa4bf68e-a46f-4fce-9885-50f222cf9615 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:22.041062 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-aa4bf68e-a46f-4fce-9885-50f222cf9615 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:22.220569 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.policy [None req-aa4bf68e-a46f-4fce-9885-50f222cf9615 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75753b29a78640df9622d4e2655baf9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee9d603d9cc4a8797f55d544f189720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117873) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:21:22.231673 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.policy [None req-aa4bf68e-a46f-4fce-9885-50f222cf9615 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75753b29a78640df9622d4e2655baf9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee9d603d9cc4a8797f55d544f189720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117873) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:21:22.233986 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.policy [None req-aa4bf68e-a46f-4fce-9885-50f222cf9615 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75753b29a78640df9622d4e2655baf9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee9d603d9cc4a8797f55d544f189720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117873) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:21:22.235452 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [None req-aa4bf68e-a46f-4fce-9885-50f222cf9615 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] 10.222.0.43 "GET /compute/v2.1/servers/b357b60f-93be-4898-a651-4a407a7dc490" status: 200 len: 1737 microversion: 2.20 time: 0.218533 Jun 22 10:21:22.236545 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 368/746] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jun 22 10:21:22 2022] GET /compute/v2.1/servers/b357b60f-93be-4898-a651-4a407a7dc490 => generated 1737 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 10:21:23.254145 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-dc54d597-caf9-4757-8e7d-e87c331eceb1 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Calling method '>' {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:21:23.255558 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.compute.api [None req-dc54d597-caf9-4757-8e7d-e87c331eceb1 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] [instance: b357b60f-93be-4898-a651-4a407a7dc490] Fetching instance by UUID {{(pid=117874) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:21:23.263637 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-dc54d597-caf9-4757-8e7d-e87c331eceb1 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:23.264649 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-dc54d597-caf9-4757-8e7d-e87c331eceb1 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:23.265924 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-dc54d597-caf9-4757-8e7d-e87c331eceb1 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:23.266515 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-dc54d597-caf9-4757-8e7d-e87c331eceb1 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:23.271086 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG dbcounter [-] [117874] Writing DB stats nova_cell1:SELECT=100 {{(pid=117874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:21:23.456782 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.policy [None req-dc54d597-caf9-4757-8e7d-e87c331eceb1 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75753b29a78640df9622d4e2655baf9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee9d603d9cc4a8797f55d544f189720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117874) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:21:23.468308 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.policy [None req-dc54d597-caf9-4757-8e7d-e87c331eceb1 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75753b29a78640df9622d4e2655baf9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee9d603d9cc4a8797f55d544f189720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117874) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:21:23.470471 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.policy [None req-dc54d597-caf9-4757-8e7d-e87c331eceb1 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75753b29a78640df9622d4e2655baf9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee9d603d9cc4a8797f55d544f189720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117874) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:21:23.471837 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [None req-dc54d597-caf9-4757-8e7d-e87c331eceb1 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] 10.222.0.43 "GET /compute/v2.1/servers/b357b60f-93be-4898-a651-4a407a7dc490" status: 200 len: 1737 microversion: 2.20 time: 0.221437 Jun 22 10:21:23.472770 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 379/747] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jun 22 10:21:23 2022] GET /compute/v2.1/servers/b357b60f-93be-4898-a651-4a407a7dc490 => generated 1737 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 10:21:24.494068 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-5c5c45ca-424b-42c3-9723-4ea303c931bc tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Calling method '>' {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:21:24.495313 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.compute.api [None req-5c5c45ca-424b-42c3-9723-4ea303c931bc tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] [instance: b357b60f-93be-4898-a651-4a407a7dc490] Fetching instance by UUID {{(pid=117873) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:21:24.502769 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-5c5c45ca-424b-42c3-9723-4ea303c931bc tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:24.503569 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-5c5c45ca-424b-42c3-9723-4ea303c931bc tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:24.504501 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-5c5c45ca-424b-42c3-9723-4ea303c931bc tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:24.505086 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-5c5c45ca-424b-42c3-9723-4ea303c931bc tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:24.677187 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.policy [None req-5c5c45ca-424b-42c3-9723-4ea303c931bc tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75753b29a78640df9622d4e2655baf9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee9d603d9cc4a8797f55d544f189720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117873) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:21:24.683965 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG dbcounter [-] [117873] Writing DB stats nova_cell1:SELECT=100 {{(pid=117873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:21:24.689932 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.policy [None req-5c5c45ca-424b-42c3-9723-4ea303c931bc tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75753b29a78640df9622d4e2655baf9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee9d603d9cc4a8797f55d544f189720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117873) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:21:24.691821 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.policy [None req-5c5c45ca-424b-42c3-9723-4ea303c931bc tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75753b29a78640df9622d4e2655baf9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee9d603d9cc4a8797f55d544f189720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117873) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:21:24.693189 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [None req-5c5c45ca-424b-42c3-9723-4ea303c931bc tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] 10.222.0.43 "GET /compute/v2.1/servers/b357b60f-93be-4898-a651-4a407a7dc490" status: 200 len: 1737 microversion: 2.20 time: 0.205446 Jun 22 10:21:24.694269 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 369/748] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jun 22 10:21:24 2022] GET /compute/v2.1/servers/b357b60f-93be-4898-a651-4a407a7dc490 => generated 1737 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 10:21:25.717337 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-1e5023f7-eec7-4597-9dec-d1bc6b98653e tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Calling method '>' {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:21:25.718120 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.compute.api [None req-1e5023f7-eec7-4597-9dec-d1bc6b98653e tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] [instance: b357b60f-93be-4898-a651-4a407a7dc490] Fetching instance by UUID {{(pid=117874) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:21:25.727620 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-1e5023f7-eec7-4597-9dec-d1bc6b98653e tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:25.728214 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-1e5023f7-eec7-4597-9dec-d1bc6b98653e tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:25.729337 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-1e5023f7-eec7-4597-9dec-d1bc6b98653e tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:25.730165 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-1e5023f7-eec7-4597-9dec-d1bc6b98653e tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:25.887218 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.policy [None req-1e5023f7-eec7-4597-9dec-d1bc6b98653e tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75753b29a78640df9622d4e2655baf9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee9d603d9cc4a8797f55d544f189720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117874) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:21:25.896145 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.policy [None req-1e5023f7-eec7-4597-9dec-d1bc6b98653e tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75753b29a78640df9622d4e2655baf9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee9d603d9cc4a8797f55d544f189720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117874) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:21:25.897652 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.policy [None req-1e5023f7-eec7-4597-9dec-d1bc6b98653e tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75753b29a78640df9622d4e2655baf9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee9d603d9cc4a8797f55d544f189720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117874) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:21:25.898946 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [None req-1e5023f7-eec7-4597-9dec-d1bc6b98653e tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] 10.222.0.43 "GET /compute/v2.1/servers/b357b60f-93be-4898-a651-4a407a7dc490" status: 200 len: 1737 microversion: 2.20 time: 0.187528 Jun 22 10:21:25.900354 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 380/749] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jun 22 10:21:25 2022] GET /compute/v2.1/servers/b357b60f-93be-4898-a651-4a407a7dc490 => generated 1737 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 10:21:26.921327 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-64e9279c-825e-4164-a1c1-b27908b62341 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Calling method '>' {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:21:26.930011 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.compute.api [None req-64e9279c-825e-4164-a1c1-b27908b62341 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] [instance: b357b60f-93be-4898-a651-4a407a7dc490] Fetching instance by UUID {{(pid=117873) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:21:26.933680 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-64e9279c-825e-4164-a1c1-b27908b62341 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:26.942406 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-64e9279c-825e-4164-a1c1-b27908b62341 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:26.942406 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-64e9279c-825e-4164-a1c1-b27908b62341 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:26.942406 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-64e9279c-825e-4164-a1c1-b27908b62341 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:27.085610 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.policy [None req-64e9279c-825e-4164-a1c1-b27908b62341 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75753b29a78640df9622d4e2655baf9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee9d603d9cc4a8797f55d544f189720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117873) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:21:27.098609 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.policy [None req-64e9279c-825e-4164-a1c1-b27908b62341 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75753b29a78640df9622d4e2655baf9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee9d603d9cc4a8797f55d544f189720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117873) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:21:27.100202 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.policy [None req-64e9279c-825e-4164-a1c1-b27908b62341 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75753b29a78640df9622d4e2655baf9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee9d603d9cc4a8797f55d544f189720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117873) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:21:27.101763 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [None req-64e9279c-825e-4164-a1c1-b27908b62341 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] 10.222.0.43 "GET /compute/v2.1/servers/b357b60f-93be-4898-a651-4a407a7dc490" status: 200 len: 1737 microversion: 2.20 time: 0.187048 Jun 22 10:21:27.111597 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 370/750] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jun 22 10:21:26 2022] GET /compute/v2.1/servers/b357b60f-93be-4898-a651-4a407a7dc490 => generated 1737 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 10:21:28.122119 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-9074bca4-a4b7-47a4-a26b-dbd43a25465e tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Calling method '>' {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:21:28.123699 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.compute.api [None req-9074bca4-a4b7-47a4-a26b-dbd43a25465e tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] [instance: b357b60f-93be-4898-a651-4a407a7dc490] Fetching instance by UUID {{(pid=117874) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:21:28.130872 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-9074bca4-a4b7-47a4-a26b-dbd43a25465e tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:28.131316 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-9074bca4-a4b7-47a4-a26b-dbd43a25465e tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:28.132212 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-9074bca4-a4b7-47a4-a26b-dbd43a25465e tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:28.132666 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-9074bca4-a4b7-47a4-a26b-dbd43a25465e tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:28.280080 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.policy [None req-9074bca4-a4b7-47a4-a26b-dbd43a25465e tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75753b29a78640df9622d4e2655baf9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee9d603d9cc4a8797f55d544f189720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117874) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:21:28.289389 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.policy [None req-9074bca4-a4b7-47a4-a26b-dbd43a25465e tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75753b29a78640df9622d4e2655baf9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee9d603d9cc4a8797f55d544f189720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117874) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:21:28.291172 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.policy [None req-9074bca4-a4b7-47a4-a26b-dbd43a25465e tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75753b29a78640df9622d4e2655baf9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee9d603d9cc4a8797f55d544f189720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117874) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:21:28.292594 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [None req-9074bca4-a4b7-47a4-a26b-dbd43a25465e tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] 10.222.0.43 "GET /compute/v2.1/servers/b357b60f-93be-4898-a651-4a407a7dc490" status: 200 len: 1737 microversion: 2.20 time: 0.174628 Jun 22 10:21:28.293253 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 381/751] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jun 22 10:21:28 2022] GET /compute/v2.1/servers/b357b60f-93be-4898-a651-4a407a7dc490 => generated 1737 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 10:21:29.311663 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-5610e7be-13a9-40e0-9a80-28ff169ef38e tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Calling method '>' {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:21:29.312264 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.compute.api [None req-5610e7be-13a9-40e0-9a80-28ff169ef38e tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] [instance: b357b60f-93be-4898-a651-4a407a7dc490] Fetching instance by UUID {{(pid=117873) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:21:29.318788 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-5610e7be-13a9-40e0-9a80-28ff169ef38e tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:29.319232 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-5610e7be-13a9-40e0-9a80-28ff169ef38e tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:29.319987 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-5610e7be-13a9-40e0-9a80-28ff169ef38e tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:29.320418 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-5610e7be-13a9-40e0-9a80-28ff169ef38e tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:29.458087 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.policy [None req-5610e7be-13a9-40e0-9a80-28ff169ef38e tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75753b29a78640df9622d4e2655baf9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee9d603d9cc4a8797f55d544f189720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117873) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:21:29.466136 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.policy [None req-5610e7be-13a9-40e0-9a80-28ff169ef38e tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75753b29a78640df9622d4e2655baf9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee9d603d9cc4a8797f55d544f189720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117873) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:21:29.467941 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.policy [None req-5610e7be-13a9-40e0-9a80-28ff169ef38e tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75753b29a78640df9622d4e2655baf9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee9d603d9cc4a8797f55d544f189720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117873) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:21:29.469082 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [None req-5610e7be-13a9-40e0-9a80-28ff169ef38e tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] 10.222.0.43 "GET /compute/v2.1/servers/b357b60f-93be-4898-a651-4a407a7dc490" status: 200 len: 1719 microversion: 2.20 time: 0.161872 Jun 22 10:21:29.469641 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 371/752] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jun 22 10:21:29 2022] GET /compute/v2.1/servers/b357b60f-93be-4898-a651-4a407a7dc490 => generated 1719 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 10:21:30.489306 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-b76095d8-26ca-446e-80ea-628f25c5e724 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Calling method '>' {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:21:30.490639 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.compute.api [None req-b76095d8-26ca-446e-80ea-628f25c5e724 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] [instance: b357b60f-93be-4898-a651-4a407a7dc490] Fetching instance by UUID {{(pid=117874) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:21:30.493279 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG dbcounter [-] [117874] Writing DB stats nova_api:SELECT=46 {{(pid=117874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:21:30.498849 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-b76095d8-26ca-446e-80ea-628f25c5e724 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:30.499242 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-b76095d8-26ca-446e-80ea-628f25c5e724 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:30.500362 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-b76095d8-26ca-446e-80ea-628f25c5e724 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:30.500956 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-b76095d8-26ca-446e-80ea-628f25c5e724 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:30.640101 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.policy [None req-b76095d8-26ca-446e-80ea-628f25c5e724 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75753b29a78640df9622d4e2655baf9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee9d603d9cc4a8797f55d544f189720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117874) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:21:30.648628 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.policy [None req-b76095d8-26ca-446e-80ea-628f25c5e724 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75753b29a78640df9622d4e2655baf9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee9d603d9cc4a8797f55d544f189720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117874) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:21:30.650231 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.policy [None req-b76095d8-26ca-446e-80ea-628f25c5e724 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75753b29a78640df9622d4e2655baf9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee9d603d9cc4a8797f55d544f189720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117874) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:21:30.651528 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [None req-b76095d8-26ca-446e-80ea-628f25c5e724 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] 10.222.0.43 "GET /compute/v2.1/servers/b357b60f-93be-4898-a651-4a407a7dc490" status: 200 len: 1722 microversion: 2.20 time: 0.166184 Jun 22 10:21:30.652268 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 382/753] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jun 22 10:21:30 2022] GET /compute/v2.1/servers/b357b60f-93be-4898-a651-4a407a7dc490 => generated 1722 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 10:21:30.669356 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-7c364d83-404a-439c-9f44-d1c3b09c17c1 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5f74c5e6-4ca6-457f-9ee8-e434283026fb"}} {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:21:30.671131 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.compute.api [None req-7c364d83-404a-439c-9f44-d1c3b09c17c1 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] [instance: b357b60f-93be-4898-a651-4a407a7dc490] Fetching instance by UUID {{(pid=117873) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:21:30.677661 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-7c364d83-404a-439c-9f44-d1c3b09c17c1 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:30.678207 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-7c364d83-404a-439c-9f44-d1c3b09c17c1 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:30.679040 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-7c364d83-404a-439c-9f44-d1c3b09c17c1 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:30.679575 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-7c364d83-404a-439c-9f44-d1c3b09c17c1 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:30.974966 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [None req-7c364d83-404a-439c-9f44-d1c3b09c17c1 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] 10.222.0.43 "POST /compute/v2.1/servers/b357b60f-93be-4898-a651-4a407a7dc490/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.309455 Jun 22 10:21:30.975607 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 372/754] 10.222.0.43 () {62 vars in 1363 bytes} [Wed Jun 22 10:21:30 2022] POST /compute/v2.1/servers/b357b60f-93be-4898-a651-4a407a7dc490/os-volume_attachments => generated 188 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 22 10:21:31.093496 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-18d09e73-f717-4499-993b-644be05692ec tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Calling method '>' {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:21:31.094010 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.compute.api [None req-18d09e73-f717-4499-993b-644be05692ec tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] [instance: b357b60f-93be-4898-a651-4a407a7dc490] Fetching instance by UUID {{(pid=117874) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:21:31.104265 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-18d09e73-f717-4499-993b-644be05692ec tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:31.104789 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-18d09e73-f717-4499-993b-644be05692ec tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:31.105653 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-18d09e73-f717-4499-993b-644be05692ec tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:31.106181 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-18d09e73-f717-4499-993b-644be05692ec tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:31.362578 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [None req-18d09e73-f717-4499-993b-644be05692ec tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] 10.222.0.43 "DELETE /compute/v2.1/servers/b357b60f-93be-4898-a651-4a407a7dc490/os-volume_attachments/5f74c5e6-4ca6-457f-9ee8-e434283026fb" status: 202 len: 0 microversion: 2.20 time: 0.272895 Jun 22 10:21:31.363184 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 383/755] 10.222.0.43 () {60 vars in 1456 bytes} [Wed Jun 22 10:21:31 2022] DELETE /compute/v2.1/servers/b357b60f-93be-4898-a651-4a407a7dc490/os-volume_attachments/5f74c5e6-4ca6-457f-9ee8-e434283026fb => generated 0 bytes in 274 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 22 10:21:31.422117 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-837064f9-632a-4a33-ad75-85ab8244a226 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:21:31.422712 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.compute.api [None req-837064f9-632a-4a33-ad75-85ab8244a226 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] [instance: b357b60f-93be-4898-a651-4a407a7dc490] Fetching instance by UUID {{(pid=117873) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:21:31.430006 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-837064f9-632a-4a33-ad75-85ab8244a226 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:31.430460 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-837064f9-632a-4a33-ad75-85ab8244a226 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:31.431234 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-837064f9-632a-4a33-ad75-85ab8244a226 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:31.431673 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-837064f9-632a-4a33-ad75-85ab8244a226 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:31.622848 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [None req-837064f9-632a-4a33-ad75-85ab8244a226 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] 10.222.0.43 "POST /compute/v2.1/servers/b357b60f-93be-4898-a651-4a407a7dc490/action" status: 202 len: 0 microversion: 2.20 time: 0.206724 Jun 22 10:21:31.623834 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 373/756] 10.222.0.43 () {62 vars in 1318 bytes} [Wed Jun 22 10:21:31 2022] POST /compute/v2.1/servers/b357b60f-93be-4898-a651-4a407a7dc490/action => generated 0 bytes in 208 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 22 10:21:31.632592 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-c9cc38ee-8cbb-47cf-b19c-32ae61913a96 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Calling method '>' {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:21:31.633199 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.compute.api [None req-c9cc38ee-8cbb-47cf-b19c-32ae61913a96 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] [instance: b357b60f-93be-4898-a651-4a407a7dc490] Fetching instance by UUID {{(pid=117874) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:21:31.641412 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-c9cc38ee-8cbb-47cf-b19c-32ae61913a96 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:31.642554 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-c9cc38ee-8cbb-47cf-b19c-32ae61913a96 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:31.643332 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-c9cc38ee-8cbb-47cf-b19c-32ae61913a96 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:31.643770 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-c9cc38ee-8cbb-47cf-b19c-32ae61913a96 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:31.803402 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.policy [None req-c9cc38ee-8cbb-47cf-b19c-32ae61913a96 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75753b29a78640df9622d4e2655baf9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee9d603d9cc4a8797f55d544f189720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117874) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:21:31.813763 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.policy [None req-c9cc38ee-8cbb-47cf-b19c-32ae61913a96 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75753b29a78640df9622d4e2655baf9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee9d603d9cc4a8797f55d544f189720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117874) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:21:31.815950 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.policy [None req-c9cc38ee-8cbb-47cf-b19c-32ae61913a96 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75753b29a78640df9622d4e2655baf9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee9d603d9cc4a8797f55d544f189720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117874) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:21:31.817138 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [None req-c9cc38ee-8cbb-47cf-b19c-32ae61913a96 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] 10.222.0.43 "GET /compute/v2.1/servers/b357b60f-93be-4898-a651-4a407a7dc490" status: 200 len: 1670 microversion: 2.20 time: 0.188433 Jun 22 10:21:31.827097 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 384/757] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jun 22 10:21:31 2022] GET /compute/v2.1/servers/b357b60f-93be-4898-a651-4a407a7dc490 => generated 1670 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 10:21:32.067566 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [req-7232fcce-c449-46a5-93db-65b185582050 req-c09ae547-4612-4547-a399-04848a9d7941 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b357b60f-93be-4898-a651-4a407a7dc490", "name": "network-vif-unplugged", "status": "completed", "tag": "41dc4ae0-ddcc-4582-8858-4f23e4695e4a"}]} {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:21:32.077607 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [req-7232fcce-c449-46a5-93db-65b185582050 req-c09ae547-4612-4547-a399-04848a9d7941 service nova] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:32.078148 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [req-7232fcce-c449-46a5-93db-65b185582050 req-c09ae547-4612-4547-a399-04848a9d7941 service nova] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:32.090963 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.compute.server_external_events [req-7232fcce-c449-46a5-93db-65b185582050 req-c09ae547-4612-4547-a399-04848a9d7941 service nova] Unable to find a host for instance b357b60f-93be-4898-a651-4a407a7dc490. Dropping event network-vif-unplugged {{(pid=117873) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jun 22 10:21:32.090963 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [req-7232fcce-c449-46a5-93db-65b185582050 req-c09ae547-4612-4547-a399-04848a9d7941 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.229829 Jun 22 10:21:32.091376 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 374/758] 10.222.0.43 () {64 vars in 1317 bytes} [Wed Jun 22 10:21:31 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 231 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Jun 22 10:21:32.836372 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-970e1844-eb59-45aa-838e-2ca656ce2c0f tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Calling method '>' {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:21:32.837143 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.compute.api [None req-970e1844-eb59-45aa-838e-2ca656ce2c0f tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] [instance: b357b60f-93be-4898-a651-4a407a7dc490] Fetching instance by UUID {{(pid=117874) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:21:32.844917 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-970e1844-eb59-45aa-838e-2ca656ce2c0f tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:32.845370 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-970e1844-eb59-45aa-838e-2ca656ce2c0f tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:32.846174 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-970e1844-eb59-45aa-838e-2ca656ce2c0f tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:32.846607 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-970e1844-eb59-45aa-838e-2ca656ce2c0f tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:32.985108 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.policy [None req-970e1844-eb59-45aa-838e-2ca656ce2c0f tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75753b29a78640df9622d4e2655baf9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee9d603d9cc4a8797f55d544f189720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117874) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:21:32.993380 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.policy [None req-970e1844-eb59-45aa-838e-2ca656ce2c0f tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75753b29a78640df9622d4e2655baf9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee9d603d9cc4a8797f55d544f189720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117874) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:21:32.994908 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.policy [None req-970e1844-eb59-45aa-838e-2ca656ce2c0f tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75753b29a78640df9622d4e2655baf9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee9d603d9cc4a8797f55d544f189720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117874) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:21:32.996046 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [None req-970e1844-eb59-45aa-838e-2ca656ce2c0f tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] 10.222.0.43 "GET /compute/v2.1/servers/b357b60f-93be-4898-a651-4a407a7dc490" status: 200 len: 1670 microversion: 2.20 time: 0.163634 Jun 22 10:21:32.996601 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 385/759] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jun 22 10:21:32 2022] GET /compute/v2.1/servers/b357b60f-93be-4898-a651-4a407a7dc490 => generated 1670 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 10:21:34.013669 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-fbc15d42-20f4-4662-aa95-83999e6ab652 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Calling method '>' {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:21:34.015187 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.compute.api [None req-fbc15d42-20f4-4662-aa95-83999e6ab652 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] [instance: b357b60f-93be-4898-a651-4a407a7dc490] Fetching instance by UUID {{(pid=117873) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:21:34.023086 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-fbc15d42-20f4-4662-aa95-83999e6ab652 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:34.023536 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-fbc15d42-20f4-4662-aa95-83999e6ab652 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:34.024312 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-fbc15d42-20f4-4662-aa95-83999e6ab652 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:34.024733 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-fbc15d42-20f4-4662-aa95-83999e6ab652 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:34.188049 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.policy [None req-fbc15d42-20f4-4662-aa95-83999e6ab652 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75753b29a78640df9622d4e2655baf9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee9d603d9cc4a8797f55d544f189720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117873) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:21:34.196989 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.policy [None req-fbc15d42-20f4-4662-aa95-83999e6ab652 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75753b29a78640df9622d4e2655baf9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee9d603d9cc4a8797f55d544f189720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117873) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:21:34.198531 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.policy [None req-fbc15d42-20f4-4662-aa95-83999e6ab652 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75753b29a78640df9622d4e2655baf9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee9d603d9cc4a8797f55d544f189720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117873) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:21:34.199689 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [None req-fbc15d42-20f4-4662-aa95-83999e6ab652 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] 10.222.0.43 "GET /compute/v2.1/servers/b357b60f-93be-4898-a651-4a407a7dc490" status: 200 len: 1728 microversion: 2.20 time: 0.190056 Jun 22 10:21:34.200274 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 375/760] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jun 22 10:21:34 2022] GET /compute/v2.1/servers/b357b60f-93be-4898-a651-4a407a7dc490 => generated 1728 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 22 10:21:35.221677 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-5929b586-858c-4e15-8f7f-d2602800ba4b tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Calling method '>' {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:21:35.222319 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.compute.api [None req-5929b586-858c-4e15-8f7f-d2602800ba4b tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] [instance: b357b60f-93be-4898-a651-4a407a7dc490] Fetching instance by UUID {{(pid=117874) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:21:35.229055 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-5929b586-858c-4e15-8f7f-d2602800ba4b tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:35.229512 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-5929b586-858c-4e15-8f7f-d2602800ba4b tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:35.230317 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-5929b586-858c-4e15-8f7f-d2602800ba4b tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:35.230755 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-5929b586-858c-4e15-8f7f-d2602800ba4b tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:35.437735 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.policy [None req-5929b586-858c-4e15-8f7f-d2602800ba4b tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75753b29a78640df9622d4e2655baf9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee9d603d9cc4a8797f55d544f189720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117874) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:21:35.446547 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.policy [None req-5929b586-858c-4e15-8f7f-d2602800ba4b tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75753b29a78640df9622d4e2655baf9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee9d603d9cc4a8797f55d544f189720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117874) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:21:35.448412 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.policy [None req-5929b586-858c-4e15-8f7f-d2602800ba4b tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75753b29a78640df9622d4e2655baf9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee9d603d9cc4a8797f55d544f189720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117874) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:21:35.450117 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [None req-5929b586-858c-4e15-8f7f-d2602800ba4b tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] 10.222.0.43 "GET /compute/v2.1/servers/b357b60f-93be-4898-a651-4a407a7dc490" status: 200 len: 1728 microversion: 2.20 time: 0.235603 Jun 22 10:21:35.462478 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 386/761] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jun 22 10:21:35 2022] GET /compute/v2.1/servers/b357b60f-93be-4898-a651-4a407a7dc490 => generated 1728 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 10:21:36.470654 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-b20a30d3-c39c-4646-b7d4-51a42f990e3b tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Calling method '>' {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:21:36.471983 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.compute.api [None req-b20a30d3-c39c-4646-b7d4-51a42f990e3b tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] [instance: b357b60f-93be-4898-a651-4a407a7dc490] Fetching instance by UUID {{(pid=117873) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:21:36.478995 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-b20a30d3-c39c-4646-b7d4-51a42f990e3b tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:36.479440 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-b20a30d3-c39c-4646-b7d4-51a42f990e3b tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:36.480192 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-b20a30d3-c39c-4646-b7d4-51a42f990e3b tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:36.480647 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-b20a30d3-c39c-4646-b7d4-51a42f990e3b tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:36.675163 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.policy [None req-b20a30d3-c39c-4646-b7d4-51a42f990e3b tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75753b29a78640df9622d4e2655baf9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee9d603d9cc4a8797f55d544f189720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117873) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:21:36.683857 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.policy [None req-b20a30d3-c39c-4646-b7d4-51a42f990e3b tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75753b29a78640df9622d4e2655baf9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee9d603d9cc4a8797f55d544f189720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117873) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:21:36.685943 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.policy [None req-b20a30d3-c39c-4646-b7d4-51a42f990e3b tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75753b29a78640df9622d4e2655baf9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee9d603d9cc4a8797f55d544f189720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117873) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:21:36.687218 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [None req-b20a30d3-c39c-4646-b7d4-51a42f990e3b tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] 10.222.0.43 "GET /compute/v2.1/servers/b357b60f-93be-4898-a651-4a407a7dc490" status: 200 len: 1728 microversion: 2.20 time: 0.221967 Jun 22 10:21:36.687765 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 376/762] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jun 22 10:21:36 2022] GET /compute/v2.1/servers/b357b60f-93be-4898-a651-4a407a7dc490 => generated 1728 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 10:21:37.095448 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-77cb8912-5c6c-4fe3-b161-bacec9971fad tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Calling method '>' {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:21:37.096603 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.compute.api [None req-77cb8912-5c6c-4fe3-b161-bacec9971fad tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] [instance: 982a8b14-2931-49ee-bc63-124bb37fb8c4] Fetching instance by UUID {{(pid=117874) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:21:37.103673 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-77cb8912-5c6c-4fe3-b161-bacec9971fad tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:37.104450 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-77cb8912-5c6c-4fe3-b161-bacec9971fad tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:37.105624 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-77cb8912-5c6c-4fe3-b161-bacec9971fad tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:37.106288 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-77cb8912-5c6c-4fe3-b161-bacec9971fad tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:37.133616 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [None req-77cb8912-5c6c-4fe3-b161-bacec9971fad tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] 10.222.0.43 "GET /compute/v2.1/servers/982a8b14-2931-49ee-bc63-124bb37fb8c4/ips" status: 200 len: 150 microversion: 2.1 time: 0.042083 Jun 22 10:21:37.134873 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 387/763] 10.222.0.43 () {58 vars in 1247 bytes} [Wed Jun 22 10:21:37 2022] GET /compute/v2.1/servers/982a8b14-2931-49ee-bc63-124bb37fb8c4/ips => generated 150 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 10:21:37.706974 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-904b289d-5a16-4aff-8ef5-f79eb882fb40 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Calling method '>' {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:21:37.708167 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.compute.api [None req-904b289d-5a16-4aff-8ef5-f79eb882fb40 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] [instance: b357b60f-93be-4898-a651-4a407a7dc490] Fetching instance by UUID {{(pid=117873) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:21:37.715706 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-904b289d-5a16-4aff-8ef5-f79eb882fb40 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:37.716591 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-904b289d-5a16-4aff-8ef5-f79eb882fb40 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:37.717499 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-904b289d-5a16-4aff-8ef5-f79eb882fb40 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:37.718194 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-904b289d-5a16-4aff-8ef5-f79eb882fb40 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:37.871319 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.policy [None req-904b289d-5a16-4aff-8ef5-f79eb882fb40 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75753b29a78640df9622d4e2655baf9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee9d603d9cc4a8797f55d544f189720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117873) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:21:37.880093 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.policy [None req-904b289d-5a16-4aff-8ef5-f79eb882fb40 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75753b29a78640df9622d4e2655baf9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee9d603d9cc4a8797f55d544f189720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117873) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:21:37.882069 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.policy [None req-904b289d-5a16-4aff-8ef5-f79eb882fb40 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75753b29a78640df9622d4e2655baf9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee9d603d9cc4a8797f55d544f189720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117873) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:21:37.883416 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [None req-904b289d-5a16-4aff-8ef5-f79eb882fb40 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] 10.222.0.43 "GET /compute/v2.1/servers/b357b60f-93be-4898-a651-4a407a7dc490" status: 200 len: 1728 microversion: 2.20 time: 0.181227 Jun 22 10:21:37.884421 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 377/764] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jun 22 10:21:37 2022] GET /compute/v2.1/servers/b357b60f-93be-4898-a651-4a407a7dc490 => generated 1728 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 10:21:38.546206 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-bc0d48a9-bb99-48bb-b02b-017a1e21f250 tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b60061b0-6260-49c1-9831-4f28f041a94c"}} {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:21:38.548369 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.compute.api [None req-bc0d48a9-bb99-48bb-b02b-017a1e21f250 tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] [instance: 982a8b14-2931-49ee-bc63-124bb37fb8c4] Fetching instance by UUID {{(pid=117874) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:21:38.561021 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-bc0d48a9-bb99-48bb-b02b-017a1e21f250 tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:38.566837 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-bc0d48a9-bb99-48bb-b02b-017a1e21f250 tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:38.568102 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-bc0d48a9-bb99-48bb-b02b-017a1e21f250 tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:38.568932 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-bc0d48a9-bb99-48bb-b02b-017a1e21f250 tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:38.903344 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-e9516b83-0c74-47a0-bc15-8120d088a467 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Calling method '>' {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:21:38.904338 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.compute.api [None req-e9516b83-0c74-47a0-bc15-8120d088a467 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] [instance: b357b60f-93be-4898-a651-4a407a7dc490] Fetching instance by UUID {{(pid=117873) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:21:38.906913 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG dbcounter [-] [117873] Writing DB stats nova_api:SELECT=36 {{(pid=117873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:21:38.912992 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-e9516b83-0c74-47a0-bc15-8120d088a467 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:38.913717 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-e9516b83-0c74-47a0-bc15-8120d088a467 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:38.914667 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-e9516b83-0c74-47a0-bc15-8120d088a467 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:38.915263 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-e9516b83-0c74-47a0-bc15-8120d088a467 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:39.091138 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.policy [None req-e9516b83-0c74-47a0-bc15-8120d088a467 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75753b29a78640df9622d4e2655baf9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee9d603d9cc4a8797f55d544f189720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117873) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:21:39.102619 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.policy [None req-e9516b83-0c74-47a0-bc15-8120d088a467 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75753b29a78640df9622d4e2655baf9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee9d603d9cc4a8797f55d544f189720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117873) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:21:39.104758 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.policy [None req-e9516b83-0c74-47a0-bc15-8120d088a467 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75753b29a78640df9622d4e2655baf9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee9d603d9cc4a8797f55d544f189720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117873) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:21:39.109666 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [None req-e9516b83-0c74-47a0-bc15-8120d088a467 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] 10.222.0.43 "GET /compute/v2.1/servers/b357b60f-93be-4898-a651-4a407a7dc490" status: 200 len: 1728 microversion: 2.20 time: 0.209943 Jun 22 10:21:39.121389 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 378/765] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jun 22 10:21:38 2022] GET /compute/v2.1/servers/b357b60f-93be-4898-a651-4a407a7dc490 => generated 1728 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 22 10:21:40.130145 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-c1db350b-34aa-4c65-a28f-2548b3ec51c3 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Calling method '>' {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:21:40.130792 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.compute.api [None req-c1db350b-34aa-4c65-a28f-2548b3ec51c3 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] [instance: b357b60f-93be-4898-a651-4a407a7dc490] Fetching instance by UUID {{(pid=117873) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:21:40.149906 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-c1db350b-34aa-4c65-a28f-2548b3ec51c3 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:40.150592 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-c1db350b-34aa-4c65-a28f-2548b3ec51c3 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:40.151534 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-c1db350b-34aa-4c65-a28f-2548b3ec51c3 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:40.154769 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-c1db350b-34aa-4c65-a28f-2548b3ec51c3 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:40.387162 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.policy [None req-c1db350b-34aa-4c65-a28f-2548b3ec51c3 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75753b29a78640df9622d4e2655baf9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee9d603d9cc4a8797f55d544f189720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117873) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:21:40.396560 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.policy [None req-c1db350b-34aa-4c65-a28f-2548b3ec51c3 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75753b29a78640df9622d4e2655baf9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee9d603d9cc4a8797f55d544f189720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117873) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:21:40.398930 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.policy [None req-c1db350b-34aa-4c65-a28f-2548b3ec51c3 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75753b29a78640df9622d4e2655baf9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee9d603d9cc4a8797f55d544f189720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117873) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:21:40.400086 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [None req-c1db350b-34aa-4c65-a28f-2548b3ec51c3 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] 10.222.0.43 "GET /compute/v2.1/servers/b357b60f-93be-4898-a651-4a407a7dc490" status: 200 len: 1728 microversion: 2.20 time: 0.274210 Jun 22 10:21:40.400686 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 379/766] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jun 22 10:21:40 2022] GET /compute/v2.1/servers/b357b60f-93be-4898-a651-4a407a7dc490 => generated 1728 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 10:21:41.421316 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-c0e4e62f-ae7d-43b4-bf70-2a937ab756c8 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Calling method '>' {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:21:41.422068 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.compute.api [None req-c0e4e62f-ae7d-43b4-bf70-2a937ab756c8 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] [instance: b357b60f-93be-4898-a651-4a407a7dc490] Fetching instance by UUID {{(pid=117873) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:21:41.428664 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-c0e4e62f-ae7d-43b4-bf70-2a937ab756c8 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:41.429104 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-c0e4e62f-ae7d-43b4-bf70-2a937ab756c8 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:41.429893 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-c0e4e62f-ae7d-43b4-bf70-2a937ab756c8 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:41.430322 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-c0e4e62f-ae7d-43b4-bf70-2a937ab756c8 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:41.572050 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.policy [None req-c0e4e62f-ae7d-43b4-bf70-2a937ab756c8 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75753b29a78640df9622d4e2655baf9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee9d603d9cc4a8797f55d544f189720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117873) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:21:41.581287 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.policy [None req-c0e4e62f-ae7d-43b4-bf70-2a937ab756c8 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75753b29a78640df9622d4e2655baf9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee9d603d9cc4a8797f55d544f189720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117873) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:21:41.582799 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.policy [None req-c0e4e62f-ae7d-43b4-bf70-2a937ab756c8 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75753b29a78640df9622d4e2655baf9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee9d603d9cc4a8797f55d544f189720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117873) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:21:41.583952 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [None req-c0e4e62f-ae7d-43b4-bf70-2a937ab756c8 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] 10.222.0.43 "GET /compute/v2.1/servers/b357b60f-93be-4898-a651-4a407a7dc490" status: 200 len: 1728 microversion: 2.20 time: 0.167615 Jun 22 10:21:41.584784 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 380/767] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jun 22 10:21:41 2022] GET /compute/v2.1/servers/b357b60f-93be-4898-a651-4a407a7dc490 => generated 1728 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 22 10:21:42.603403 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-9dbc1cb4-d8ee-44be-a42d-b10d09d7e04e tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Calling method '>' {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:21:42.604109 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.compute.api [None req-9dbc1cb4-d8ee-44be-a42d-b10d09d7e04e tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] [instance: b357b60f-93be-4898-a651-4a407a7dc490] Fetching instance by UUID {{(pid=117873) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:21:42.611265 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-9dbc1cb4-d8ee-44be-a42d-b10d09d7e04e tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:42.611779 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-9dbc1cb4-d8ee-44be-a42d-b10d09d7e04e tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:42.612528 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-9dbc1cb4-d8ee-44be-a42d-b10d09d7e04e tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:42.612956 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-9dbc1cb4-d8ee-44be-a42d-b10d09d7e04e tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:42.746807 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.policy [None req-9dbc1cb4-d8ee-44be-a42d-b10d09d7e04e tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75753b29a78640df9622d4e2655baf9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee9d603d9cc4a8797f55d544f189720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117873) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:21:42.754606 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.policy [None req-9dbc1cb4-d8ee-44be-a42d-b10d09d7e04e tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75753b29a78640df9622d4e2655baf9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee9d603d9cc4a8797f55d544f189720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117873) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:21:42.756117 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.policy [None req-9dbc1cb4-d8ee-44be-a42d-b10d09d7e04e tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75753b29a78640df9622d4e2655baf9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee9d603d9cc4a8797f55d544f189720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117873) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:21:42.757280 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [None req-9dbc1cb4-d8ee-44be-a42d-b10d09d7e04e tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] 10.222.0.43 "GET /compute/v2.1/servers/b357b60f-93be-4898-a651-4a407a7dc490" status: 200 len: 1728 microversion: 2.20 time: 0.158121 Jun 22 10:21:42.757858 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 381/768] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jun 22 10:21:42 2022] GET /compute/v2.1/servers/b357b60f-93be-4898-a651-4a407a7dc490 => generated 1728 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 22 10:21:43.775701 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-af090489-83c8-4864-ad64-dde70847ec96 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Calling method '>' {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:21:43.776427 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.compute.api [None req-af090489-83c8-4864-ad64-dde70847ec96 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] [instance: b357b60f-93be-4898-a651-4a407a7dc490] Fetching instance by UUID {{(pid=117873) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:21:43.784085 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-af090489-83c8-4864-ad64-dde70847ec96 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:43.784522 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-af090489-83c8-4864-ad64-dde70847ec96 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:43.785274 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-af090489-83c8-4864-ad64-dde70847ec96 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:43.785723 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-af090489-83c8-4864-ad64-dde70847ec96 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:43.937075 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.policy [None req-af090489-83c8-4864-ad64-dde70847ec96 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75753b29a78640df9622d4e2655baf9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee9d603d9cc4a8797f55d544f189720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117873) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:21:43.946935 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.policy [None req-af090489-83c8-4864-ad64-dde70847ec96 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75753b29a78640df9622d4e2655baf9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee9d603d9cc4a8797f55d544f189720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117873) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:21:43.948463 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.policy [None req-af090489-83c8-4864-ad64-dde70847ec96 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75753b29a78640df9622d4e2655baf9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee9d603d9cc4a8797f55d544f189720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117873) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:21:43.949838 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [None req-af090489-83c8-4864-ad64-dde70847ec96 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] 10.222.0.43 "GET /compute/v2.1/servers/b357b60f-93be-4898-a651-4a407a7dc490" status: 200 len: 1728 microversion: 2.20 time: 0.178078 Jun 22 10:21:43.951303 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 382/769] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jun 22 10:21:43 2022] GET /compute/v2.1/servers/b357b60f-93be-4898-a651-4a407a7dc490 => generated 1728 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 22 10:21:44.020725 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [None req-bc0d48a9-bb99-48bb-b02b-017a1e21f250 tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] 10.222.0.43 "POST /compute/v2.1/servers/982a8b14-2931-49ee-bc63-124bb37fb8c4/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 5.479554 Jun 22 10:21:44.021420 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 388/770] 10.222.0.43 () {60 vars in 1322 bytes} [Wed Jun 22 10:21:38 2022] POST /compute/v2.1/servers/982a8b14-2931-49ee-bc63-124bb37fb8c4/os-volume_attachments => generated 194 bytes in 5481 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 10:21:44.969566 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-0444f89e-28cb-4def-8088-babca5ff2aa7 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Calling method '>' {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:21:44.970174 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.compute.api [None req-0444f89e-28cb-4def-8088-babca5ff2aa7 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] [instance: b357b60f-93be-4898-a651-4a407a7dc490] Fetching instance by UUID {{(pid=117873) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:21:44.978095 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-0444f89e-28cb-4def-8088-babca5ff2aa7 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:44.978535 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-0444f89e-28cb-4def-8088-babca5ff2aa7 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:44.979293 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-0444f89e-28cb-4def-8088-babca5ff2aa7 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:44.979719 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-0444f89e-28cb-4def-8088-babca5ff2aa7 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:44.997751 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG dbcounter [-] [117873] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=117873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:21:45.118645 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.policy [None req-0444f89e-28cb-4def-8088-babca5ff2aa7 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75753b29a78640df9622d4e2655baf9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee9d603d9cc4a8797f55d544f189720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117873) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:21:45.127331 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.policy [None req-0444f89e-28cb-4def-8088-babca5ff2aa7 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75753b29a78640df9622d4e2655baf9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee9d603d9cc4a8797f55d544f189720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117873) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:21:45.128828 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.policy [None req-0444f89e-28cb-4def-8088-babca5ff2aa7 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75753b29a78640df9622d4e2655baf9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee9d603d9cc4a8797f55d544f189720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117873) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:21:45.130025 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [None req-0444f89e-28cb-4def-8088-babca5ff2aa7 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] 10.222.0.43 "GET /compute/v2.1/servers/b357b60f-93be-4898-a651-4a407a7dc490" status: 200 len: 1728 microversion: 2.20 time: 0.164332 Jun 22 10:21:45.134098 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 383/771] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jun 22 10:21:44 2022] GET /compute/v2.1/servers/b357b60f-93be-4898-a651-4a407a7dc490 => generated 1728 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 10:21:46.149261 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-17018a1b-04b8-49e5-ae90-2a9cbeb687d2 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Calling method '>' {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:21:46.149988 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.compute.api [None req-17018a1b-04b8-49e5-ae90-2a9cbeb687d2 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] [instance: b357b60f-93be-4898-a651-4a407a7dc490] Fetching instance by UUID {{(pid=117874) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:21:46.157585 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-17018a1b-04b8-49e5-ae90-2a9cbeb687d2 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:46.158059 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-17018a1b-04b8-49e5-ae90-2a9cbeb687d2 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:46.158829 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-17018a1b-04b8-49e5-ae90-2a9cbeb687d2 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:46.159259 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-17018a1b-04b8-49e5-ae90-2a9cbeb687d2 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:46.308606 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.policy [None req-17018a1b-04b8-49e5-ae90-2a9cbeb687d2 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75753b29a78640df9622d4e2655baf9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee9d603d9cc4a8797f55d544f189720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117874) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:21:46.318196 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.policy [None req-17018a1b-04b8-49e5-ae90-2a9cbeb687d2 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75753b29a78640df9622d4e2655baf9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee9d603d9cc4a8797f55d544f189720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117874) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:21:46.320051 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.policy [None req-17018a1b-04b8-49e5-ae90-2a9cbeb687d2 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75753b29a78640df9622d4e2655baf9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee9d603d9cc4a8797f55d544f189720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117874) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:21:46.321377 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [None req-17018a1b-04b8-49e5-ae90-2a9cbeb687d2 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] 10.222.0.43 "GET /compute/v2.1/servers/b357b60f-93be-4898-a651-4a407a7dc490" status: 200 len: 1728 microversion: 2.20 time: 0.176987 Jun 22 10:21:46.322403 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 389/772] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jun 22 10:21:46 2022] GET /compute/v2.1/servers/b357b60f-93be-4898-a651-4a407a7dc490 => generated 1728 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 10:21:46.443376 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-6d20c385-a5c3-4013-8ccd-f43319a9943b tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Calling method '>' {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:21:46.443903 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.compute.api [None req-6d20c385-a5c3-4013-8ccd-f43319a9943b tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] [instance: edabe652-f189-4feb-89b8-6bc768c1669d] Fetching instance by UUID {{(pid=117873) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:21:46.449943 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-6d20c385-a5c3-4013-8ccd-f43319a9943b tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:46.450388 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-6d20c385-a5c3-4013-8ccd-f43319a9943b tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:46.451143 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-6d20c385-a5c3-4013-8ccd-f43319a9943b tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:46.452451 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-6d20c385-a5c3-4013-8ccd-f43319a9943b tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:46.476168 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [None req-6d20c385-a5c3-4013-8ccd-f43319a9943b tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] 10.222.0.43 "GET /compute/v2.1/servers/edabe652-f189-4feb-89b8-6bc768c1669d/ips" status: 200 len: 145 microversion: 2.1 time: 0.299023 Jun 22 10:21:46.477204 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 384/773] 10.222.0.43 () {58 vars in 1247 bytes} [Wed Jun 22 10:21:46 2022] GET /compute/v2.1/servers/edabe652-f189-4feb-89b8-6bc768c1669d/ips => generated 145 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 22 10:21:47.340841 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-feb24fca-b088-4ca4-8ddc-63235285cf55 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Calling method '>' {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:21:47.341436 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.compute.api [None req-feb24fca-b088-4ca4-8ddc-63235285cf55 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] [instance: b357b60f-93be-4898-a651-4a407a7dc490] Fetching instance by UUID {{(pid=117874) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:21:47.348031 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-feb24fca-b088-4ca4-8ddc-63235285cf55 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:47.348469 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-feb24fca-b088-4ca4-8ddc-63235285cf55 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:47.349217 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-feb24fca-b088-4ca4-8ddc-63235285cf55 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:47.349636 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-feb24fca-b088-4ca4-8ddc-63235285cf55 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:47.476182 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.policy [None req-feb24fca-b088-4ca4-8ddc-63235285cf55 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75753b29a78640df9622d4e2655baf9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee9d603d9cc4a8797f55d544f189720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117874) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:21:47.484932 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.policy [None req-feb24fca-b088-4ca4-8ddc-63235285cf55 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75753b29a78640df9622d4e2655baf9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee9d603d9cc4a8797f55d544f189720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117874) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:21:47.486466 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.policy [None req-feb24fca-b088-4ca4-8ddc-63235285cf55 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75753b29a78640df9622d4e2655baf9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee9d603d9cc4a8797f55d544f189720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117874) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:21:47.487608 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [None req-feb24fca-b088-4ca4-8ddc-63235285cf55 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] 10.222.0.43 "GET /compute/v2.1/servers/b357b60f-93be-4898-a651-4a407a7dc490" status: 200 len: 1728 microversion: 2.20 time: 0.150684 Jun 22 10:21:47.488167 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 390/774] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jun 22 10:21:47 2022] GET /compute/v2.1/servers/b357b60f-93be-4898-a651-4a407a7dc490 => generated 1728 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 10:21:47.799116 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-f926f0af-2815-4f93-a70c-0aa660f05fd8 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3678a4d4-6a12-4b1d-81d8-35ff956cfacf"}} {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:21:47.800181 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.compute.api [None req-f926f0af-2815-4f93-a70c-0aa660f05fd8 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] [instance: edabe652-f189-4feb-89b8-6bc768c1669d] Fetching instance by UUID {{(pid=117873) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:21:47.807116 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-f926f0af-2815-4f93-a70c-0aa660f05fd8 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:47.807559 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-f926f0af-2815-4f93-a70c-0aa660f05fd8 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:47.808315 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-f926f0af-2815-4f93-a70c-0aa660f05fd8 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:47.808728 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-f926f0af-2815-4f93-a70c-0aa660f05fd8 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:47.962098 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [req-8223f9d7-47f0-4c7b-a91f-b8369239c3e5 req-310295d8-4e0a-4f90-ac93-03332968743a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b357b60f-93be-4898-a651-4a407a7dc490", "name": "network-vif-plugged", "status": "completed", "tag": "41dc4ae0-ddcc-4582-8858-4f23e4695e4a"}]} {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:21:47.972122 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [req-8223f9d7-47f0-4c7b-a91f-b8369239c3e5 req-310295d8-4e0a-4f90-ac93-03332968743a service nova] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:47.972568 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [req-8223f9d7-47f0-4c7b-a91f-b8369239c3e5 req-310295d8-4e0a-4f90-ac93-03332968743a service nova] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:47.987355 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.compute.server_external_events [req-8223f9d7-47f0-4c7b-a91f-b8369239c3e5 req-310295d8-4e0a-4f90-ac93-03332968743a service nova] Creating event network-vif-plugged:41dc4ae0-ddcc-4582-8858-4f23e4695e4a for instance b357b60f-93be-4898-a651-4a407a7dc490 on hv-cinder-84713 Jun 22 10:21:47.992516 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [req-8223f9d7-47f0-4c7b-a91f-b8369239c3e5 req-310295d8-4e0a-4f90-ac93-03332968743a service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034293 Jun 22 10:21:47.993065 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 391/775] 10.222.0.43 () {64 vars in 1317 bytes} [Wed Jun 22 10:21:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 10:21:48.068170 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [None req-f926f0af-2815-4f93-a70c-0aa660f05fd8 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] 10.222.0.43 "POST /compute/v2.1/servers/edabe652-f189-4feb-89b8-6bc768c1669d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.273318 Jun 22 10:21:48.068785 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 385/776] 10.222.0.43 () {60 vars in 1322 bytes} [Wed Jun 22 10:21:47 2022] POST /compute/v2.1/servers/edabe652-f189-4feb-89b8-6bc768c1669d/os-volume_attachments => generated 194 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 10:21:48.506816 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-592c6542-c188-443f-a7bf-342269c8828b tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Calling method '>' {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:21:48.507529 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.compute.api [None req-592c6542-c188-443f-a7bf-342269c8828b tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] [instance: b357b60f-93be-4898-a651-4a407a7dc490] Fetching instance by UUID {{(pid=117874) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:21:48.514403 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-592c6542-c188-443f-a7bf-342269c8828b tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:48.514872 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-592c6542-c188-443f-a7bf-342269c8828b tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:48.515480 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-592c6542-c188-443f-a7bf-342269c8828b tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:48.515914 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-592c6542-c188-443f-a7bf-342269c8828b tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:48.650423 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.policy [None req-592c6542-c188-443f-a7bf-342269c8828b tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75753b29a78640df9622d4e2655baf9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee9d603d9cc4a8797f55d544f189720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117874) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:21:48.659012 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.policy [None req-592c6542-c188-443f-a7bf-342269c8828b tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75753b29a78640df9622d4e2655baf9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee9d603d9cc4a8797f55d544f189720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117874) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:21:48.660502 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.policy [None req-592c6542-c188-443f-a7bf-342269c8828b tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75753b29a78640df9622d4e2655baf9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee9d603d9cc4a8797f55d544f189720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117874) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:21:48.661635 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [None req-592c6542-c188-443f-a7bf-342269c8828b tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] 10.222.0.43 "GET /compute/v2.1/servers/b357b60f-93be-4898-a651-4a407a7dc490" status: 200 len: 1728 microversion: 2.20 time: 0.159143 Jun 22 10:21:48.662232 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 392/777] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jun 22 10:21:48 2022] GET /compute/v2.1/servers/b357b60f-93be-4898-a651-4a407a7dc490 => generated 1728 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 10:21:49.680804 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-a9b74504-c339-4f88-9f23-b53edf76033f tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Calling method '>' {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:21:49.681591 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.compute.api [None req-a9b74504-c339-4f88-9f23-b53edf76033f tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] [instance: b357b60f-93be-4898-a651-4a407a7dc490] Fetching instance by UUID {{(pid=117873) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:21:49.688818 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-a9b74504-c339-4f88-9f23-b53edf76033f tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:49.689328 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-a9b74504-c339-4f88-9f23-b53edf76033f tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:49.690180 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-a9b74504-c339-4f88-9f23-b53edf76033f tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:49.690679 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-a9b74504-c339-4f88-9f23-b53edf76033f tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:49.841082 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.policy [None req-a9b74504-c339-4f88-9f23-b53edf76033f tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75753b29a78640df9622d4e2655baf9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee9d603d9cc4a8797f55d544f189720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117873) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:21:49.850019 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.policy [None req-a9b74504-c339-4f88-9f23-b53edf76033f tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75753b29a78640df9622d4e2655baf9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee9d603d9cc4a8797f55d544f189720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117873) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:21:49.852696 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.policy [None req-a9b74504-c339-4f88-9f23-b53edf76033f tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75753b29a78640df9622d4e2655baf9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee9d603d9cc4a8797f55d544f189720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117873) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:21:49.854049 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [None req-a9b74504-c339-4f88-9f23-b53edf76033f tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] 10.222.0.43 "GET /compute/v2.1/servers/b357b60f-93be-4898-a651-4a407a7dc490" status: 200 len: 1728 microversion: 2.20 time: 0.178149 Jun 22 10:21:49.854688 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 386/778] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jun 22 10:21:49 2022] GET /compute/v2.1/servers/b357b60f-93be-4898-a651-4a407a7dc490 => generated 1728 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 10:21:50.874052 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-6494c564-1f62-4377-8704-0ef1f770702d tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Calling method '>' {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:21:50.874623 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.compute.api [None req-6494c564-1f62-4377-8704-0ef1f770702d tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] [instance: b357b60f-93be-4898-a651-4a407a7dc490] Fetching instance by UUID {{(pid=117874) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:21:50.881057 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-6494c564-1f62-4377-8704-0ef1f770702d tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:50.881504 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-6494c564-1f62-4377-8704-0ef1f770702d tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:50.882305 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-6494c564-1f62-4377-8704-0ef1f770702d tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:50.882740 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-6494c564-1f62-4377-8704-0ef1f770702d tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:50.885377 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG dbcounter [-] [117874] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=3,nova_cell1:UPDATE=6 {{(pid=117874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:21:51.035945 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.policy [None req-6494c564-1f62-4377-8704-0ef1f770702d tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75753b29a78640df9622d4e2655baf9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee9d603d9cc4a8797f55d544f189720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117874) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:21:51.044109 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.policy [None req-6494c564-1f62-4377-8704-0ef1f770702d tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75753b29a78640df9622d4e2655baf9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee9d603d9cc4a8797f55d544f189720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117874) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:21:51.045611 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.policy [None req-6494c564-1f62-4377-8704-0ef1f770702d tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75753b29a78640df9622d4e2655baf9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee9d603d9cc4a8797f55d544f189720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117874) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:21:51.046802 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [None req-6494c564-1f62-4377-8704-0ef1f770702d tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] 10.222.0.43 "GET /compute/v2.1/servers/b357b60f-93be-4898-a651-4a407a7dc490" status: 200 len: 1715 microversion: 2.20 time: 0.177198 Jun 22 10:21:51.047360 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 393/779] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jun 22 10:21:50 2022] GET /compute/v2.1/servers/b357b60f-93be-4898-a651-4a407a7dc490 => generated 1715 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 10:21:51.612518 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-304d5719-3740-4c71-b88e-c00e87db3c1a tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Calling method '>' {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:21:51.613006 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.compute.api [None req-304d5719-3740-4c71-b88e-c00e87db3c1a tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] [instance: 982a8b14-2931-49ee-bc63-124bb37fb8c4] Fetching instance by UUID {{(pid=117873) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:21:51.619583 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-304d5719-3740-4c71-b88e-c00e87db3c1a tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:51.620024 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-304d5719-3740-4c71-b88e-c00e87db3c1a tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:51.620768 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-304d5719-3740-4c71-b88e-c00e87db3c1a tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:51.621194 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-304d5719-3740-4c71-b88e-c00e87db3c1a tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:51.701035 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.objects.instance [None req-304d5719-3740-4c71-b88e-c00e87db3c1a tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Lazy-loading 'services' on Instance uuid 982a8b14-2931-49ee-bc63-124bb37fb8c4 {{(pid=117873) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 22 10:21:51.771381 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [None req-304d5719-3740-4c71-b88e-c00e87db3c1a tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] 10.222.0.43 "DELETE /compute/v2.1/servers/982a8b14-2931-49ee-bc63-124bb37fb8c4/os-volume_attachments/b60061b0-6260-49c1-9831-4f28f041a94c" status: 202 len: 0 microversion: 2.1 time: 0.162520 Jun 22 10:21:51.771970 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 387/780] 10.222.0.43 () {58 vars in 1415 bytes} [Wed Jun 22 10:21:51 2022] DELETE /compute/v2.1/servers/982a8b14-2931-49ee-bc63-124bb37fb8c4/os-volume_attachments/b60061b0-6260-49c1-9831-4f28f041a94c => generated 0 bytes in 165 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 22 10:21:51.780866 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-b53b0ea5-8bf1-4502-96a1-498f09d4dca3 tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Calling method '>' {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:21:51.781815 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.compute.api [None req-b53b0ea5-8bf1-4502-96a1-498f09d4dca3 tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] [instance: 982a8b14-2931-49ee-bc63-124bb37fb8c4] Fetching instance by UUID {{(pid=117874) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:21:51.787807 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-b53b0ea5-8bf1-4502-96a1-498f09d4dca3 tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:51.788267 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-b53b0ea5-8bf1-4502-96a1-498f09d4dca3 tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:51.789101 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-b53b0ea5-8bf1-4502-96a1-498f09d4dca3 tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:51.789527 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-b53b0ea5-8bf1-4502-96a1-498f09d4dca3 tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:51.819145 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [None req-b53b0ea5-8bf1-4502-96a1-498f09d4dca3 tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] 10.222.0.43 "GET /compute/v2.1/servers/982a8b14-2931-49ee-bc63-124bb37fb8c4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042662 Jun 22 10:21:51.819691 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 394/781] 10.222.0.43 () {58 vars in 1301 bytes} [Wed Jun 22 10:21:51 2022] GET /compute/v2.1/servers/982a8b14-2931-49ee-bc63-124bb37fb8c4/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 10:21:52.833541 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-3496ad37-6627-4e30-8251-52b828258bd7 tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Calling method '>' {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:21:52.834548 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.compute.api [None req-3496ad37-6627-4e30-8251-52b828258bd7 tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] [instance: 982a8b14-2931-49ee-bc63-124bb37fb8c4] Fetching instance by UUID {{(pid=117873) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:21:52.840843 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-3496ad37-6627-4e30-8251-52b828258bd7 tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:52.841287 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-3496ad37-6627-4e30-8251-52b828258bd7 tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:52.842078 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-3496ad37-6627-4e30-8251-52b828258bd7 tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:52.842513 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-3496ad37-6627-4e30-8251-52b828258bd7 tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:52.871861 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [None req-3496ad37-6627-4e30-8251-52b828258bd7 tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] 10.222.0.43 "GET /compute/v2.1/servers/982a8b14-2931-49ee-bc63-124bb37fb8c4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044652 Jun 22 10:21:52.872418 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 388/782] 10.222.0.43 () {58 vars in 1301 bytes} [Wed Jun 22 10:21:52 2022] GET /compute/v2.1/servers/982a8b14-2931-49ee-bc63-124bb37fb8c4/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 10:21:53.884197 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-03f2e8c1-43b3-4ce9-bc9a-b649c2fad975 tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Calling method '>' {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:21:53.885113 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.compute.api [None req-03f2e8c1-43b3-4ce9-bc9a-b649c2fad975 tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] [instance: 982a8b14-2931-49ee-bc63-124bb37fb8c4] Fetching instance by UUID {{(pid=117874) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:21:53.892020 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-03f2e8c1-43b3-4ce9-bc9a-b649c2fad975 tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:53.892460 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-03f2e8c1-43b3-4ce9-bc9a-b649c2fad975 tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:53.893205 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-03f2e8c1-43b3-4ce9-bc9a-b649c2fad975 tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:53.893631 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-03f2e8c1-43b3-4ce9-bc9a-b649c2fad975 tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:53.923960 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [None req-03f2e8c1-43b3-4ce9-bc9a-b649c2fad975 tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] 10.222.0.43 "GET /compute/v2.1/servers/982a8b14-2931-49ee-bc63-124bb37fb8c4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043688 Jun 22 10:21:53.924535 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 395/783] 10.222.0.43 () {58 vars in 1301 bytes} [Wed Jun 22 10:21:53 2022] GET /compute/v2.1/servers/982a8b14-2931-49ee-bc63-124bb37fb8c4/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 10:21:54.935553 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-87486bcb-05af-4a6a-84e1-cb65e616d9d4 tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Calling method '>' {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:21:54.936472 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.compute.api [None req-87486bcb-05af-4a6a-84e1-cb65e616d9d4 tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] [instance: 982a8b14-2931-49ee-bc63-124bb37fb8c4] Fetching instance by UUID {{(pid=117873) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:21:54.943587 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-87486bcb-05af-4a6a-84e1-cb65e616d9d4 tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:54.944036 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-87486bcb-05af-4a6a-84e1-cb65e616d9d4 tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:54.944791 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-87486bcb-05af-4a6a-84e1-cb65e616d9d4 tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:54.945226 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-87486bcb-05af-4a6a-84e1-cb65e616d9d4 tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:54.974580 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [None req-87486bcb-05af-4a6a-84e1-cb65e616d9d4 tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] 10.222.0.43 "GET /compute/v2.1/servers/982a8b14-2931-49ee-bc63-124bb37fb8c4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042949 Jun 22 10:21:54.975139 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 389/784] 10.222.0.43 () {58 vars in 1301 bytes} [Wed Jun 22 10:21:54 2022] GET /compute/v2.1/servers/982a8b14-2931-49ee-bc63-124bb37fb8c4/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 10:21:55.986897 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-7ebcb612-e2b2-4686-b135-367a49c52743 tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Calling method '>' {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:21:55.987821 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.compute.api [None req-7ebcb612-e2b2-4686-b135-367a49c52743 tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] [instance: 982a8b14-2931-49ee-bc63-124bb37fb8c4] Fetching instance by UUID {{(pid=117874) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:21:55.994364 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-7ebcb612-e2b2-4686-b135-367a49c52743 tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:55.994810 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-7ebcb612-e2b2-4686-b135-367a49c52743 tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:55.995565 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-7ebcb612-e2b2-4686-b135-367a49c52743 tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:55.996000 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-7ebcb612-e2b2-4686-b135-367a49c52743 tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:56.025435 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [None req-7ebcb612-e2b2-4686-b135-367a49c52743 tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] 10.222.0.43 "GET /compute/v2.1/servers/982a8b14-2931-49ee-bc63-124bb37fb8c4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042953 Jun 22 10:21:56.026039 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 396/785] 10.222.0.43 () {58 vars in 1301 bytes} [Wed Jun 22 10:21:55 2022] GET /compute/v2.1/servers/982a8b14-2931-49ee-bc63-124bb37fb8c4/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 10:21:57.037170 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-1fde8866-01ba-41f0-9ed0-45d0d36893b8 tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Calling method '>' {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:21:57.038013 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.compute.api [None req-1fde8866-01ba-41f0-9ed0-45d0d36893b8 tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] [instance: 982a8b14-2931-49ee-bc63-124bb37fb8c4] Fetching instance by UUID {{(pid=117873) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:21:57.044405 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-1fde8866-01ba-41f0-9ed0-45d0d36893b8 tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:57.044848 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-1fde8866-01ba-41f0-9ed0-45d0d36893b8 tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:57.045682 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-1fde8866-01ba-41f0-9ed0-45d0d36893b8 tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:57.046747 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-1fde8866-01ba-41f0-9ed0-45d0d36893b8 tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:57.079144 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [None req-1fde8866-01ba-41f0-9ed0-45d0d36893b8 tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] 10.222.0.43 "GET /compute/v2.1/servers/982a8b14-2931-49ee-bc63-124bb37fb8c4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045843 Jun 22 10:21:57.079735 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 390/786] 10.222.0.43 () {58 vars in 1301 bytes} [Wed Jun 22 10:21:57 2022] GET /compute/v2.1/servers/982a8b14-2931-49ee-bc63-124bb37fb8c4/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 10:21:57.663638 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-89c98a2d-f726-49b4-950c-edadf91c7ee0 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Calling method '>' {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:21:57.664568 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.compute.api [None req-89c98a2d-f726-49b4-950c-edadf91c7ee0 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] [instance: edabe652-f189-4feb-89b8-6bc768c1669d] Fetching instance by UUID {{(pid=117874) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:21:57.671553 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-89c98a2d-f726-49b4-950c-edadf91c7ee0 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:57.672010 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-89c98a2d-f726-49b4-950c-edadf91c7ee0 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:57.672781 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-89c98a2d-f726-49b4-950c-edadf91c7ee0 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:57.673218 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-89c98a2d-f726-49b4-950c-edadf91c7ee0 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:57.703664 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [None req-89c98a2d-f726-49b4-950c-edadf91c7ee0 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] 10.222.0.43 "GET /compute/v2.1/servers/edabe652-f189-4feb-89b8-6bc768c1669d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043849 Jun 22 10:21:57.704224 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 397/787] 10.222.0.43 () {58 vars in 1301 bytes} [Wed Jun 22 10:21:57 2022] GET /compute/v2.1/servers/edabe652-f189-4feb-89b8-6bc768c1669d/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 10:21:57.713968 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-560be750-a211-4d7a-9e99-2b6bca5c06f4 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Calling method '>' {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:21:57.714451 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.compute.api [None req-560be750-a211-4d7a-9e99-2b6bca5c06f4 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] [instance: edabe652-f189-4feb-89b8-6bc768c1669d] Fetching instance by UUID {{(pid=117873) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:21:57.720410 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-560be750-a211-4d7a-9e99-2b6bca5c06f4 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:57.720848 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-560be750-a211-4d7a-9e99-2b6bca5c06f4 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:57.721590 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-560be750-a211-4d7a-9e99-2b6bca5c06f4 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:57.722060 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-560be750-a211-4d7a-9e99-2b6bca5c06f4 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:57.750351 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [None req-560be750-a211-4d7a-9e99-2b6bca5c06f4 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] 10.222.0.43 "GET /compute/v2.1/servers/edabe652-f189-4feb-89b8-6bc768c1669d/os-volume_attachments/3678a4d4-6a12-4b1d-81d8-35ff956cfacf" status: 200 len: 194 microversion: 2.1 time: 0.040330 Jun 22 10:21:57.750910 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 391/788] 10.222.0.43 () {58 vars in 1412 bytes} [Wed Jun 22 10:21:57 2022] GET /compute/v2.1/servers/edabe652-f189-4feb-89b8-6bc768c1669d/os-volume_attachments/3678a4d4-6a12-4b1d-81d8-35ff956cfacf => generated 194 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 10:21:58.090882 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-a75aafbf-b8f0-4088-b570-1bcf37b595aa tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Calling method '>' {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:21:58.091810 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.compute.api [None req-a75aafbf-b8f0-4088-b570-1bcf37b595aa tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] [instance: 982a8b14-2931-49ee-bc63-124bb37fb8c4] Fetching instance by UUID {{(pid=117874) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:21:58.098064 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-a75aafbf-b8f0-4088-b570-1bcf37b595aa tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:58.098512 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-a75aafbf-b8f0-4088-b570-1bcf37b595aa tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:58.099274 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-a75aafbf-b8f0-4088-b570-1bcf37b595aa tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:58.099709 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-a75aafbf-b8f0-4088-b570-1bcf37b595aa tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:58.129470 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [None req-a75aafbf-b8f0-4088-b570-1bcf37b595aa tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] 10.222.0.43 "GET /compute/v2.1/servers/982a8b14-2931-49ee-bc63-124bb37fb8c4/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042459 Jun 22 10:21:58.129979 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 398/789] 10.222.0.43 () {58 vars in 1301 bytes} [Wed Jun 22 10:21:58 2022] GET /compute/v2.1/servers/982a8b14-2931-49ee-bc63-124bb37fb8c4/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 22 10:21:58.188247 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-249d36b2-daf3-40fd-b87f-e6a6444aab0a tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Calling method '>' {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:21:58.188742 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.compute.api [None req-249d36b2-daf3-40fd-b87f-e6a6444aab0a tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] [instance: 982a8b14-2931-49ee-bc63-124bb37fb8c4] Fetching instance by UUID {{(pid=117873) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:21:58.195304 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-249d36b2-daf3-40fd-b87f-e6a6444aab0a tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:58.195751 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-249d36b2-daf3-40fd-b87f-e6a6444aab0a tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:58.196545 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-249d36b2-daf3-40fd-b87f-e6a6444aab0a tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:58.196967 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-249d36b2-daf3-40fd-b87f-e6a6444aab0a tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:58.222338 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.compute.api [None req-249d36b2-daf3-40fd-b87f-e6a6444aab0a tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] [instance: 982a8b14-2931-49ee-bc63-124bb37fb8c4] Going to try to terminate instance {{(pid=117873) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 22 10:21:58.298715 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [None req-249d36b2-daf3-40fd-b87f-e6a6444aab0a tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] 10.222.0.43 "DELETE /compute/v2.1/servers/982a8b14-2931-49ee-bc63-124bb37fb8c4" status: 204 len: 0 microversion: 2.1 time: 0.114787 Jun 22 10:21:58.300528 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 392/790] 10.222.0.43 () {58 vars in 1238 bytes} [Wed Jun 22 10:21:58 2022] DELETE /compute/v2.1/servers/982a8b14-2931-49ee-bc63-124bb37fb8c4 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 22 10:21:58.308779 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-940a237e-9c6c-4b0b-ae85-b49d6a35de9d tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Calling method '>' {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:21:58.309496 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.compute.api [None req-940a237e-9c6c-4b0b-ae85-b49d6a35de9d tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] [instance: 982a8b14-2931-49ee-bc63-124bb37fb8c4] Fetching instance by UUID {{(pid=117874) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:21:58.316611 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-940a237e-9c6c-4b0b-ae85-b49d6a35de9d tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:58.317075 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-940a237e-9c6c-4b0b-ae85-b49d6a35de9d tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:58.317894 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-940a237e-9c6c-4b0b-ae85-b49d6a35de9d tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:58.318326 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-940a237e-9c6c-4b0b-ae85-b49d6a35de9d tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:58.450550 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.policy [None req-940a237e-9c6c-4b0b-ae85-b49d6a35de9d tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7be3d844dcee4d19966fc7944463a0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78629282e2b74418a2c1cdac32576ef1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117874) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:21:58.460194 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [None req-940a237e-9c6c-4b0b-ae85-b49d6a35de9d tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] 10.222.0.43 "GET /compute/v2.1/servers/982a8b14-2931-49ee-bc63-124bb37fb8c4" status: 200 len: 1683 microversion: 2.1 time: 0.155447 Jun 22 10:21:58.460774 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 399/791] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:21:58 2022] GET /compute/v2.1/servers/982a8b14-2931-49ee-bc63-124bb37fb8c4 => generated 1683 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:21:59.061450 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-4fb44c9a-f61d-42e9-abdb-f1b4468d6912 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c431b32e-a9b5-4833-991a-ed8162090bbf"}} {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:21:59.062846 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.compute.api [None req-4fb44c9a-f61d-42e9-abdb-f1b4468d6912 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] [instance: edabe652-f189-4feb-89b8-6bc768c1669d] Fetching instance by UUID {{(pid=117873) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:21:59.071430 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-4fb44c9a-f61d-42e9-abdb-f1b4468d6912 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:59.072108 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-4fb44c9a-f61d-42e9-abdb-f1b4468d6912 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:59.073240 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-4fb44c9a-f61d-42e9-abdb-f1b4468d6912 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:59.073912 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-4fb44c9a-f61d-42e9-abdb-f1b4468d6912 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:59.478780 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-cd4db943-75ee-4292-9128-49a85239c38c tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Calling method '>' {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:21:59.479389 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.compute.api [None req-cd4db943-75ee-4292-9128-49a85239c38c tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] [instance: 982a8b14-2931-49ee-bc63-124bb37fb8c4] Fetching instance by UUID {{(pid=117874) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:21:59.487021 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-cd4db943-75ee-4292-9128-49a85239c38c tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:59.487460 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-cd4db943-75ee-4292-9128-49a85239c38c tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:59.488208 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-cd4db943-75ee-4292-9128-49a85239c38c tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:59.488631 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-cd4db943-75ee-4292-9128-49a85239c38c tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:59.627170 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.policy [None req-cd4db943-75ee-4292-9128-49a85239c38c tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7be3d844dcee4d19966fc7944463a0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78629282e2b74418a2c1cdac32576ef1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117874) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:21:59.635814 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [None req-cd4db943-75ee-4292-9128-49a85239c38c tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] 10.222.0.43 "GET /compute/v2.1/servers/982a8b14-2931-49ee-bc63-124bb37fb8c4" status: 200 len: 1683 microversion: 2.1 time: 0.161098 Jun 22 10:21:59.636713 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 400/792] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:21:59 2022] GET /compute/v2.1/servers/982a8b14-2931-49ee-bc63-124bb37fb8c4 => generated 1683 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 10:21:59.689387 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [None req-4fb44c9a-f61d-42e9-abdb-f1b4468d6912 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] 10.222.0.43 "POST /compute/v2.1/servers/edabe652-f189-4feb-89b8-6bc768c1669d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.632061 Jun 22 10:21:59.690049 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 393/793] 10.222.0.43 () {60 vars in 1322 bytes} [Wed Jun 22 10:21:59 2022] POST /compute/v2.1/servers/edabe652-f189-4feb-89b8-6bc768c1669d/os-volume_attachments => generated 194 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 10:22:00.654351 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-7eeb415e-3439-4c90-a7ec-6cc23772b04e tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Calling method '>' {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:22:00.654993 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.compute.api [None req-7eeb415e-3439-4c90-a7ec-6cc23772b04e tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] [instance: 982a8b14-2931-49ee-bc63-124bb37fb8c4] Fetching instance by UUID {{(pid=117874) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:22:00.657397 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG dbcounter [-] [117874] Writing DB stats nova_api:SELECT=38 {{(pid=117874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:22:00.674001 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-7eeb415e-3439-4c90-a7ec-6cc23772b04e tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:22:00.674445 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-7eeb415e-3439-4c90-a7ec-6cc23772b04e tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:22:00.675215 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-7eeb415e-3439-4c90-a7ec-6cc23772b04e tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:22:00.675641 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-7eeb415e-3439-4c90-a7ec-6cc23772b04e tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:22:00.752846 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.policy [None req-7eeb415e-3439-4c90-a7ec-6cc23772b04e tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7be3d844dcee4d19966fc7944463a0bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78629282e2b74418a2c1cdac32576ef1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117874) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:22:00.766208 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [None req-7eeb415e-3439-4c90-a7ec-6cc23772b04e tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] 10.222.0.43 "GET /compute/v2.1/servers/982a8b14-2931-49ee-bc63-124bb37fb8c4" status: 200 len: 1615 microversion: 2.1 time: 0.115552 Jun 22 10:22:00.777221 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 401/794] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:22:00 2022] GET /compute/v2.1/servers/982a8b14-2931-49ee-bc63-124bb37fb8c4 => generated 1615 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:22:00.816873 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [req-10d28d97-77df-453d-a55c-8f587c214e96 req-8b53a188-0cfc-4f37-81dc-6d610fe91012 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "982a8b14-2931-49ee-bc63-124bb37fb8c4", "name": "network-vif-deleted", "tag": "14658931-09ac-4ec1-9e21-53442e71aacc"}]} {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:22:00.827830 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [req-10d28d97-77df-453d-a55c-8f587c214e96 req-8b53a188-0cfc-4f37-81dc-6d610fe91012 service nova] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:22:00.828620 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [req-10d28d97-77df-453d-a55c-8f587c214e96 req-8b53a188-0cfc-4f37-81dc-6d610fe91012 service nova] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:22:00.841772 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.compute.server_external_events [req-10d28d97-77df-453d-a55c-8f587c214e96 req-8b53a188-0cfc-4f37-81dc-6d610fe91012 service nova] Creating event network-vif-deleted:14658931-09ac-4ec1-9e21-53442e71aacc for instance 982a8b14-2931-49ee-bc63-124bb37fb8c4 on hv-cinder-84713 Jun 22 10:22:00.847380 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [req-10d28d97-77df-453d-a55c-8f587c214e96 req-8b53a188-0cfc-4f37-81dc-6d610fe91012 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.138807 Jun 22 10:22:00.848242 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 394/795] 10.222.0.43 () {64 vars in 1317 bytes} [Wed Jun 22 10:22:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 10:22:01.785934 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-f4fe2e45-b33b-41c9-a65a-9b1e6216b1d1 tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Calling method '>' {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:22:01.786664 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.compute.api [None req-f4fe2e45-b33b-41c9-a65a-9b1e6216b1d1 tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] [instance: 982a8b14-2931-49ee-bc63-124bb37fb8c4] Fetching instance by UUID {{(pid=117874) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:22:01.795640 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-f4fe2e45-b33b-41c9-a65a-9b1e6216b1d1 tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:22:01.796618 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-f4fe2e45-b33b-41c9-a65a-9b1e6216b1d1 tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:22:01.797424 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-f4fe2e45-b33b-41c9-a65a-9b1e6216b1d1 tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:22:01.797821 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-f4fe2e45-b33b-41c9-a65a-9b1e6216b1d1 tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:22:01.812471 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.wsgi [None req-f4fe2e45-b33b-41c9-a65a-9b1e6216b1d1 tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] HTTP exception thrown: Instance 982a8b14-2931-49ee-bc63-124bb37fb8c4 could not be found. Jun 22 10:22:01.814069 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-f4fe2e45-b33b-41c9-a65a-9b1e6216b1d1 tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Request method failure captured: Jun 22 10:22:01.814069 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: request: GET /compute/v2.1/servers/982a8b14-2931-49ee-bc63-124bb37fb8c4 HTTP/1.1 Jun 22 10:22:01.814069 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: Accept: application/json Jun 22 10:22:01.814069 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: Accept-Encoding: identity Jun 22 10:22:01.814069 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: Connection: close Jun 22 10:22:01.814069 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: Content-Length: 0 Jun 22 10:22:01.814069 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: Content-Type: application/json Jun 22 10:22:01.814069 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: Host: 10.222.0.43 Jun 22 10:22:01.814069 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: Openstack-System-Scope: None Jun 22 10:22:01.814069 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: User-Agent: python-urllib3/1.26.9 Jun 22 10:22:01.814069 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-Auth-Token: gAAAAABisuvUpGkoSsQ9d1KNFPX834O5Ed4reiDCWeVnTPicJ3T1CXVLNJjI8u1aloRBXjMgN_RPq4rTUmL5P2islljUOvvHIwLebG3DYtPiBpBpjPn3C8o_VLQB3yNvqrLTJBaPVXC7QVZTOTIWPKqjtW_CrQ0ZdCwS1UGZXZ6Doixu1TJW9Cg Jun 22 10:22:01.814069 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-Domain-Id: None Jun 22 10:22:01.814069 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-Domain-Name: None Jun 22 10:22:01.814069 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-Identity-Status: Confirmed Jun 22 10:22:01.814069 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-Is-Admin-Project: True Jun 22 10:22:01.814069 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-Project-Domain-Id: default Jun 22 10:22:01.814069 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-Project-Domain-Name: Default Jun 22 10:22:01.814069 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-Project-Id: 78629282e2b74418a2c1cdac32576ef1 Jun 22 10:22:01.814069 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-Project-Name: tempest-AttachVolumeNegativeTest-73508829 Jun 22 10:22:01.814069 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-Role: reader,member Jun 22 10:22:01.814069 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-Roles: reader,member Jun 22 10:22:01.815682 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/78629282e2b74418a2c1cdac32576ef1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/78629282e2b74418a2c1cdac32576ef1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_78629282e2b74418a2c1cdac32576ef1", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/78629282e2b74418a2c1cdac32576ef1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}] Jun 22 10:22:01.815682 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-Tenant: tempest-AttachVolumeNegativeTest-73508829 Jun 22 10:22:01.815682 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-Tenant-Id: 78629282e2b74418a2c1cdac32576ef1 Jun 22 10:22:01.815682 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-73508829 Jun 22 10:22:01.815682 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-User: tempest-AttachVolumeNegativeTest-73508829-project Jun 22 10:22:01.815682 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-User-Domain-Id: default Jun 22 10:22:01.815682 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-User-Domain-Name: Default Jun 22 10:22:01.815682 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-User-Id: 7be3d844dcee4d19966fc7944463a0bc Jun 22 10:22:01.815682 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-User-Name: tempest-AttachVolumeNegativeTest-73508829-project Jun 22 10:22:01.815682 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: method: > Jun 22 10:22:01.815682 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: exception: Instance 982a8b14-2931-49ee-bc63-124bb37fb8c4 could not be found. Jun 22 10:22:01.815682 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: action_args: {'id': '982a8b14-2931-49ee-bc63-124bb37fb8c4'} Jun 22 10:22:01.816568 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 10:22:01.816568 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:22:01.816568 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 22 10:22:01.816568 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 22 10:22:01.816568 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 22 10:22:01.816568 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 22 10:22:01.816568 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 22 10:22:01.816568 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 22 10:22:01.816568 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 22 10:22:01.816568 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 22 10:22:01.816568 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 982a8b14-2931-49ee-bc63-124bb37fb8c4 could not be found. Jun 22 10:22:01.816568 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi Jun 22 10:22:01.816568 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 10:22:01.816568 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi Jun 22 10:22:01.816568 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:22:01.816568 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 10:22:01.816568 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 10:22:01.816568 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 10:22:01.816568 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 10:22:01.816568 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 10:22:01.818080 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 10:22:01.818080 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 22 10:22:01.818080 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 22 10:22:01.818080 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 22 10:22:01.818080 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 22 10:22:01.818080 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 22 10:22:01.818080 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 22 10:22:01.818080 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 982a8b14-2931-49ee-bc63-124bb37fb8c4 could not be found. Jun 22 10:22:01.818080 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi Jun 22 10:22:01.818080 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 10:22:01.818080 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi Jun 22 10:22:01.818080 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:22:01.818080 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 10:22:01.818080 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 10:22:01.818080 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 10:22:01.818080 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 10:22:01.818080 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 982a8b14-2931-49ee-bc63-124bb37fb8c4 could not be found. Jun 22 10:22:01.818080 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi Jun 22 10:22:01.819275 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-f4fe2e45-b33b-41c9-a65a-9b1e6216b1d1 tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Returning 404 to user: Instance 982a8b14-2931-49ee-bc63-124bb37fb8c4 could not be found. {{(pid=117874) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 10:22:01.819275 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [None req-f4fe2e45-b33b-41c9-a65a-9b1e6216b1d1 tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] 10.222.0.43 "GET /compute/v2.1/servers/982a8b14-2931-49ee-bc63-124bb37fb8c4" status: 404 len: 111 microversion: 2.1 time: 0.035275 Jun 22 10:22:01.819275 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 402/796] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:22:01 2022] GET /compute/v2.1/servers/982a8b14-2931-49ee-bc63-124bb37fb8c4 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 22 10:22:01.829058 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-113f970b-225c-49e2-912c-9df790913e98 tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Calling method '.version_select at 0x7f36be3dea60>' {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:22:01.849577 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [None req-113f970b-225c-49e2-912c-9df790913e98 tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] 10.222.0.43 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1678991820" status: 202 len: 0 microversion: 2.1 time: 0.025714 Jun 22 10:22:01.850229 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 395/797] 10.222.0.43 () {58 vars in 1220 bytes} [Wed Jun 22 10:22:01 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1678991820 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 22 10:22:03.608988 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-0eff97a1-c240-41a5-9614-17729b453acc tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Calling method '>' {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:22:03.609537 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.compute.api [None req-0eff97a1-c240-41a5-9614-17729b453acc tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] [instance: 982a8b14-2931-49ee-bc63-124bb37fb8c4] Fetching instance by UUID {{(pid=117874) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:22:03.616020 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-0eff97a1-c240-41a5-9614-17729b453acc tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:22:03.616461 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-0eff97a1-c240-41a5-9614-17729b453acc tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:22:03.617204 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-0eff97a1-c240-41a5-9614-17729b453acc tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:22:03.617630 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-0eff97a1-c240-41a5-9614-17729b453acc tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:22:03.632539 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.wsgi [None req-0eff97a1-c240-41a5-9614-17729b453acc tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] HTTP exception thrown: Instance 982a8b14-2931-49ee-bc63-124bb37fb8c4 could not be found. Jun 22 10:22:03.634071 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-0eff97a1-c240-41a5-9614-17729b453acc tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Request method failure captured: Jun 22 10:22:03.634071 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: request: DELETE /compute/v2.1/servers/982a8b14-2931-49ee-bc63-124bb37fb8c4 HTTP/1.1 Jun 22 10:22:03.634071 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: Accept: application/json Jun 22 10:22:03.634071 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: Accept-Encoding: identity Jun 22 10:22:03.634071 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: Connection: close Jun 22 10:22:03.634071 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: Content-Length: 0 Jun 22 10:22:03.634071 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: Content-Type: application/json Jun 22 10:22:03.634071 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: Host: 10.222.0.43 Jun 22 10:22:03.634071 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: Openstack-System-Scope: None Jun 22 10:22:03.634071 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: User-Agent: python-urllib3/1.26.9 Jun 22 10:22:03.634071 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-Auth-Token: gAAAAABisuvUpGkoSsQ9d1KNFPX834O5Ed4reiDCWeVnTPicJ3T1CXVLNJjI8u1aloRBXjMgN_RPq4rTUmL5P2islljUOvvHIwLebG3DYtPiBpBpjPn3C8o_VLQB3yNvqrLTJBaPVXC7QVZTOTIWPKqjtW_CrQ0ZdCwS1UGZXZ6Doixu1TJW9Cg Jun 22 10:22:03.634071 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-Domain-Id: None Jun 22 10:22:03.634071 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-Domain-Name: None Jun 22 10:22:03.634071 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-Identity-Status: Confirmed Jun 22 10:22:03.634071 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-Is-Admin-Project: True Jun 22 10:22:03.634071 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-Project-Domain-Id: default Jun 22 10:22:03.634071 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-Project-Domain-Name: Default Jun 22 10:22:03.634071 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-Project-Id: 78629282e2b74418a2c1cdac32576ef1 Jun 22 10:22:03.634071 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-Project-Name: tempest-AttachVolumeNegativeTest-73508829 Jun 22 10:22:03.634071 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-Role: reader,member Jun 22 10:22:03.634071 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-Roles: reader,member Jun 22 10:22:03.635578 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/78629282e2b74418a2c1cdac32576ef1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/78629282e2b74418a2c1cdac32576ef1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_78629282e2b74418a2c1cdac32576ef1", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/78629282e2b74418a2c1cdac32576ef1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}] Jun 22 10:22:03.635578 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-Tenant: tempest-AttachVolumeNegativeTest-73508829 Jun 22 10:22:03.635578 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-Tenant-Id: 78629282e2b74418a2c1cdac32576ef1 Jun 22 10:22:03.635578 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-73508829 Jun 22 10:22:03.635578 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-User: tempest-AttachVolumeNegativeTest-73508829-project Jun 22 10:22:03.635578 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-User-Domain-Id: default Jun 22 10:22:03.635578 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-User-Domain-Name: Default Jun 22 10:22:03.635578 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-User-Id: 7be3d844dcee4d19966fc7944463a0bc Jun 22 10:22:03.635578 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-User-Name: tempest-AttachVolumeNegativeTest-73508829-project Jun 22 10:22:03.635578 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: method: > Jun 22 10:22:03.635578 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: exception: Instance 982a8b14-2931-49ee-bc63-124bb37fb8c4 could not be found. Jun 22 10:22:03.635578 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: action_args: {'id': '982a8b14-2931-49ee-bc63-124bb37fb8c4'} Jun 22 10:22:03.636393 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 10:22:03.636393 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:22:03.636393 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 22 10:22:03.636393 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 22 10:22:03.636393 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 22 10:22:03.636393 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 22 10:22:03.636393 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 22 10:22:03.636393 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 22 10:22:03.636393 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 22 10:22:03.636393 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 22 10:22:03.636393 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 982a8b14-2931-49ee-bc63-124bb37fb8c4 could not be found. Jun 22 10:22:03.636393 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi Jun 22 10:22:03.636393 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 10:22:03.636393 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi Jun 22 10:22:03.636393 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:22:03.636393 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 10:22:03.636393 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 10:22:03.636393 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 10:22:03.636393 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 10:22:03.636393 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 10:22:03.637874 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 10:22:03.637874 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 22 10:22:03.637874 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 22 10:22:03.637874 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 22 10:22:03.637874 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 22 10:22:03.637874 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 22 10:22:03.637874 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 22 10:22:03.637874 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 22 10:22:03.637874 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 22 10:22:03.637874 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 982a8b14-2931-49ee-bc63-124bb37fb8c4 could not be found. Jun 22 10:22:03.637874 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi Jun 22 10:22:03.637874 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 10:22:03.637874 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi Jun 22 10:22:03.637874 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:22:03.637874 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 10:22:03.637874 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 10:22:03.637874 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 10:22:03.637874 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 10:22:03.637874 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 982a8b14-2931-49ee-bc63-124bb37fb8c4 could not be found. Jun 22 10:22:03.637874 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi Jun 22 10:22:03.639330 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-0eff97a1-c240-41a5-9614-17729b453acc tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Returning 404 to user: Instance 982a8b14-2931-49ee-bc63-124bb37fb8c4 could not be found. {{(pid=117874) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 10:22:03.639330 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [None req-0eff97a1-c240-41a5-9614-17729b453acc tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] 10.222.0.43 "DELETE /compute/v2.1/servers/982a8b14-2931-49ee-bc63-124bb37fb8c4" status: 404 len: 111 microversion: 2.1 time: 0.031037 Jun 22 10:22:03.639330 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 403/798] 10.222.0.43 () {58 vars in 1238 bytes} [Wed Jun 22 10:22:03 2022] DELETE /compute/v2.1/servers/982a8b14-2931-49ee-bc63-124bb37fb8c4 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 22 10:22:03.644620 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-94a1488c-9bc7-4116-9c9b-6c391ea37f3e tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Calling method '>' {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:22:03.645430 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.compute.api [None req-94a1488c-9bc7-4116-9c9b-6c391ea37f3e tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] [instance: 982a8b14-2931-49ee-bc63-124bb37fb8c4] Fetching instance by UUID {{(pid=117873) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:22:03.652038 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-94a1488c-9bc7-4116-9c9b-6c391ea37f3e tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:22:03.652474 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-94a1488c-9bc7-4116-9c9b-6c391ea37f3e tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:22:03.653217 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-94a1488c-9bc7-4116-9c9b-6c391ea37f3e tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:22:03.653642 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-94a1488c-9bc7-4116-9c9b-6c391ea37f3e tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:22:03.666834 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.wsgi [None req-94a1488c-9bc7-4116-9c9b-6c391ea37f3e tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] HTTP exception thrown: Instance 982a8b14-2931-49ee-bc63-124bb37fb8c4 could not be found. Jun 22 10:22:03.668394 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-94a1488c-9bc7-4116-9c9b-6c391ea37f3e tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Request method failure captured: Jun 22 10:22:03.668394 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: request: GET /compute/v2.1/servers/982a8b14-2931-49ee-bc63-124bb37fb8c4 HTTP/1.1 Jun 22 10:22:03.668394 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: Accept: application/json Jun 22 10:22:03.668394 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: Accept-Encoding: identity Jun 22 10:22:03.668394 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: Connection: close Jun 22 10:22:03.668394 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: Content-Length: 0 Jun 22 10:22:03.668394 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: Content-Type: application/json Jun 22 10:22:03.668394 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: Host: 10.222.0.43 Jun 22 10:22:03.668394 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: Openstack-System-Scope: None Jun 22 10:22:03.668394 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: User-Agent: python-urllib3/1.26.9 Jun 22 10:22:03.668394 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-Auth-Token: gAAAAABisuvUpGkoSsQ9d1KNFPX834O5Ed4reiDCWeVnTPicJ3T1CXVLNJjI8u1aloRBXjMgN_RPq4rTUmL5P2islljUOvvHIwLebG3DYtPiBpBpjPn3C8o_VLQB3yNvqrLTJBaPVXC7QVZTOTIWPKqjtW_CrQ0ZdCwS1UGZXZ6Doixu1TJW9Cg Jun 22 10:22:03.668394 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-Domain-Id: None Jun 22 10:22:03.668394 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-Domain-Name: None Jun 22 10:22:03.668394 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-Identity-Status: Confirmed Jun 22 10:22:03.668394 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-Is-Admin-Project: True Jun 22 10:22:03.668394 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-Project-Domain-Id: default Jun 22 10:22:03.668394 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-Project-Domain-Name: Default Jun 22 10:22:03.668394 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-Project-Id: 78629282e2b74418a2c1cdac32576ef1 Jun 22 10:22:03.668394 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-Project-Name: tempest-AttachVolumeNegativeTest-73508829 Jun 22 10:22:03.668394 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-Role: reader,member Jun 22 10:22:03.668394 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-Roles: reader,member Jun 22 10:22:03.669959 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/78629282e2b74418a2c1cdac32576ef1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/78629282e2b74418a2c1cdac32576ef1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_78629282e2b74418a2c1cdac32576ef1", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/78629282e2b74418a2c1cdac32576ef1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}] Jun 22 10:22:03.669959 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-Tenant: tempest-AttachVolumeNegativeTest-73508829 Jun 22 10:22:03.669959 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-Tenant-Id: 78629282e2b74418a2c1cdac32576ef1 Jun 22 10:22:03.669959 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-73508829 Jun 22 10:22:03.669959 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-User: tempest-AttachVolumeNegativeTest-73508829-project Jun 22 10:22:03.669959 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-User-Domain-Id: default Jun 22 10:22:03.669959 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-User-Domain-Name: Default Jun 22 10:22:03.669959 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-User-Id: 7be3d844dcee4d19966fc7944463a0bc Jun 22 10:22:03.669959 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-User-Name: tempest-AttachVolumeNegativeTest-73508829-project Jun 22 10:22:03.669959 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: method: > Jun 22 10:22:03.669959 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: exception: Instance 982a8b14-2931-49ee-bc63-124bb37fb8c4 could not be found. Jun 22 10:22:03.669959 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: action_args: {'id': '982a8b14-2931-49ee-bc63-124bb37fb8c4'} Jun 22 10:22:03.671638 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 10:22:03.671638 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:22:03.671638 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 22 10:22:03.671638 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 22 10:22:03.671638 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 22 10:22:03.671638 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 22 10:22:03.671638 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 22 10:22:03.671638 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 22 10:22:03.671638 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 22 10:22:03.671638 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 22 10:22:03.671638 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 982a8b14-2931-49ee-bc63-124bb37fb8c4 could not be found. Jun 22 10:22:03.671638 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi Jun 22 10:22:03.671638 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 10:22:03.671638 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi Jun 22 10:22:03.671638 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:22:03.671638 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 10:22:03.671638 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 10:22:03.671638 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 10:22:03.671638 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 10:22:03.671638 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 10:22:03.673061 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 10:22:03.673061 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 22 10:22:03.673061 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 22 10:22:03.673061 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 22 10:22:03.673061 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 22 10:22:03.673061 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 22 10:22:03.673061 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 22 10:22:03.673061 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 982a8b14-2931-49ee-bc63-124bb37fb8c4 could not be found. Jun 22 10:22:03.673061 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi Jun 22 10:22:03.673061 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 10:22:03.673061 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi Jun 22 10:22:03.673061 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:22:03.673061 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 10:22:03.673061 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 10:22:03.673061 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 10:22:03.673061 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 10:22:03.673061 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 982a8b14-2931-49ee-bc63-124bb37fb8c4 could not be found. Jun 22 10:22:03.673061 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi Jun 22 10:22:03.674337 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-94a1488c-9bc7-4116-9c9b-6c391ea37f3e tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Returning 404 to user: Instance 982a8b14-2931-49ee-bc63-124bb37fb8c4 could not be found. {{(pid=117873) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 10:22:03.674337 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [None req-94a1488c-9bc7-4116-9c9b-6c391ea37f3e tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] 10.222.0.43 "GET /compute/v2.1/servers/982a8b14-2931-49ee-bc63-124bb37fb8c4" status: 404 len: 111 microversion: 2.1 time: 0.029577 Jun 22 10:22:03.674337 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 396/799] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:22:03 2022] GET /compute/v2.1/servers/982a8b14-2931-49ee-bc63-124bb37fb8c4 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 22 10:22:04.801561 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-22a3702f-ab48-4932-aa79-129102f8af8c tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Calling method '>' {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:22:04.802099 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.compute.api [None req-22a3702f-ab48-4932-aa79-129102f8af8c tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] [instance: a5d1635b-71e2-4f7c-9fcc-b6d2e9803c09] Fetching instance by UUID {{(pid=117874) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:22:04.808524 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-22a3702f-ab48-4932-aa79-129102f8af8c tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:22:04.808973 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-22a3702f-ab48-4932-aa79-129102f8af8c tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:22:04.809780 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-22a3702f-ab48-4932-aa79-129102f8af8c tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:22:04.810293 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-22a3702f-ab48-4932-aa79-129102f8af8c tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:22:04.823905 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.wsgi [None req-22a3702f-ab48-4932-aa79-129102f8af8c tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] HTTP exception thrown: Instance a5d1635b-71e2-4f7c-9fcc-b6d2e9803c09 could not be found. Jun 22 10:22:04.825421 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-22a3702f-ab48-4932-aa79-129102f8af8c tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Request method failure captured: Jun 22 10:22:04.825421 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: request: DELETE /compute/v2.1/servers/a5d1635b-71e2-4f7c-9fcc-b6d2e9803c09 HTTP/1.1 Jun 22 10:22:04.825421 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: Accept: application/json Jun 22 10:22:04.825421 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: Accept-Encoding: identity Jun 22 10:22:04.825421 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: Connection: close Jun 22 10:22:04.825421 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: Content-Length: 0 Jun 22 10:22:04.825421 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: Content-Type: application/json Jun 22 10:22:04.825421 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: Host: 10.222.0.43 Jun 22 10:22:04.825421 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: Openstack-System-Scope: None Jun 22 10:22:04.825421 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: User-Agent: python-urllib3/1.26.9 Jun 22 10:22:04.825421 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-Auth-Token: gAAAAABisuvUpGkoSsQ9d1KNFPX834O5Ed4reiDCWeVnTPicJ3T1CXVLNJjI8u1aloRBXjMgN_RPq4rTUmL5P2islljUOvvHIwLebG3DYtPiBpBpjPn3C8o_VLQB3yNvqrLTJBaPVXC7QVZTOTIWPKqjtW_CrQ0ZdCwS1UGZXZ6Doixu1TJW9Cg Jun 22 10:22:04.825421 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-Domain-Id: None Jun 22 10:22:04.825421 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-Domain-Name: None Jun 22 10:22:04.825421 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-Identity-Status: Confirmed Jun 22 10:22:04.825421 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-Is-Admin-Project: True Jun 22 10:22:04.825421 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-Project-Domain-Id: default Jun 22 10:22:04.825421 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-Project-Domain-Name: Default Jun 22 10:22:04.825421 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-Project-Id: 78629282e2b74418a2c1cdac32576ef1 Jun 22 10:22:04.825421 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-Project-Name: tempest-AttachVolumeNegativeTest-73508829 Jun 22 10:22:04.825421 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-Role: reader,member Jun 22 10:22:04.825421 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-Roles: reader,member Jun 22 10:22:04.827389 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/78629282e2b74418a2c1cdac32576ef1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/78629282e2b74418a2c1cdac32576ef1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_78629282e2b74418a2c1cdac32576ef1", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/78629282e2b74418a2c1cdac32576ef1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}] Jun 22 10:22:04.827389 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-Tenant: tempest-AttachVolumeNegativeTest-73508829 Jun 22 10:22:04.827389 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-Tenant-Id: 78629282e2b74418a2c1cdac32576ef1 Jun 22 10:22:04.827389 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-73508829 Jun 22 10:22:04.827389 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-User: tempest-AttachVolumeNegativeTest-73508829-project Jun 22 10:22:04.827389 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-User-Domain-Id: default Jun 22 10:22:04.827389 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-User-Domain-Name: Default Jun 22 10:22:04.827389 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-User-Id: 7be3d844dcee4d19966fc7944463a0bc Jun 22 10:22:04.827389 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-User-Name: tempest-AttachVolumeNegativeTest-73508829-project Jun 22 10:22:04.827389 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: method: > Jun 22 10:22:04.827389 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: exception: Instance a5d1635b-71e2-4f7c-9fcc-b6d2e9803c09 could not be found. Jun 22 10:22:04.827389 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: action_args: {'id': 'a5d1635b-71e2-4f7c-9fcc-b6d2e9803c09'} Jun 22 10:22:04.828331 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 10:22:04.828331 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:22:04.828331 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 22 10:22:04.828331 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 22 10:22:04.828331 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 22 10:22:04.828331 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 22 10:22:04.828331 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 22 10:22:04.828331 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 22 10:22:04.828331 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 22 10:22:04.828331 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 22 10:22:04.828331 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a5d1635b-71e2-4f7c-9fcc-b6d2e9803c09 could not be found. Jun 22 10:22:04.828331 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi Jun 22 10:22:04.828331 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 10:22:04.828331 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi Jun 22 10:22:04.828331 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:22:04.828331 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 10:22:04.828331 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 10:22:04.828331 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 10:22:04.828331 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 10:22:04.828331 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 10:22:04.829774 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 10:22:04.829774 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 22 10:22:04.829774 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 22 10:22:04.829774 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 22 10:22:04.829774 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 22 10:22:04.829774 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 22 10:22:04.829774 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 22 10:22:04.829774 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 22 10:22:04.829774 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 22 10:22:04.829774 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a5d1635b-71e2-4f7c-9fcc-b6d2e9803c09 could not be found. Jun 22 10:22:04.829774 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi Jun 22 10:22:04.829774 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 10:22:04.829774 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi Jun 22 10:22:04.829774 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:22:04.829774 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 10:22:04.829774 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 10:22:04.829774 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 10:22:04.829774 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 10:22:04.829774 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a5d1635b-71e2-4f7c-9fcc-b6d2e9803c09 could not be found. Jun 22 10:22:04.829774 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi Jun 22 10:22:04.831260 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-22a3702f-ab48-4932-aa79-129102f8af8c tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Returning 404 to user: Instance a5d1635b-71e2-4f7c-9fcc-b6d2e9803c09 could not be found. {{(pid=117874) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 10:22:04.831260 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [None req-22a3702f-ab48-4932-aa79-129102f8af8c tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] 10.222.0.43 "DELETE /compute/v2.1/servers/a5d1635b-71e2-4f7c-9fcc-b6d2e9803c09" status: 404 len: 111 microversion: 2.1 time: 0.029083 Jun 22 10:22:04.831260 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 404/800] 10.222.0.43 () {58 vars in 1238 bytes} [Wed Jun 22 10:22:04 2022] DELETE /compute/v2.1/servers/a5d1635b-71e2-4f7c-9fcc-b6d2e9803c09 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 22 10:22:04.835401 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-42704f51-fc34-4d0b-aad2-49506ee55b8d tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Calling method '>' {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:22:04.836010 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.compute.api [None req-42704f51-fc34-4d0b-aad2-49506ee55b8d tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] [instance: a5d1635b-71e2-4f7c-9fcc-b6d2e9803c09] Fetching instance by UUID {{(pid=117873) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:22:04.842439 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-42704f51-fc34-4d0b-aad2-49506ee55b8d tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:22:04.843208 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-42704f51-fc34-4d0b-aad2-49506ee55b8d tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:22:04.843915 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-42704f51-fc34-4d0b-aad2-49506ee55b8d tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:22:04.844380 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-42704f51-fc34-4d0b-aad2-49506ee55b8d tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:22:04.858091 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.wsgi [None req-42704f51-fc34-4d0b-aad2-49506ee55b8d tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] HTTP exception thrown: Instance a5d1635b-71e2-4f7c-9fcc-b6d2e9803c09 could not be found. Jun 22 10:22:04.860426 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-42704f51-fc34-4d0b-aad2-49506ee55b8d tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Request method failure captured: Jun 22 10:22:04.860426 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: request: GET /compute/v2.1/servers/a5d1635b-71e2-4f7c-9fcc-b6d2e9803c09 HTTP/1.1 Jun 22 10:22:04.860426 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: Accept: application/json Jun 22 10:22:04.860426 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: Accept-Encoding: identity Jun 22 10:22:04.860426 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: Connection: close Jun 22 10:22:04.860426 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: Content-Length: 0 Jun 22 10:22:04.860426 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: Content-Type: application/json Jun 22 10:22:04.860426 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: Host: 10.222.0.43 Jun 22 10:22:04.860426 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: Openstack-System-Scope: None Jun 22 10:22:04.860426 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: User-Agent: python-urllib3/1.26.9 Jun 22 10:22:04.860426 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-Auth-Token: gAAAAABisuvUpGkoSsQ9d1KNFPX834O5Ed4reiDCWeVnTPicJ3T1CXVLNJjI8u1aloRBXjMgN_RPq4rTUmL5P2islljUOvvHIwLebG3DYtPiBpBpjPn3C8o_VLQB3yNvqrLTJBaPVXC7QVZTOTIWPKqjtW_CrQ0ZdCwS1UGZXZ6Doixu1TJW9Cg Jun 22 10:22:04.860426 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-Domain-Id: None Jun 22 10:22:04.860426 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-Domain-Name: None Jun 22 10:22:04.860426 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-Identity-Status: Confirmed Jun 22 10:22:04.860426 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-Is-Admin-Project: True Jun 22 10:22:04.860426 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-Project-Domain-Id: default Jun 22 10:22:04.860426 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-Project-Domain-Name: Default Jun 22 10:22:04.860426 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-Project-Id: 78629282e2b74418a2c1cdac32576ef1 Jun 22 10:22:04.860426 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-Project-Name: tempest-AttachVolumeNegativeTest-73508829 Jun 22 10:22:04.860426 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-Role: reader,member Jun 22 10:22:04.860426 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-Roles: reader,member Jun 22 10:22:04.861980 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/78629282e2b74418a2c1cdac32576ef1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/78629282e2b74418a2c1cdac32576ef1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_78629282e2b74418a2c1cdac32576ef1", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/78629282e2b74418a2c1cdac32576ef1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}] Jun 22 10:22:04.861980 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-Tenant: tempest-AttachVolumeNegativeTest-73508829 Jun 22 10:22:04.861980 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-Tenant-Id: 78629282e2b74418a2c1cdac32576ef1 Jun 22 10:22:04.861980 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-73508829 Jun 22 10:22:04.861980 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-User: tempest-AttachVolumeNegativeTest-73508829-project Jun 22 10:22:04.861980 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-User-Domain-Id: default Jun 22 10:22:04.861980 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-User-Domain-Name: Default Jun 22 10:22:04.861980 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-User-Id: 7be3d844dcee4d19966fc7944463a0bc Jun 22 10:22:04.861980 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-User-Name: tempest-AttachVolumeNegativeTest-73508829-project Jun 22 10:22:04.861980 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: method: > Jun 22 10:22:04.861980 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: exception: Instance a5d1635b-71e2-4f7c-9fcc-b6d2e9803c09 could not be found. Jun 22 10:22:04.861980 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: action_args: {'id': 'a5d1635b-71e2-4f7c-9fcc-b6d2e9803c09'} Jun 22 10:22:04.862875 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 10:22:04.862875 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:22:04.862875 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 22 10:22:04.862875 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 22 10:22:04.862875 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 22 10:22:04.862875 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 22 10:22:04.862875 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 22 10:22:04.862875 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 22 10:22:04.862875 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 22 10:22:04.862875 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 22 10:22:04.862875 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a5d1635b-71e2-4f7c-9fcc-b6d2e9803c09 could not be found. Jun 22 10:22:04.862875 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi Jun 22 10:22:04.862875 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 10:22:04.862875 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi Jun 22 10:22:04.862875 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:22:04.862875 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 10:22:04.862875 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 10:22:04.862875 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 10:22:04.862875 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 10:22:04.862875 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 10:22:04.864256 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 10:22:04.864256 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 22 10:22:04.864256 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 22 10:22:04.864256 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 22 10:22:04.864256 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 22 10:22:04.864256 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 22 10:22:04.864256 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 22 10:22:04.864256 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a5d1635b-71e2-4f7c-9fcc-b6d2e9803c09 could not be found. Jun 22 10:22:04.864256 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi Jun 22 10:22:04.864256 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 10:22:04.864256 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi Jun 22 10:22:04.864256 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:22:04.864256 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 10:22:04.864256 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 10:22:04.864256 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 10:22:04.864256 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 10:22:04.864256 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a5d1635b-71e2-4f7c-9fcc-b6d2e9803c09 could not be found. Jun 22 10:22:04.864256 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi Jun 22 10:22:04.865492 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-42704f51-fc34-4d0b-aad2-49506ee55b8d tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Returning 404 to user: Instance a5d1635b-71e2-4f7c-9fcc-b6d2e9803c09 could not be found. {{(pid=117873) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 10:22:04.865492 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [None req-42704f51-fc34-4d0b-aad2-49506ee55b8d tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] 10.222.0.43 "GET /compute/v2.1/servers/a5d1635b-71e2-4f7c-9fcc-b6d2e9803c09" status: 404 len: 111 microversion: 2.1 time: 0.030232 Jun 22 10:22:04.865492 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 397/801] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:22:04 2022] GET /compute/v2.1/servers/a5d1635b-71e2-4f7c-9fcc-b6d2e9803c09 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 22 10:22:04.870138 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-36ce74e7-d4a1-4bc3-940d-bcb7a5ea2d5a tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Calling method '>' {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:22:04.870627 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.compute.api [None req-36ce74e7-d4a1-4bc3-940d-bcb7a5ea2d5a tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] [instance: 0b2e66bb-efd5-4ff0-8163-5973db8e0db7] Fetching instance by UUID {{(pid=117874) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:22:04.877217 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-36ce74e7-d4a1-4bc3-940d-bcb7a5ea2d5a tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:22:04.877657 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-36ce74e7-d4a1-4bc3-940d-bcb7a5ea2d5a tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:22:04.878437 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-36ce74e7-d4a1-4bc3-940d-bcb7a5ea2d5a tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:22:04.878863 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-36ce74e7-d4a1-4bc3-940d-bcb7a5ea2d5a tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:22:04.892088 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.wsgi [None req-36ce74e7-d4a1-4bc3-940d-bcb7a5ea2d5a tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] HTTP exception thrown: Instance 0b2e66bb-efd5-4ff0-8163-5973db8e0db7 could not be found. Jun 22 10:22:04.893585 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-36ce74e7-d4a1-4bc3-940d-bcb7a5ea2d5a tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Request method failure captured: Jun 22 10:22:04.893585 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: request: DELETE /compute/v2.1/servers/0b2e66bb-efd5-4ff0-8163-5973db8e0db7 HTTP/1.1 Jun 22 10:22:04.893585 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: Accept: application/json Jun 22 10:22:04.893585 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: Accept-Encoding: identity Jun 22 10:22:04.893585 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: Connection: close Jun 22 10:22:04.893585 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: Content-Length: 0 Jun 22 10:22:04.893585 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: Content-Type: application/json Jun 22 10:22:04.893585 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: Host: 10.222.0.43 Jun 22 10:22:04.893585 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: Openstack-System-Scope: None Jun 22 10:22:04.893585 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: User-Agent: python-urllib3/1.26.9 Jun 22 10:22:04.893585 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-Auth-Token: gAAAAABisuvUpGkoSsQ9d1KNFPX834O5Ed4reiDCWeVnTPicJ3T1CXVLNJjI8u1aloRBXjMgN_RPq4rTUmL5P2islljUOvvHIwLebG3DYtPiBpBpjPn3C8o_VLQB3yNvqrLTJBaPVXC7QVZTOTIWPKqjtW_CrQ0ZdCwS1UGZXZ6Doixu1TJW9Cg Jun 22 10:22:04.893585 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-Domain-Id: None Jun 22 10:22:04.893585 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-Domain-Name: None Jun 22 10:22:04.893585 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-Identity-Status: Confirmed Jun 22 10:22:04.893585 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-Is-Admin-Project: True Jun 22 10:22:04.893585 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-Project-Domain-Id: default Jun 22 10:22:04.893585 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-Project-Domain-Name: Default Jun 22 10:22:04.893585 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-Project-Id: 78629282e2b74418a2c1cdac32576ef1 Jun 22 10:22:04.893585 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-Project-Name: tempest-AttachVolumeNegativeTest-73508829 Jun 22 10:22:04.893585 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-Role: reader,member Jun 22 10:22:04.893585 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-Roles: reader,member Jun 22 10:22:04.895162 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/78629282e2b74418a2c1cdac32576ef1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/78629282e2b74418a2c1cdac32576ef1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_78629282e2b74418a2c1cdac32576ef1", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/78629282e2b74418a2c1cdac32576ef1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}] Jun 22 10:22:04.895162 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-Tenant: tempest-AttachVolumeNegativeTest-73508829 Jun 22 10:22:04.895162 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-Tenant-Id: 78629282e2b74418a2c1cdac32576ef1 Jun 22 10:22:04.895162 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-73508829 Jun 22 10:22:04.895162 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-User: tempest-AttachVolumeNegativeTest-73508829-project Jun 22 10:22:04.895162 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-User-Domain-Id: default Jun 22 10:22:04.895162 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-User-Domain-Name: Default Jun 22 10:22:04.895162 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-User-Id: 7be3d844dcee4d19966fc7944463a0bc Jun 22 10:22:04.895162 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-User-Name: tempest-AttachVolumeNegativeTest-73508829-project Jun 22 10:22:04.895162 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: method: > Jun 22 10:22:04.895162 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: exception: Instance 0b2e66bb-efd5-4ff0-8163-5973db8e0db7 could not be found. Jun 22 10:22:04.895162 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: action_args: {'id': '0b2e66bb-efd5-4ff0-8163-5973db8e0db7'} Jun 22 10:22:04.895952 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 10:22:04.895952 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:22:04.895952 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 22 10:22:04.895952 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 22 10:22:04.895952 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 22 10:22:04.895952 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 22 10:22:04.895952 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 22 10:22:04.895952 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 22 10:22:04.895952 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 22 10:22:04.895952 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 22 10:22:04.895952 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0b2e66bb-efd5-4ff0-8163-5973db8e0db7 could not be found. Jun 22 10:22:04.895952 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi Jun 22 10:22:04.895952 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 10:22:04.895952 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi Jun 22 10:22:04.895952 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:22:04.895952 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 10:22:04.895952 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 10:22:04.895952 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 10:22:04.895952 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 10:22:04.895952 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 10:22:04.897203 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 10:22:04.897203 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 22 10:22:04.897203 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 22 10:22:04.897203 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 22 10:22:04.897203 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 22 10:22:04.897203 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 22 10:22:04.897203 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 22 10:22:04.897203 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 22 10:22:04.897203 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 22 10:22:04.897203 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0b2e66bb-efd5-4ff0-8163-5973db8e0db7 could not be found. Jun 22 10:22:04.897203 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi Jun 22 10:22:04.897203 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 10:22:04.897203 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi Jun 22 10:22:04.897203 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:22:04.897203 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 10:22:04.897203 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 10:22:04.897203 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 10:22:04.897203 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 10:22:04.897203 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0b2e66bb-efd5-4ff0-8163-5973db8e0db7 could not be found. Jun 22 10:22:04.897203 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi Jun 22 10:22:04.898403 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-36ce74e7-d4a1-4bc3-940d-bcb7a5ea2d5a tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Returning 404 to user: Instance 0b2e66bb-efd5-4ff0-8163-5973db8e0db7 could not be found. {{(pid=117874) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 10:22:04.898403 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [None req-36ce74e7-d4a1-4bc3-940d-bcb7a5ea2d5a tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] 10.222.0.43 "DELETE /compute/v2.1/servers/0b2e66bb-efd5-4ff0-8163-5973db8e0db7" status: 404 len: 111 microversion: 2.1 time: 0.028641 Jun 22 10:22:04.898403 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 405/802] 10.222.0.43 () {58 vars in 1238 bytes} [Wed Jun 22 10:22:04 2022] DELETE /compute/v2.1/servers/0b2e66bb-efd5-4ff0-8163-5973db8e0db7 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 22 10:22:04.903257 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-f156a830-111c-4bb8-9e4a-feb5acf02762 tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Calling method '>' {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:22:04.903869 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.compute.api [None req-f156a830-111c-4bb8-9e4a-feb5acf02762 tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] [instance: 0b2e66bb-efd5-4ff0-8163-5973db8e0db7] Fetching instance by UUID {{(pid=117873) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:22:04.910784 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-f156a830-111c-4bb8-9e4a-feb5acf02762 tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:22:04.911232 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-f156a830-111c-4bb8-9e4a-feb5acf02762 tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:22:04.911996 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-f156a830-111c-4bb8-9e4a-feb5acf02762 tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:22:04.912431 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-f156a830-111c-4bb8-9e4a-feb5acf02762 tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:22:04.928233 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.wsgi [None req-f156a830-111c-4bb8-9e4a-feb5acf02762 tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] HTTP exception thrown: Instance 0b2e66bb-efd5-4ff0-8163-5973db8e0db7 could not be found. Jun 22 10:22:04.929760 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-f156a830-111c-4bb8-9e4a-feb5acf02762 tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Request method failure captured: Jun 22 10:22:04.929760 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: request: GET /compute/v2.1/servers/0b2e66bb-efd5-4ff0-8163-5973db8e0db7 HTTP/1.1 Jun 22 10:22:04.929760 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: Accept: application/json Jun 22 10:22:04.929760 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: Accept-Encoding: identity Jun 22 10:22:04.929760 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: Connection: close Jun 22 10:22:04.929760 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: Content-Length: 0 Jun 22 10:22:04.929760 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: Content-Type: application/json Jun 22 10:22:04.929760 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: Host: 10.222.0.43 Jun 22 10:22:04.929760 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: Openstack-System-Scope: None Jun 22 10:22:04.929760 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: User-Agent: python-urllib3/1.26.9 Jun 22 10:22:04.929760 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-Auth-Token: gAAAAABisuvUpGkoSsQ9d1KNFPX834O5Ed4reiDCWeVnTPicJ3T1CXVLNJjI8u1aloRBXjMgN_RPq4rTUmL5P2islljUOvvHIwLebG3DYtPiBpBpjPn3C8o_VLQB3yNvqrLTJBaPVXC7QVZTOTIWPKqjtW_CrQ0ZdCwS1UGZXZ6Doixu1TJW9Cg Jun 22 10:22:04.929760 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-Domain-Id: None Jun 22 10:22:04.929760 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-Domain-Name: None Jun 22 10:22:04.929760 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-Identity-Status: Confirmed Jun 22 10:22:04.929760 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-Is-Admin-Project: True Jun 22 10:22:04.929760 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-Project-Domain-Id: default Jun 22 10:22:04.929760 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-Project-Domain-Name: Default Jun 22 10:22:04.929760 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-Project-Id: 78629282e2b74418a2c1cdac32576ef1 Jun 22 10:22:04.929760 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-Project-Name: tempest-AttachVolumeNegativeTest-73508829 Jun 22 10:22:04.929760 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-Role: reader,member Jun 22 10:22:04.929760 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-Roles: reader,member Jun 22 10:22:04.932109 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/78629282e2b74418a2c1cdac32576ef1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/78629282e2b74418a2c1cdac32576ef1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_78629282e2b74418a2c1cdac32576ef1", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/78629282e2b74418a2c1cdac32576ef1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}] Jun 22 10:22:04.932109 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-Tenant: tempest-AttachVolumeNegativeTest-73508829 Jun 22 10:22:04.932109 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-Tenant-Id: 78629282e2b74418a2c1cdac32576ef1 Jun 22 10:22:04.932109 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-73508829 Jun 22 10:22:04.932109 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-User: tempest-AttachVolumeNegativeTest-73508829-project Jun 22 10:22:04.932109 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-User-Domain-Id: default Jun 22 10:22:04.932109 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-User-Domain-Name: Default Jun 22 10:22:04.932109 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-User-Id: 7be3d844dcee4d19966fc7944463a0bc Jun 22 10:22:04.932109 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-User-Name: tempest-AttachVolumeNegativeTest-73508829-project Jun 22 10:22:04.932109 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: method: > Jun 22 10:22:04.932109 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: exception: Instance 0b2e66bb-efd5-4ff0-8163-5973db8e0db7 could not be found. Jun 22 10:22:04.932109 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: action_args: {'id': '0b2e66bb-efd5-4ff0-8163-5973db8e0db7'} Jun 22 10:22:04.933666 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 10:22:04.933666 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:22:04.933666 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 22 10:22:04.933666 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 22 10:22:04.933666 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 22 10:22:04.933666 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 22 10:22:04.933666 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 22 10:22:04.933666 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 22 10:22:04.933666 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 22 10:22:04.933666 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 22 10:22:04.933666 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0b2e66bb-efd5-4ff0-8163-5973db8e0db7 could not be found. Jun 22 10:22:04.933666 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi Jun 22 10:22:04.933666 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 10:22:04.933666 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi Jun 22 10:22:04.933666 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:22:04.933666 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 10:22:04.933666 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 10:22:04.933666 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 10:22:04.933666 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 10:22:04.933666 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 10:22:04.936238 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 10:22:04.936238 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 22 10:22:04.936238 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 22 10:22:04.936238 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 22 10:22:04.936238 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 22 10:22:04.936238 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 22 10:22:04.936238 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 22 10:22:04.936238 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0b2e66bb-efd5-4ff0-8163-5973db8e0db7 could not be found. Jun 22 10:22:04.936238 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi Jun 22 10:22:04.936238 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 10:22:04.936238 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi Jun 22 10:22:04.936238 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:22:04.936238 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 10:22:04.936238 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 10:22:04.936238 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 10:22:04.936238 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 10:22:04.936238 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0b2e66bb-efd5-4ff0-8163-5973db8e0db7 could not be found. Jun 22 10:22:04.936238 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi Jun 22 10:22:04.938809 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-f156a830-111c-4bb8-9e4a-feb5acf02762 tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Returning 404 to user: Instance 0b2e66bb-efd5-4ff0-8163-5973db8e0db7 could not be found. {{(pid=117873) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 10:22:04.938809 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [None req-f156a830-111c-4bb8-9e4a-feb5acf02762 tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] 10.222.0.43 "GET /compute/v2.1/servers/0b2e66bb-efd5-4ff0-8163-5973db8e0db7" status: 404 len: 111 microversion: 2.1 time: 0.031657 Jun 22 10:22:04.938809 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 398/803] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:22:04 2022] GET /compute/v2.1/servers/0b2e66bb-efd5-4ff0-8163-5973db8e0db7 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 22 10:22:06.068919 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-87e22774-d560-49a7-b2d7-e18d65f26bae tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Calling method '>' {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:22:06.069478 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.compute.api [None req-87e22774-d560-49a7-b2d7-e18d65f26bae tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] [instance: 5828c9dc-3439-4da7-a94c-f81cbbfdcb99] Fetching instance by UUID {{(pid=117874) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:22:06.075966 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-87e22774-d560-49a7-b2d7-e18d65f26bae tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:22:06.076405 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-87e22774-d560-49a7-b2d7-e18d65f26bae tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:22:06.077790 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-87e22774-d560-49a7-b2d7-e18d65f26bae tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:22:06.078424 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-87e22774-d560-49a7-b2d7-e18d65f26bae tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:22:06.093278 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.wsgi [None req-87e22774-d560-49a7-b2d7-e18d65f26bae tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] HTTP exception thrown: Instance 5828c9dc-3439-4da7-a94c-f81cbbfdcb99 could not be found. Jun 22 10:22:06.094424 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-87e22774-d560-49a7-b2d7-e18d65f26bae tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Request method failure captured: Jun 22 10:22:06.094424 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: request: DELETE /compute/v2.1/servers/5828c9dc-3439-4da7-a94c-f81cbbfdcb99 HTTP/1.1 Jun 22 10:22:06.094424 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: Accept: application/json Jun 22 10:22:06.094424 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: Accept-Encoding: identity Jun 22 10:22:06.094424 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: Connection: close Jun 22 10:22:06.094424 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: Content-Length: 0 Jun 22 10:22:06.094424 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: Content-Type: application/json Jun 22 10:22:06.094424 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: Host: 10.222.0.43 Jun 22 10:22:06.094424 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: Openstack-System-Scope: None Jun 22 10:22:06.094424 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: User-Agent: python-urllib3/1.26.9 Jun 22 10:22:06.094424 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-Auth-Token: gAAAAABisuvUpGkoSsQ9d1KNFPX834O5Ed4reiDCWeVnTPicJ3T1CXVLNJjI8u1aloRBXjMgN_RPq4rTUmL5P2islljUOvvHIwLebG3DYtPiBpBpjPn3C8o_VLQB3yNvqrLTJBaPVXC7QVZTOTIWPKqjtW_CrQ0ZdCwS1UGZXZ6Doixu1TJW9Cg Jun 22 10:22:06.094424 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-Domain-Id: None Jun 22 10:22:06.094424 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-Domain-Name: None Jun 22 10:22:06.094424 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-Identity-Status: Confirmed Jun 22 10:22:06.094424 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-Is-Admin-Project: True Jun 22 10:22:06.094424 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-Project-Domain-Id: default Jun 22 10:22:06.094424 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-Project-Domain-Name: Default Jun 22 10:22:06.094424 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-Project-Id: 78629282e2b74418a2c1cdac32576ef1 Jun 22 10:22:06.094424 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-Project-Name: tempest-AttachVolumeNegativeTest-73508829 Jun 22 10:22:06.094424 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-Role: reader,member Jun 22 10:22:06.094424 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-Roles: reader,member Jun 22 10:22:06.095706 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/78629282e2b74418a2c1cdac32576ef1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/78629282e2b74418a2c1cdac32576ef1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_78629282e2b74418a2c1cdac32576ef1", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/78629282e2b74418a2c1cdac32576ef1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}] Jun 22 10:22:06.095706 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-Tenant: tempest-AttachVolumeNegativeTest-73508829 Jun 22 10:22:06.095706 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-Tenant-Id: 78629282e2b74418a2c1cdac32576ef1 Jun 22 10:22:06.095706 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-73508829 Jun 22 10:22:06.095706 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-User: tempest-AttachVolumeNegativeTest-73508829-project Jun 22 10:22:06.095706 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-User-Domain-Id: default Jun 22 10:22:06.095706 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-User-Domain-Name: Default Jun 22 10:22:06.095706 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-User-Id: 7be3d844dcee4d19966fc7944463a0bc Jun 22 10:22:06.095706 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-User-Name: tempest-AttachVolumeNegativeTest-73508829-project Jun 22 10:22:06.095706 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: method: > Jun 22 10:22:06.095706 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: exception: Instance 5828c9dc-3439-4da7-a94c-f81cbbfdcb99 could not be found. Jun 22 10:22:06.095706 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: action_args: {'id': '5828c9dc-3439-4da7-a94c-f81cbbfdcb99'} Jun 22 10:22:06.096468 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 10:22:06.096468 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:22:06.096468 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 22 10:22:06.096468 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 22 10:22:06.096468 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 22 10:22:06.096468 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 22 10:22:06.096468 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 22 10:22:06.096468 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 22 10:22:06.096468 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 22 10:22:06.096468 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 22 10:22:06.096468 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5828c9dc-3439-4da7-a94c-f81cbbfdcb99 could not be found. Jun 22 10:22:06.096468 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi Jun 22 10:22:06.096468 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 10:22:06.096468 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi Jun 22 10:22:06.096468 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:22:06.096468 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 10:22:06.096468 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 10:22:06.096468 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 10:22:06.096468 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 10:22:06.096468 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 10:22:06.097813 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 10:22:06.097813 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 22 10:22:06.097813 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 22 10:22:06.097813 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 22 10:22:06.097813 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 22 10:22:06.097813 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 22 10:22:06.097813 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 22 10:22:06.097813 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 22 10:22:06.097813 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 22 10:22:06.097813 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5828c9dc-3439-4da7-a94c-f81cbbfdcb99 could not be found. Jun 22 10:22:06.097813 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi Jun 22 10:22:06.097813 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 10:22:06.097813 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi Jun 22 10:22:06.097813 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:22:06.097813 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 10:22:06.097813 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 10:22:06.097813 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 10:22:06.097813 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 10:22:06.097813 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5828c9dc-3439-4da7-a94c-f81cbbfdcb99 could not be found. Jun 22 10:22:06.097813 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi Jun 22 10:22:06.099142 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-87e22774-d560-49a7-b2d7-e18d65f26bae tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Returning 404 to user: Instance 5828c9dc-3439-4da7-a94c-f81cbbfdcb99 could not be found. {{(pid=117874) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 10:22:06.099142 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [None req-87e22774-d560-49a7-b2d7-e18d65f26bae tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] 10.222.0.43 "DELETE /compute/v2.1/servers/5828c9dc-3439-4da7-a94c-f81cbbfdcb99" status: 404 len: 111 microversion: 2.1 time: 0.030732 Jun 22 10:22:06.099142 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 406/804] 10.222.0.43 () {58 vars in 1238 bytes} [Wed Jun 22 10:22:06 2022] DELETE /compute/v2.1/servers/5828c9dc-3439-4da7-a94c-f81cbbfdcb99 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 22 10:22:06.109955 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-b37e83f5-9cf1-440d-9233-ba65a1fd8844 tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Calling method '>' {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:22:06.110592 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.compute.api [None req-b37e83f5-9cf1-440d-9233-ba65a1fd8844 tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] [instance: 5828c9dc-3439-4da7-a94c-f81cbbfdcb99] Fetching instance by UUID {{(pid=117873) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:22:06.117026 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-b37e83f5-9cf1-440d-9233-ba65a1fd8844 tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:22:06.117465 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-b37e83f5-9cf1-440d-9233-ba65a1fd8844 tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:22:06.118240 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-b37e83f5-9cf1-440d-9233-ba65a1fd8844 tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:22:06.118665 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-b37e83f5-9cf1-440d-9233-ba65a1fd8844 tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:22:06.121236 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG dbcounter [-] [117873] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=5,nova_cell1:INSERT=4 {{(pid=117873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:22:06.134616 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.wsgi [None req-b37e83f5-9cf1-440d-9233-ba65a1fd8844 tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] HTTP exception thrown: Instance 5828c9dc-3439-4da7-a94c-f81cbbfdcb99 could not be found. Jun 22 10:22:06.136288 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-b37e83f5-9cf1-440d-9233-ba65a1fd8844 tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Request method failure captured: Jun 22 10:22:06.136288 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: request: GET /compute/v2.1/servers/5828c9dc-3439-4da7-a94c-f81cbbfdcb99 HTTP/1.1 Jun 22 10:22:06.136288 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: Accept: application/json Jun 22 10:22:06.136288 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: Accept-Encoding: identity Jun 22 10:22:06.136288 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: Connection: close Jun 22 10:22:06.136288 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: Content-Length: 0 Jun 22 10:22:06.136288 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: Content-Type: application/json Jun 22 10:22:06.136288 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: Host: 10.222.0.43 Jun 22 10:22:06.136288 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: Openstack-System-Scope: None Jun 22 10:22:06.136288 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: User-Agent: python-urllib3/1.26.9 Jun 22 10:22:06.136288 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-Auth-Token: gAAAAABisuvUpGkoSsQ9d1KNFPX834O5Ed4reiDCWeVnTPicJ3T1CXVLNJjI8u1aloRBXjMgN_RPq4rTUmL5P2islljUOvvHIwLebG3DYtPiBpBpjPn3C8o_VLQB3yNvqrLTJBaPVXC7QVZTOTIWPKqjtW_CrQ0ZdCwS1UGZXZ6Doixu1TJW9Cg Jun 22 10:22:06.136288 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-Domain-Id: None Jun 22 10:22:06.136288 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-Domain-Name: None Jun 22 10:22:06.136288 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-Identity-Status: Confirmed Jun 22 10:22:06.136288 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-Is-Admin-Project: True Jun 22 10:22:06.136288 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-Project-Domain-Id: default Jun 22 10:22:06.136288 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-Project-Domain-Name: Default Jun 22 10:22:06.136288 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-Project-Id: 78629282e2b74418a2c1cdac32576ef1 Jun 22 10:22:06.136288 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-Project-Name: tempest-AttachVolumeNegativeTest-73508829 Jun 22 10:22:06.136288 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-Role: reader,member Jun 22 10:22:06.136288 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-Roles: reader,member Jun 22 10:22:06.137670 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/78629282e2b74418a2c1cdac32576ef1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/78629282e2b74418a2c1cdac32576ef1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_78629282e2b74418a2c1cdac32576ef1", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/78629282e2b74418a2c1cdac32576ef1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}] Jun 22 10:22:06.137670 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-Tenant: tempest-AttachVolumeNegativeTest-73508829 Jun 22 10:22:06.137670 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-Tenant-Id: 78629282e2b74418a2c1cdac32576ef1 Jun 22 10:22:06.137670 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-73508829 Jun 22 10:22:06.137670 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-User: tempest-AttachVolumeNegativeTest-73508829-project Jun 22 10:22:06.137670 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-User-Domain-Id: default Jun 22 10:22:06.137670 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-User-Domain-Name: Default Jun 22 10:22:06.137670 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-User-Id: 7be3d844dcee4d19966fc7944463a0bc Jun 22 10:22:06.137670 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-User-Name: tempest-AttachVolumeNegativeTest-73508829-project Jun 22 10:22:06.137670 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: method: > Jun 22 10:22:06.137670 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: exception: Instance 5828c9dc-3439-4da7-a94c-f81cbbfdcb99 could not be found. Jun 22 10:22:06.137670 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: action_args: {'id': '5828c9dc-3439-4da7-a94c-f81cbbfdcb99'} Jun 22 10:22:06.138443 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 10:22:06.138443 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:22:06.138443 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 22 10:22:06.138443 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 22 10:22:06.138443 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 22 10:22:06.138443 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 22 10:22:06.138443 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 22 10:22:06.138443 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 22 10:22:06.138443 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 22 10:22:06.138443 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 22 10:22:06.138443 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5828c9dc-3439-4da7-a94c-f81cbbfdcb99 could not be found. Jun 22 10:22:06.138443 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi Jun 22 10:22:06.138443 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 10:22:06.138443 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi Jun 22 10:22:06.138443 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:22:06.138443 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 10:22:06.138443 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 10:22:06.138443 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 10:22:06.138443 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 10:22:06.138443 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 10:22:06.140351 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 10:22:06.140351 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 22 10:22:06.140351 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 22 10:22:06.140351 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 22 10:22:06.140351 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 22 10:22:06.140351 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 22 10:22:06.140351 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 22 10:22:06.140351 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5828c9dc-3439-4da7-a94c-f81cbbfdcb99 could not be found. Jun 22 10:22:06.140351 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi Jun 22 10:22:06.140351 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 10:22:06.140351 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi Jun 22 10:22:06.140351 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:22:06.140351 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 10:22:06.140351 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 10:22:06.140351 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 10:22:06.140351 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 10:22:06.140351 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5828c9dc-3439-4da7-a94c-f81cbbfdcb99 could not be found. Jun 22 10:22:06.140351 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi Jun 22 10:22:06.141400 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-b37e83f5-9cf1-440d-9233-ba65a1fd8844 tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] Returning 404 to user: Instance 5828c9dc-3439-4da7-a94c-f81cbbfdcb99 could not be found. {{(pid=117873) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 10:22:06.141400 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [None req-b37e83f5-9cf1-440d-9233-ba65a1fd8844 tempest-AttachVolumeNegativeTest-73508829 tempest-AttachVolumeNegativeTest-73508829-project] 10.222.0.43 "GET /compute/v2.1/servers/5828c9dc-3439-4da7-a94c-f81cbbfdcb99" status: 404 len: 111 microversion: 2.1 time: 0.031692 Jun 22 10:22:06.141400 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 399/805] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:22:06 2022] GET /compute/v2.1/servers/5828c9dc-3439-4da7-a94c-f81cbbfdcb99 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 22 10:22:07.226666 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-96753296-03d9-4676-a73f-b3121796ab0a tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Calling method '>' {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:22:07.227935 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.compute.api [None req-96753296-03d9-4676-a73f-b3121796ab0a tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] [instance: edabe652-f189-4feb-89b8-6bc768c1669d] Fetching instance by UUID {{(pid=117874) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:22:07.235580 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-96753296-03d9-4676-a73f-b3121796ab0a tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:22:07.236069 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-96753296-03d9-4676-a73f-b3121796ab0a tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:22:07.236852 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-96753296-03d9-4676-a73f-b3121796ab0a tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:22:07.237292 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-96753296-03d9-4676-a73f-b3121796ab0a tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:22:07.269508 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [None req-96753296-03d9-4676-a73f-b3121796ab0a tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] 10.222.0.43 "GET /compute/v2.1/servers/edabe652-f189-4feb-89b8-6bc768c1669d/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.046808 Jun 22 10:22:07.274072 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 407/806] 10.222.0.43 () {58 vars in 1301 bytes} [Wed Jun 22 10:22:07 2022] GET /compute/v2.1/servers/edabe652-f189-4feb-89b8-6bc768c1669d/os-volume_attachments => generated 371 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 10:22:07.408635 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-79dd51b2-2685-4723-9963-5690052df30d tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Calling method '>' {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:22:07.409162 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.compute.api [None req-79dd51b2-2685-4723-9963-5690052df30d tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] [instance: edabe652-f189-4feb-89b8-6bc768c1669d] Fetching instance by UUID {{(pid=117873) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:22:07.415941 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-79dd51b2-2685-4723-9963-5690052df30d tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:22:07.416333 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-79dd51b2-2685-4723-9963-5690052df30d tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:22:07.417079 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-79dd51b2-2685-4723-9963-5690052df30d tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:22:07.417506 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-79dd51b2-2685-4723-9963-5690052df30d tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:22:07.446308 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [None req-79dd51b2-2685-4723-9963-5690052df30d tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] 10.222.0.43 "GET /compute/v2.1/servers/edabe652-f189-4feb-89b8-6bc768c1669d/os-volume_attachments/3678a4d4-6a12-4b1d-81d8-35ff956cfacf" status: 200 len: 194 microversion: 2.1 time: 0.042149 Jun 22 10:22:07.450367 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 400/807] 10.222.0.43 () {58 vars in 1412 bytes} [Wed Jun 22 10:22:07 2022] GET /compute/v2.1/servers/edabe652-f189-4feb-89b8-6bc768c1669d/os-volume_attachments/3678a4d4-6a12-4b1d-81d8-35ff956cfacf => generated 194 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 10:22:07.456692 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-759a1c55-4d21-4578-80eb-6ddedeee9e07 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Calling method '>' {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:22:07.457182 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.compute.api [None req-759a1c55-4d21-4578-80eb-6ddedeee9e07 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] [instance: edabe652-f189-4feb-89b8-6bc768c1669d] Fetching instance by UUID {{(pid=117874) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:22:07.463064 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-759a1c55-4d21-4578-80eb-6ddedeee9e07 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:22:07.463506 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-759a1c55-4d21-4578-80eb-6ddedeee9e07 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:22:07.464256 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-759a1c55-4d21-4578-80eb-6ddedeee9e07 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:22:07.464686 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-759a1c55-4d21-4578-80eb-6ddedeee9e07 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:22:07.546783 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.objects.instance [None req-759a1c55-4d21-4578-80eb-6ddedeee9e07 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Lazy-loading 'services' on Instance uuid edabe652-f189-4feb-89b8-6bc768c1669d {{(pid=117874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 22 10:22:07.619898 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [None req-759a1c55-4d21-4578-80eb-6ddedeee9e07 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] 10.222.0.43 "DELETE /compute/v2.1/servers/edabe652-f189-4feb-89b8-6bc768c1669d/os-volume_attachments/3678a4d4-6a12-4b1d-81d8-35ff956cfacf" status: 202 len: 0 microversion: 2.1 time: 0.166933 Jun 22 10:22:07.620665 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 408/808] 10.222.0.43 () {58 vars in 1415 bytes} [Wed Jun 22 10:22:07 2022] DELETE /compute/v2.1/servers/edabe652-f189-4feb-89b8-6bc768c1669d/os-volume_attachments/3678a4d4-6a12-4b1d-81d8-35ff956cfacf => generated 0 bytes in 169 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 22 10:22:08.768308 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-af416924-3f3d-4169-b215-c0245f0a63b1 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Calling method '>' {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:22:08.768824 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.compute.api [None req-af416924-3f3d-4169-b215-c0245f0a63b1 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] [instance: edabe652-f189-4feb-89b8-6bc768c1669d] Fetching instance by UUID {{(pid=117873) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:22:08.775866 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-af416924-3f3d-4169-b215-c0245f0a63b1 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:22:08.776984 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-af416924-3f3d-4169-b215-c0245f0a63b1 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:22:08.777791 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-af416924-3f3d-4169-b215-c0245f0a63b1 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:22:08.778227 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-af416924-3f3d-4169-b215-c0245f0a63b1 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:22:08.814010 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [None req-af416924-3f3d-4169-b215-c0245f0a63b1 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] 10.222.0.43 "GET /compute/v2.1/servers/edabe652-f189-4feb-89b8-6bc768c1669d/os-volume_attachments/c431b32e-a9b5-4833-991a-ed8162090bbf" status: 200 len: 194 microversion: 2.1 time: 0.050841 Jun 22 10:22:08.814618 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 401/809] 10.222.0.43 () {58 vars in 1412 bytes} [Wed Jun 22 10:22:08 2022] GET /compute/v2.1/servers/edabe652-f189-4feb-89b8-6bc768c1669d/os-volume_attachments/c431b32e-a9b5-4833-991a-ed8162090bbf => generated 194 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 10:22:08.824815 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-35f920b1-0d3d-4f90-8065-26f668614e81 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Calling method '>' {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:22:08.825517 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.compute.api [None req-35f920b1-0d3d-4f90-8065-26f668614e81 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] [instance: edabe652-f189-4feb-89b8-6bc768c1669d] Fetching instance by UUID {{(pid=117874) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:22:08.832987 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-35f920b1-0d3d-4f90-8065-26f668614e81 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:22:08.833439 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-35f920b1-0d3d-4f90-8065-26f668614e81 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:22:08.834236 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-35f920b1-0d3d-4f90-8065-26f668614e81 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:22:08.834675 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-35f920b1-0d3d-4f90-8065-26f668614e81 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:22:08.937140 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.objects.instance [None req-35f920b1-0d3d-4f90-8065-26f668614e81 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Lazy-loading 'services' on Instance uuid edabe652-f189-4feb-89b8-6bc768c1669d {{(pid=117874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 22 10:22:09.026233 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [None req-35f920b1-0d3d-4f90-8065-26f668614e81 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] 10.222.0.43 "DELETE /compute/v2.1/servers/edabe652-f189-4feb-89b8-6bc768c1669d/os-volume_attachments/c431b32e-a9b5-4833-991a-ed8162090bbf" status: 202 len: 0 microversion: 2.1 time: 0.205327 Jun 22 10:22:09.027128 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 409/810] 10.222.0.43 () {58 vars in 1415 bytes} [Wed Jun 22 10:22:08 2022] DELETE /compute/v2.1/servers/edabe652-f189-4feb-89b8-6bc768c1669d/os-volume_attachments/c431b32e-a9b5-4833-991a-ed8162090bbf => generated 0 bytes in 207 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 22 10:22:10.208479 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-46860ff6-0c69-4773-9def-ce085a9d1551 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Calling method '>' {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:22:10.209535 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.compute.api [None req-46860ff6-0c69-4773-9def-ce085a9d1551 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] [instance: edabe652-f189-4feb-89b8-6bc768c1669d] Fetching instance by UUID {{(pid=117873) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:22:10.212175 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG dbcounter [-] [117873] Writing DB stats nova_api:SELECT=54,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=117873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:22:10.218073 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-46860ff6-0c69-4773-9def-ce085a9d1551 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:22:10.218515 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-46860ff6-0c69-4773-9def-ce085a9d1551 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:22:10.219297 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-46860ff6-0c69-4773-9def-ce085a9d1551 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:22:10.219729 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-46860ff6-0c69-4773-9def-ce085a9d1551 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:22:10.252842 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [None req-46860ff6-0c69-4773-9def-ce085a9d1551 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] 10.222.0.43 "GET /compute/v2.1/servers/edabe652-f189-4feb-89b8-6bc768c1669d/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.048305 Jun 22 10:22:10.253403 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 402/811] 10.222.0.43 () {58 vars in 1301 bytes} [Wed Jun 22 10:22:10 2022] GET /compute/v2.1/servers/edabe652-f189-4feb-89b8-6bc768c1669d/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 22 10:22:10.363853 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-5123dbff-b466-4811-81b4-542e6477a294 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Calling method '>' {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:22:10.364919 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.compute.api [None req-5123dbff-b466-4811-81b4-542e6477a294 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] [instance: edabe652-f189-4feb-89b8-6bc768c1669d] Fetching instance by UUID {{(pid=117874) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:22:10.371426 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-5123dbff-b466-4811-81b4-542e6477a294 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:22:10.371879 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-5123dbff-b466-4811-81b4-542e6477a294 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:22:10.372650 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-5123dbff-b466-4811-81b4-542e6477a294 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:22:10.373087 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-5123dbff-b466-4811-81b4-542e6477a294 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:22:10.406227 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [None req-5123dbff-b466-4811-81b4-542e6477a294 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] 10.222.0.43 "GET /compute/v2.1/servers/edabe652-f189-4feb-89b8-6bc768c1669d/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047760 Jun 22 10:22:10.406971 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 410/812] 10.222.0.43 () {58 vars in 1301 bytes} [Wed Jun 22 10:22:10 2022] GET /compute/v2.1/servers/edabe652-f189-4feb-89b8-6bc768c1669d/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 22 10:22:10.466726 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-535763e1-e3b6-477a-824d-8712edd9ccba tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Calling method '>' {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:22:10.468028 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.compute.api [None req-535763e1-e3b6-477a-824d-8712edd9ccba tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] [instance: edabe652-f189-4feb-89b8-6bc768c1669d] Fetching instance by UUID {{(pid=117873) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:22:10.473866 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-535763e1-e3b6-477a-824d-8712edd9ccba tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:22:10.474314 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-535763e1-e3b6-477a-824d-8712edd9ccba tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:22:10.475078 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-535763e1-e3b6-477a-824d-8712edd9ccba tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:22:10.475551 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-535763e1-e3b6-477a-824d-8712edd9ccba tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:22:10.505548 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.compute.api [None req-535763e1-e3b6-477a-824d-8712edd9ccba tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] [instance: edabe652-f189-4feb-89b8-6bc768c1669d] Going to try to terminate instance {{(pid=117873) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 22 10:22:10.598366 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [None req-535763e1-e3b6-477a-824d-8712edd9ccba tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] 10.222.0.43 "DELETE /compute/v2.1/servers/edabe652-f189-4feb-89b8-6bc768c1669d" status: 204 len: 0 microversion: 2.1 time: 0.134933 Jun 22 10:22:10.599592 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 403/813] 10.222.0.43 () {58 vars in 1238 bytes} [Wed Jun 22 10:22:10 2022] DELETE /compute/v2.1/servers/edabe652-f189-4feb-89b8-6bc768c1669d => generated 0 bytes in 137 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 22 10:22:10.607715 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-16a528c2-e738-4479-a7d1-1da05bdc854e tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Calling method '>' {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:22:10.608596 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.compute.api [None req-16a528c2-e738-4479-a7d1-1da05bdc854e tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] [instance: edabe652-f189-4feb-89b8-6bc768c1669d] Fetching instance by UUID {{(pid=117874) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:22:10.614889 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-16a528c2-e738-4479-a7d1-1da05bdc854e tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:22:10.615528 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-16a528c2-e738-4479-a7d1-1da05bdc854e tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:22:10.616469 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-16a528c2-e738-4479-a7d1-1da05bdc854e tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:22:10.617065 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-16a528c2-e738-4479-a7d1-1da05bdc854e tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:22:10.779778 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.policy [None req-16a528c2-e738-4479-a7d1-1da05bdc854e tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78fe3fc4334c43d7a5ef6d70f9f57523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad52333bcbec425089c44c3e55df97ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117874) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:22:10.788792 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG dbcounter [-] [117874] Writing DB stats nova_cell1:SELECT=98,nova_cell1:INSERT=2 {{(pid=117874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:22:10.791776 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [None req-16a528c2-e738-4479-a7d1-1da05bdc854e tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] 10.222.0.43 "GET /compute/v2.1/servers/edabe652-f189-4feb-89b8-6bc768c1669d" status: 200 len: 1673 microversion: 2.1 time: 0.187921 Jun 22 10:22:10.792433 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 411/814] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:22:10 2022] GET /compute/v2.1/servers/edabe652-f189-4feb-89b8-6bc768c1669d => generated 1673 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:22:11.810562 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-ccbd4678-1bbf-43f8-8503-3e438430273a tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Calling method '>' {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:22:11.811353 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.compute.api [None req-ccbd4678-1bbf-43f8-8503-3e438430273a tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] [instance: edabe652-f189-4feb-89b8-6bc768c1669d] Fetching instance by UUID {{(pid=117873) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:22:11.817964 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-ccbd4678-1bbf-43f8-8503-3e438430273a tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:22:11.818410 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-ccbd4678-1bbf-43f8-8503-3e438430273a tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:22:11.819175 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-ccbd4678-1bbf-43f8-8503-3e438430273a tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:22:11.819610 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-ccbd4678-1bbf-43f8-8503-3e438430273a tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:22:11.959502 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.policy [None req-ccbd4678-1bbf-43f8-8503-3e438430273a tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78fe3fc4334c43d7a5ef6d70f9f57523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad52333bcbec425089c44c3e55df97ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117873) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:22:11.967159 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [None req-ccbd4678-1bbf-43f8-8503-3e438430273a tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] 10.222.0.43 "GET /compute/v2.1/servers/edabe652-f189-4feb-89b8-6bc768c1669d" status: 200 len: 1673 microversion: 2.1 time: 0.160752 Jun 22 10:22:11.967687 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 404/815] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:22:11 2022] GET /compute/v2.1/servers/edabe652-f189-4feb-89b8-6bc768c1669d => generated 1673 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:22:12.984279 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-5d97944e-6ef9-4c36-b29c-a6b285ef3fc4 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Calling method '>' {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:22:12.984865 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.compute.api [None req-5d97944e-6ef9-4c36-b29c-a6b285ef3fc4 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] [instance: edabe652-f189-4feb-89b8-6bc768c1669d] Fetching instance by UUID {{(pid=117874) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:22:12.992473 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-5d97944e-6ef9-4c36-b29c-a6b285ef3fc4 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:22:12.992980 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-5d97944e-6ef9-4c36-b29c-a6b285ef3fc4 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:22:12.993763 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-5d97944e-6ef9-4c36-b29c-a6b285ef3fc4 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:22:12.994199 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-5d97944e-6ef9-4c36-b29c-a6b285ef3fc4 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:22:13.059491 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.policy [None req-5d97944e-6ef9-4c36-b29c-a6b285ef3fc4 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78fe3fc4334c43d7a5ef6d70f9f57523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad52333bcbec425089c44c3e55df97ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117874) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:22:13.067746 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [None req-5d97944e-6ef9-4c36-b29c-a6b285ef3fc4 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] 10.222.0.43 "GET /compute/v2.1/servers/edabe652-f189-4feb-89b8-6bc768c1669d" status: 200 len: 1605 microversion: 2.1 time: 0.087641 Jun 22 10:22:13.068339 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 412/816] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:22:12 2022] GET /compute/v2.1/servers/edabe652-f189-4feb-89b8-6bc768c1669d => generated 1605 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:22:13.214274 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [req-5a5a46b0-fa7d-401a-a1e5-f47f2506b091 req-90e89d68-db44-4023-a5c7-a3b0a737d46c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "edabe652-f189-4feb-89b8-6bc768c1669d", "name": "network-vif-deleted", "tag": "181865e7-8701-4ee4-8619-52218e16c189"}]} {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:22:13.226464 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [req-5a5a46b0-fa7d-401a-a1e5-f47f2506b091 req-90e89d68-db44-4023-a5c7-a3b0a737d46c service nova] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:22:13.227365 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [req-5a5a46b0-fa7d-401a-a1e5-f47f2506b091 req-90e89d68-db44-4023-a5c7-a3b0a737d46c service nova] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:22:13.240364 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.compute.server_external_events [req-5a5a46b0-fa7d-401a-a1e5-f47f2506b091 req-90e89d68-db44-4023-a5c7-a3b0a737d46c service nova] Creating event network-vif-deleted:181865e7-8701-4ee4-8619-52218e16c189 for instance edabe652-f189-4feb-89b8-6bc768c1669d on hv-cinder-84713 Jun 22 10:22:13.245555 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [req-5a5a46b0-fa7d-401a-a1e5-f47f2506b091 req-90e89d68-db44-4023-a5c7-a3b0a737d46c service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034868 Jun 22 10:22:13.246199 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 405/817] 10.222.0.43 () {64 vars in 1317 bytes} [Wed Jun 22 10:22:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 10:22:14.085782 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-a36b7437-a203-4f9f-94c9-6d5aadc2c5d0 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Calling method '>' {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:22:14.086396 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.compute.api [None req-a36b7437-a203-4f9f-94c9-6d5aadc2c5d0 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] [instance: edabe652-f189-4feb-89b8-6bc768c1669d] Fetching instance by UUID {{(pid=117874) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:22:14.094224 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-a36b7437-a203-4f9f-94c9-6d5aadc2c5d0 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:22:14.094673 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-a36b7437-a203-4f9f-94c9-6d5aadc2c5d0 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:22:14.095498 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-a36b7437-a203-4f9f-94c9-6d5aadc2c5d0 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:22:14.095933 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-a36b7437-a203-4f9f-94c9-6d5aadc2c5d0 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:22:14.112254 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.wsgi [None req-a36b7437-a203-4f9f-94c9-6d5aadc2c5d0 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] HTTP exception thrown: Instance edabe652-f189-4feb-89b8-6bc768c1669d could not be found. Jun 22 10:22:14.114026 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-a36b7437-a203-4f9f-94c9-6d5aadc2c5d0 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Request method failure captured: Jun 22 10:22:14.114026 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: request: GET /compute/v2.1/servers/edabe652-f189-4feb-89b8-6bc768c1669d HTTP/1.1 Jun 22 10:22:14.114026 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: Accept: application/json Jun 22 10:22:14.114026 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: Accept-Encoding: identity Jun 22 10:22:14.114026 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: Connection: close Jun 22 10:22:14.114026 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: Content-Length: 0 Jun 22 10:22:14.114026 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: Content-Type: application/json Jun 22 10:22:14.114026 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: Host: 10.222.0.43 Jun 22 10:22:14.114026 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: Openstack-System-Scope: None Jun 22 10:22:14.114026 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: User-Agent: python-urllib3/1.26.9 Jun 22 10:22:14.114026 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-Auth-Token: gAAAAABisuvm1HC5vURYGMHfhINNIY8dTNOSFMPEl0C8lmgixL-5gwhHJAyz_bxTDEMKLYHp_kBtrSYxzku6NejXNaLgya7bmqZ35QgSXSflYBmbpUiQTFVxrG4p6pERG6W27K0HsTOZ4plGpZPukHTNXTIrCder10qUDxudU2mAH2u7vnZVtg8 Jun 22 10:22:14.114026 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-Domain-Id: None Jun 22 10:22:14.114026 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-Domain-Name: None Jun 22 10:22:14.114026 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-Identity-Status: Confirmed Jun 22 10:22:14.114026 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-Is-Admin-Project: True Jun 22 10:22:14.114026 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-Project-Domain-Id: default Jun 22 10:22:14.114026 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-Project-Domain-Name: Default Jun 22 10:22:14.114026 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-Project-Id: ad52333bcbec425089c44c3e55df97ff Jun 22 10:22:14.114026 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-Project-Name: tempest-AttachVolumeTestJSON-1901268930 Jun 22 10:22:14.114026 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-Role: reader,member Jun 22 10:22:14.114026 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-Roles: reader,member Jun 22 10:22:14.115718 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/ad52333bcbec425089c44c3e55df97ff"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/ad52333bcbec425089c44c3e55df97ff"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_ad52333bcbec425089c44c3e55df97ff", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/ad52333bcbec425089c44c3e55df97ff"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}] Jun 22 10:22:14.115718 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-Tenant: tempest-AttachVolumeTestJSON-1901268930 Jun 22 10:22:14.115718 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-Tenant-Id: ad52333bcbec425089c44c3e55df97ff Jun 22 10:22:14.115718 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1901268930 Jun 22 10:22:14.115718 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-User: tempest-AttachVolumeTestJSON-1901268930-project Jun 22 10:22:14.115718 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-User-Domain-Id: default Jun 22 10:22:14.115718 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-User-Domain-Name: Default Jun 22 10:22:14.115718 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-User-Id: 78fe3fc4334c43d7a5ef6d70f9f57523 Jun 22 10:22:14.115718 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-User-Name: tempest-AttachVolumeTestJSON-1901268930-project Jun 22 10:22:14.115718 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: method: > Jun 22 10:22:14.115718 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: exception: Instance edabe652-f189-4feb-89b8-6bc768c1669d could not be found. Jun 22 10:22:14.115718 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: action_args: {'id': 'edabe652-f189-4feb-89b8-6bc768c1669d'} Jun 22 10:22:14.116609 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 10:22:14.116609 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:22:14.116609 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 22 10:22:14.116609 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 22 10:22:14.116609 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 22 10:22:14.116609 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 22 10:22:14.116609 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 22 10:22:14.116609 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 22 10:22:14.116609 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 22 10:22:14.116609 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 22 10:22:14.116609 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance edabe652-f189-4feb-89b8-6bc768c1669d could not be found. Jun 22 10:22:14.116609 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi Jun 22 10:22:14.116609 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 10:22:14.116609 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi Jun 22 10:22:14.116609 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:22:14.116609 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 10:22:14.116609 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 10:22:14.116609 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 10:22:14.116609 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 10:22:14.116609 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 10:22:14.118064 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 10:22:14.118064 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 22 10:22:14.118064 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 22 10:22:14.118064 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 22 10:22:14.118064 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 22 10:22:14.118064 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 22 10:22:14.118064 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 22 10:22:14.118064 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance edabe652-f189-4feb-89b8-6bc768c1669d could not be found. Jun 22 10:22:14.118064 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi Jun 22 10:22:14.118064 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 10:22:14.118064 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi Jun 22 10:22:14.118064 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:22:14.118064 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 10:22:14.118064 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 10:22:14.118064 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 10:22:14.118064 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 10:22:14.118064 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance edabe652-f189-4feb-89b8-6bc768c1669d could not be found. Jun 22 10:22:14.118064 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi Jun 22 10:22:14.119393 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-a36b7437-a203-4f9f-94c9-6d5aadc2c5d0 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Returning 404 to user: Instance edabe652-f189-4feb-89b8-6bc768c1669d could not be found. {{(pid=117874) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 10:22:14.119393 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [None req-a36b7437-a203-4f9f-94c9-6d5aadc2c5d0 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] 10.222.0.43 "GET /compute/v2.1/servers/edabe652-f189-4feb-89b8-6bc768c1669d" status: 404 len: 111 microversion: 2.1 time: 0.033559 Jun 22 10:22:14.119639 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 413/818] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:22:14 2022] GET /compute/v2.1/servers/edabe652-f189-4feb-89b8-6bc768c1669d => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 22 10:22:14.127691 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-c16f0bea-9d7e-4635-8ef9-5704664d47a6 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Calling method '.version_select at 0x7f36be3a2a60>' {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:22:14.147280 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [None req-c16f0bea-9d7e-4635-8ef9-5704664d47a6 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] 10.222.0.43 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-282820695" status: 202 len: 0 microversion: 2.1 time: 0.025344 Jun 22 10:22:14.148437 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 406/819] 10.222.0.43 () {58 vars in 1217 bytes} [Wed Jun 22 10:22:14 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-282820695 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 22 10:22:19.204169 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-11b40134-1335-46df-b128-e2e92a1aa3c5 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Calling method '>' {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:22:19.204668 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.compute.api [None req-11b40134-1335-46df-b128-e2e92a1aa3c5 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] [instance: edabe652-f189-4feb-89b8-6bc768c1669d] Fetching instance by UUID {{(pid=117874) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:22:19.211264 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-11b40134-1335-46df-b128-e2e92a1aa3c5 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:22:19.211705 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-11b40134-1335-46df-b128-e2e92a1aa3c5 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:22:19.212460 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-11b40134-1335-46df-b128-e2e92a1aa3c5 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:22:19.212885 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-11b40134-1335-46df-b128-e2e92a1aa3c5 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:22:19.227148 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.wsgi [None req-11b40134-1335-46df-b128-e2e92a1aa3c5 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] HTTP exception thrown: Instance edabe652-f189-4feb-89b8-6bc768c1669d could not be found. Jun 22 10:22:19.228671 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-11b40134-1335-46df-b128-e2e92a1aa3c5 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Request method failure captured: Jun 22 10:22:19.228671 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: request: DELETE /compute/v2.1/servers/edabe652-f189-4feb-89b8-6bc768c1669d HTTP/1.1 Jun 22 10:22:19.228671 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: Accept: application/json Jun 22 10:22:19.228671 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: Accept-Encoding: identity Jun 22 10:22:19.228671 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: Connection: close Jun 22 10:22:19.228671 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: Content-Length: 0 Jun 22 10:22:19.228671 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: Content-Type: application/json Jun 22 10:22:19.228671 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: Host: 10.222.0.43 Jun 22 10:22:19.228671 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: Openstack-System-Scope: None Jun 22 10:22:19.228671 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: User-Agent: python-urllib3/1.26.9 Jun 22 10:22:19.228671 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-Auth-Token: gAAAAABisuvm1HC5vURYGMHfhINNIY8dTNOSFMPEl0C8lmgixL-5gwhHJAyz_bxTDEMKLYHp_kBtrSYxzku6NejXNaLgya7bmqZ35QgSXSflYBmbpUiQTFVxrG4p6pERG6W27K0HsTOZ4plGpZPukHTNXTIrCder10qUDxudU2mAH2u7vnZVtg8 Jun 22 10:22:19.228671 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-Domain-Id: None Jun 22 10:22:19.228671 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-Domain-Name: None Jun 22 10:22:19.228671 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-Identity-Status: Confirmed Jun 22 10:22:19.228671 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-Is-Admin-Project: True Jun 22 10:22:19.228671 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-Project-Domain-Id: default Jun 22 10:22:19.228671 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-Project-Domain-Name: Default Jun 22 10:22:19.228671 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-Project-Id: ad52333bcbec425089c44c3e55df97ff Jun 22 10:22:19.228671 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-Project-Name: tempest-AttachVolumeTestJSON-1901268930 Jun 22 10:22:19.228671 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-Role: reader,member Jun 22 10:22:19.228671 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-Roles: reader,member Jun 22 10:22:19.230276 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/ad52333bcbec425089c44c3e55df97ff"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/ad52333bcbec425089c44c3e55df97ff"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_ad52333bcbec425089c44c3e55df97ff", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/ad52333bcbec425089c44c3e55df97ff"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}] Jun 22 10:22:19.230276 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-Tenant: tempest-AttachVolumeTestJSON-1901268930 Jun 22 10:22:19.230276 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-Tenant-Id: ad52333bcbec425089c44c3e55df97ff Jun 22 10:22:19.230276 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1901268930 Jun 22 10:22:19.230276 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-User: tempest-AttachVolumeTestJSON-1901268930-project Jun 22 10:22:19.230276 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-User-Domain-Id: default Jun 22 10:22:19.230276 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-User-Domain-Name: Default Jun 22 10:22:19.230276 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-User-Id: 78fe3fc4334c43d7a5ef6d70f9f57523 Jun 22 10:22:19.230276 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-User-Name: tempest-AttachVolumeTestJSON-1901268930-project Jun 22 10:22:19.230276 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: method: > Jun 22 10:22:19.230276 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: exception: Instance edabe652-f189-4feb-89b8-6bc768c1669d could not be found. Jun 22 10:22:19.230276 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: action_args: {'id': 'edabe652-f189-4feb-89b8-6bc768c1669d'} Jun 22 10:22:19.233954 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 10:22:19.233954 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:22:19.233954 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 22 10:22:19.233954 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 22 10:22:19.233954 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 22 10:22:19.233954 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 22 10:22:19.233954 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 22 10:22:19.233954 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 22 10:22:19.233954 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 22 10:22:19.233954 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 22 10:22:19.233954 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance edabe652-f189-4feb-89b8-6bc768c1669d could not be found. Jun 22 10:22:19.233954 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi Jun 22 10:22:19.233954 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 10:22:19.233954 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi Jun 22 10:22:19.233954 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:22:19.233954 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 10:22:19.233954 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 10:22:19.233954 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 10:22:19.233954 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 10:22:19.233954 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 10:22:19.235326 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 10:22:19.235326 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 22 10:22:19.235326 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 22 10:22:19.235326 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 22 10:22:19.235326 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 22 10:22:19.235326 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 22 10:22:19.235326 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 22 10:22:19.235326 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 22 10:22:19.235326 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 22 10:22:19.235326 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance edabe652-f189-4feb-89b8-6bc768c1669d could not be found. Jun 22 10:22:19.235326 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi Jun 22 10:22:19.235326 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 10:22:19.235326 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi Jun 22 10:22:19.235326 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:22:19.235326 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 10:22:19.235326 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 10:22:19.235326 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 10:22:19.235326 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 10:22:19.235326 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance edabe652-f189-4feb-89b8-6bc768c1669d could not be found. Jun 22 10:22:19.235326 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi Jun 22 10:22:19.236836 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-11b40134-1335-46df-b128-e2e92a1aa3c5 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Returning 404 to user: Instance edabe652-f189-4feb-89b8-6bc768c1669d could not be found. {{(pid=117874) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 10:22:19.236836 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [None req-11b40134-1335-46df-b128-e2e92a1aa3c5 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] 10.222.0.43 "DELETE /compute/v2.1/servers/edabe652-f189-4feb-89b8-6bc768c1669d" status: 404 len: 111 microversion: 2.1 time: 0.030803 Jun 22 10:22:19.236836 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 414/820] 10.222.0.43 () {58 vars in 1238 bytes} [Wed Jun 22 10:22:19 2022] DELETE /compute/v2.1/servers/edabe652-f189-4feb-89b8-6bc768c1669d => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 22 10:22:19.239543 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-0c2e6ebb-c873-4221-901d-78d9e78c7b7d tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Calling method '>' {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:22:19.240264 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.compute.api [None req-0c2e6ebb-c873-4221-901d-78d9e78c7b7d tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] [instance: edabe652-f189-4feb-89b8-6bc768c1669d] Fetching instance by UUID {{(pid=117873) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:22:19.246500 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-0c2e6ebb-c873-4221-901d-78d9e78c7b7d tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:22:19.246940 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-0c2e6ebb-c873-4221-901d-78d9e78c7b7d tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:22:19.247696 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-0c2e6ebb-c873-4221-901d-78d9e78c7b7d tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:22:19.248128 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-0c2e6ebb-c873-4221-901d-78d9e78c7b7d tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:22:19.262160 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.wsgi [None req-0c2e6ebb-c873-4221-901d-78d9e78c7b7d tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] HTTP exception thrown: Instance edabe652-f189-4feb-89b8-6bc768c1669d could not be found. Jun 22 10:22:19.263823 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-0c2e6ebb-c873-4221-901d-78d9e78c7b7d tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Request method failure captured: Jun 22 10:22:19.263823 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: request: GET /compute/v2.1/servers/edabe652-f189-4feb-89b8-6bc768c1669d HTTP/1.1 Jun 22 10:22:19.263823 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: Accept: application/json Jun 22 10:22:19.263823 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: Accept-Encoding: identity Jun 22 10:22:19.263823 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: Connection: close Jun 22 10:22:19.263823 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: Content-Length: 0 Jun 22 10:22:19.263823 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: Content-Type: application/json Jun 22 10:22:19.263823 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: Host: 10.222.0.43 Jun 22 10:22:19.263823 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: Openstack-System-Scope: None Jun 22 10:22:19.263823 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: User-Agent: python-urllib3/1.26.9 Jun 22 10:22:19.263823 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-Auth-Token: gAAAAABisuvm1HC5vURYGMHfhINNIY8dTNOSFMPEl0C8lmgixL-5gwhHJAyz_bxTDEMKLYHp_kBtrSYxzku6NejXNaLgya7bmqZ35QgSXSflYBmbpUiQTFVxrG4p6pERG6W27K0HsTOZ4plGpZPukHTNXTIrCder10qUDxudU2mAH2u7vnZVtg8 Jun 22 10:22:19.263823 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-Domain-Id: None Jun 22 10:22:19.263823 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-Domain-Name: None Jun 22 10:22:19.263823 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-Identity-Status: Confirmed Jun 22 10:22:19.263823 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-Is-Admin-Project: True Jun 22 10:22:19.263823 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-Project-Domain-Id: default Jun 22 10:22:19.263823 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-Project-Domain-Name: Default Jun 22 10:22:19.263823 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-Project-Id: ad52333bcbec425089c44c3e55df97ff Jun 22 10:22:19.263823 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-Project-Name: tempest-AttachVolumeTestJSON-1901268930 Jun 22 10:22:19.263823 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-Role: reader,member Jun 22 10:22:19.263823 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-Roles: reader,member Jun 22 10:22:19.266134 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/ad52333bcbec425089c44c3e55df97ff"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/ad52333bcbec425089c44c3e55df97ff"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_ad52333bcbec425089c44c3e55df97ff", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/ad52333bcbec425089c44c3e55df97ff"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}] Jun 22 10:22:19.266134 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-Tenant: tempest-AttachVolumeTestJSON-1901268930 Jun 22 10:22:19.266134 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-Tenant-Id: ad52333bcbec425089c44c3e55df97ff Jun 22 10:22:19.266134 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1901268930 Jun 22 10:22:19.266134 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-User: tempest-AttachVolumeTestJSON-1901268930-project Jun 22 10:22:19.266134 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-User-Domain-Id: default Jun 22 10:22:19.266134 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-User-Domain-Name: Default Jun 22 10:22:19.266134 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-User-Id: 78fe3fc4334c43d7a5ef6d70f9f57523 Jun 22 10:22:19.266134 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-User-Name: tempest-AttachVolumeTestJSON-1901268930-project Jun 22 10:22:19.266134 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: method: > Jun 22 10:22:19.266134 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: exception: Instance edabe652-f189-4feb-89b8-6bc768c1669d could not be found. Jun 22 10:22:19.266134 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: action_args: {'id': 'edabe652-f189-4feb-89b8-6bc768c1669d'} Jun 22 10:22:19.267220 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 10:22:19.267220 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:22:19.267220 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 22 10:22:19.267220 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 22 10:22:19.267220 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 22 10:22:19.267220 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 22 10:22:19.267220 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 22 10:22:19.267220 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 22 10:22:19.267220 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 22 10:22:19.267220 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 22 10:22:19.267220 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance edabe652-f189-4feb-89b8-6bc768c1669d could not be found. Jun 22 10:22:19.267220 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi Jun 22 10:22:19.267220 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 10:22:19.267220 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi Jun 22 10:22:19.267220 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:22:19.267220 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 10:22:19.267220 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 10:22:19.267220 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 10:22:19.267220 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 10:22:19.267220 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 10:22:19.268522 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 10:22:19.268522 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 22 10:22:19.268522 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 22 10:22:19.268522 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 22 10:22:19.268522 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 22 10:22:19.268522 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 22 10:22:19.268522 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 22 10:22:19.268522 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance edabe652-f189-4feb-89b8-6bc768c1669d could not be found. Jun 22 10:22:19.268522 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi Jun 22 10:22:19.268522 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 10:22:19.268522 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi Jun 22 10:22:19.268522 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:22:19.268522 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 10:22:19.268522 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 10:22:19.268522 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 10:22:19.268522 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 10:22:19.268522 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance edabe652-f189-4feb-89b8-6bc768c1669d could not be found. Jun 22 10:22:19.268522 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi Jun 22 10:22:19.269769 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-0c2e6ebb-c873-4221-901d-78d9e78c7b7d tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Returning 404 to user: Instance edabe652-f189-4feb-89b8-6bc768c1669d could not be found. {{(pid=117873) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 10:22:19.269769 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [None req-0c2e6ebb-c873-4221-901d-78d9e78c7b7d tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] 10.222.0.43 "GET /compute/v2.1/servers/edabe652-f189-4feb-89b8-6bc768c1669d" status: 404 len: 111 microversion: 2.1 time: 0.031206 Jun 22 10:22:19.269769 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 407/821] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:22:19 2022] GET /compute/v2.1/servers/edabe652-f189-4feb-89b8-6bc768c1669d => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 22 10:22:20.407414 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-4eac50c9-1b03-465e-be1d-90017e180d57 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Calling method '>' {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:22:20.407945 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.compute.api [None req-4eac50c9-1b03-465e-be1d-90017e180d57 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] [instance: eb851ab6-0e89-41d2-be52-d76cdc8644d6] Fetching instance by UUID {{(pid=117874) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:22:20.414448 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-4eac50c9-1b03-465e-be1d-90017e180d57 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:22:20.414898 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-4eac50c9-1b03-465e-be1d-90017e180d57 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:22:20.415659 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-4eac50c9-1b03-465e-be1d-90017e180d57 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:22:20.416095 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-4eac50c9-1b03-465e-be1d-90017e180d57 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:22:20.430748 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.wsgi [None req-4eac50c9-1b03-465e-be1d-90017e180d57 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] HTTP exception thrown: Instance eb851ab6-0e89-41d2-be52-d76cdc8644d6 could not be found. Jun 22 10:22:20.432303 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-4eac50c9-1b03-465e-be1d-90017e180d57 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Request method failure captured: Jun 22 10:22:20.432303 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: request: DELETE /compute/v2.1/servers/eb851ab6-0e89-41d2-be52-d76cdc8644d6 HTTP/1.1 Jun 22 10:22:20.432303 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: Accept: application/json Jun 22 10:22:20.432303 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: Accept-Encoding: identity Jun 22 10:22:20.432303 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: Connection: close Jun 22 10:22:20.432303 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: Content-Length: 0 Jun 22 10:22:20.432303 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: Content-Type: application/json Jun 22 10:22:20.432303 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: Host: 10.222.0.43 Jun 22 10:22:20.432303 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: Openstack-System-Scope: None Jun 22 10:22:20.432303 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: User-Agent: python-urllib3/1.26.9 Jun 22 10:22:20.432303 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-Auth-Token: gAAAAABisuvm1HC5vURYGMHfhINNIY8dTNOSFMPEl0C8lmgixL-5gwhHJAyz_bxTDEMKLYHp_kBtrSYxzku6NejXNaLgya7bmqZ35QgSXSflYBmbpUiQTFVxrG4p6pERG6W27K0HsTOZ4plGpZPukHTNXTIrCder10qUDxudU2mAH2u7vnZVtg8 Jun 22 10:22:20.432303 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-Domain-Id: None Jun 22 10:22:20.432303 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-Domain-Name: None Jun 22 10:22:20.432303 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-Identity-Status: Confirmed Jun 22 10:22:20.432303 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-Is-Admin-Project: True Jun 22 10:22:20.432303 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-Project-Domain-Id: default Jun 22 10:22:20.432303 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-Project-Domain-Name: Default Jun 22 10:22:20.432303 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-Project-Id: ad52333bcbec425089c44c3e55df97ff Jun 22 10:22:20.432303 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-Project-Name: tempest-AttachVolumeTestJSON-1901268930 Jun 22 10:22:20.432303 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-Role: reader,member Jun 22 10:22:20.432303 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-Roles: reader,member Jun 22 10:22:20.433810 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/ad52333bcbec425089c44c3e55df97ff"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/ad52333bcbec425089c44c3e55df97ff"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_ad52333bcbec425089c44c3e55df97ff", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/ad52333bcbec425089c44c3e55df97ff"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}] Jun 22 10:22:20.433810 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-Tenant: tempest-AttachVolumeTestJSON-1901268930 Jun 22 10:22:20.433810 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-Tenant-Id: ad52333bcbec425089c44c3e55df97ff Jun 22 10:22:20.433810 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1901268930 Jun 22 10:22:20.433810 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-User: tempest-AttachVolumeTestJSON-1901268930-project Jun 22 10:22:20.433810 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-User-Domain-Id: default Jun 22 10:22:20.433810 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-User-Domain-Name: Default Jun 22 10:22:20.433810 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-User-Id: 78fe3fc4334c43d7a5ef6d70f9f57523 Jun 22 10:22:20.433810 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-User-Name: tempest-AttachVolumeTestJSON-1901268930-project Jun 22 10:22:20.433810 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: method: > Jun 22 10:22:20.433810 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: exception: Instance eb851ab6-0e89-41d2-be52-d76cdc8644d6 could not be found. Jun 22 10:22:20.433810 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: action_args: {'id': 'eb851ab6-0e89-41d2-be52-d76cdc8644d6'} Jun 22 10:22:20.434664 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 10:22:20.434664 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:22:20.434664 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 22 10:22:20.434664 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 22 10:22:20.434664 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 22 10:22:20.434664 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 22 10:22:20.434664 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 22 10:22:20.434664 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 22 10:22:20.434664 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 22 10:22:20.434664 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 22 10:22:20.434664 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eb851ab6-0e89-41d2-be52-d76cdc8644d6 could not be found. Jun 22 10:22:20.434664 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi Jun 22 10:22:20.434664 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 10:22:20.434664 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi Jun 22 10:22:20.434664 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:22:20.434664 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 10:22:20.434664 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 10:22:20.434664 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 10:22:20.434664 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 10:22:20.434664 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 10:22:20.436045 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 10:22:20.436045 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 22 10:22:20.436045 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 22 10:22:20.436045 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 22 10:22:20.436045 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 22 10:22:20.436045 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 22 10:22:20.436045 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 22 10:22:20.436045 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 22 10:22:20.436045 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 22 10:22:20.436045 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eb851ab6-0e89-41d2-be52-d76cdc8644d6 could not be found. Jun 22 10:22:20.436045 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi Jun 22 10:22:20.436045 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 10:22:20.436045 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi Jun 22 10:22:20.436045 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:22:20.436045 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 10:22:20.436045 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 10:22:20.436045 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 10:22:20.436045 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 10:22:20.436045 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eb851ab6-0e89-41d2-be52-d76cdc8644d6 could not be found. Jun 22 10:22:20.436045 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi Jun 22 10:22:20.437840 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-4eac50c9-1b03-465e-be1d-90017e180d57 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Returning 404 to user: Instance eb851ab6-0e89-41d2-be52-d76cdc8644d6 could not be found. {{(pid=117874) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 10:22:20.437840 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [None req-4eac50c9-1b03-465e-be1d-90017e180d57 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] 10.222.0.43 "DELETE /compute/v2.1/servers/eb851ab6-0e89-41d2-be52-d76cdc8644d6" status: 404 len: 111 microversion: 2.1 time: 0.031288 Jun 22 10:22:20.437840 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 415/822] 10.222.0.43 () {58 vars in 1238 bytes} [Wed Jun 22 10:22:20 2022] DELETE /compute/v2.1/servers/eb851ab6-0e89-41d2-be52-d76cdc8644d6 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 22 10:22:20.442800 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-d79296b0-8b12-4253-b9d5-01be100c47b2 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Calling method '>' {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:22:20.443408 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.compute.api [None req-d79296b0-8b12-4253-b9d5-01be100c47b2 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] [instance: eb851ab6-0e89-41d2-be52-d76cdc8644d6] Fetching instance by UUID {{(pid=117873) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:22:20.449913 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-d79296b0-8b12-4253-b9d5-01be100c47b2 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:22:20.450362 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-d79296b0-8b12-4253-b9d5-01be100c47b2 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:22:20.451116 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-d79296b0-8b12-4253-b9d5-01be100c47b2 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:22:20.451549 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-d79296b0-8b12-4253-b9d5-01be100c47b2 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:22:20.465042 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.wsgi [None req-d79296b0-8b12-4253-b9d5-01be100c47b2 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] HTTP exception thrown: Instance eb851ab6-0e89-41d2-be52-d76cdc8644d6 could not be found. Jun 22 10:22:20.466591 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-d79296b0-8b12-4253-b9d5-01be100c47b2 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Request method failure captured: Jun 22 10:22:20.466591 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: request: GET /compute/v2.1/servers/eb851ab6-0e89-41d2-be52-d76cdc8644d6 HTTP/1.1 Jun 22 10:22:20.466591 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: Accept: application/json Jun 22 10:22:20.466591 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: Accept-Encoding: identity Jun 22 10:22:20.466591 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: Connection: close Jun 22 10:22:20.466591 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: Content-Length: 0 Jun 22 10:22:20.466591 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: Content-Type: application/json Jun 22 10:22:20.466591 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: Host: 10.222.0.43 Jun 22 10:22:20.466591 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: Openstack-System-Scope: None Jun 22 10:22:20.466591 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: User-Agent: python-urllib3/1.26.9 Jun 22 10:22:20.466591 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-Auth-Token: gAAAAABisuvm1HC5vURYGMHfhINNIY8dTNOSFMPEl0C8lmgixL-5gwhHJAyz_bxTDEMKLYHp_kBtrSYxzku6NejXNaLgya7bmqZ35QgSXSflYBmbpUiQTFVxrG4p6pERG6W27K0HsTOZ4plGpZPukHTNXTIrCder10qUDxudU2mAH2u7vnZVtg8 Jun 22 10:22:20.466591 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-Domain-Id: None Jun 22 10:22:20.466591 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-Domain-Name: None Jun 22 10:22:20.466591 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-Identity-Status: Confirmed Jun 22 10:22:20.466591 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-Is-Admin-Project: True Jun 22 10:22:20.466591 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-Project-Domain-Id: default Jun 22 10:22:20.466591 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-Project-Domain-Name: Default Jun 22 10:22:20.466591 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-Project-Id: ad52333bcbec425089c44c3e55df97ff Jun 22 10:22:20.466591 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-Project-Name: tempest-AttachVolumeTestJSON-1901268930 Jun 22 10:22:20.466591 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-Role: reader,member Jun 22 10:22:20.466591 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-Roles: reader,member Jun 22 10:22:20.468693 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/ad52333bcbec425089c44c3e55df97ff"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/ad52333bcbec425089c44c3e55df97ff"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_ad52333bcbec425089c44c3e55df97ff", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/ad52333bcbec425089c44c3e55df97ff"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}] Jun 22 10:22:20.468693 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-Tenant: tempest-AttachVolumeTestJSON-1901268930 Jun 22 10:22:20.468693 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-Tenant-Id: ad52333bcbec425089c44c3e55df97ff Jun 22 10:22:20.468693 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1901268930 Jun 22 10:22:20.468693 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-User: tempest-AttachVolumeTestJSON-1901268930-project Jun 22 10:22:20.468693 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-User-Domain-Id: default Jun 22 10:22:20.468693 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-User-Domain-Name: Default Jun 22 10:22:20.468693 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-User-Id: 78fe3fc4334c43d7a5ef6d70f9f57523 Jun 22 10:22:20.468693 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-User-Name: tempest-AttachVolumeTestJSON-1901268930-project Jun 22 10:22:20.468693 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: method: > Jun 22 10:22:20.468693 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: exception: Instance eb851ab6-0e89-41d2-be52-d76cdc8644d6 could not be found. Jun 22 10:22:20.468693 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: action_args: {'id': 'eb851ab6-0e89-41d2-be52-d76cdc8644d6'} Jun 22 10:22:20.469560 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 10:22:20.469560 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:22:20.469560 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 22 10:22:20.469560 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 22 10:22:20.469560 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 22 10:22:20.469560 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 22 10:22:20.469560 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 22 10:22:20.469560 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 22 10:22:20.469560 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 22 10:22:20.469560 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 22 10:22:20.469560 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eb851ab6-0e89-41d2-be52-d76cdc8644d6 could not be found. Jun 22 10:22:20.469560 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi Jun 22 10:22:20.469560 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 10:22:20.469560 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi Jun 22 10:22:20.469560 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:22:20.469560 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 10:22:20.469560 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 10:22:20.469560 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 10:22:20.469560 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 10:22:20.469560 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 10:22:20.471005 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 10:22:20.471005 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 22 10:22:20.471005 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 22 10:22:20.471005 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 22 10:22:20.471005 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 22 10:22:20.471005 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 22 10:22:20.471005 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 22 10:22:20.471005 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eb851ab6-0e89-41d2-be52-d76cdc8644d6 could not be found. Jun 22 10:22:20.471005 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi Jun 22 10:22:20.471005 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 10:22:20.471005 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi Jun 22 10:22:20.471005 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:22:20.471005 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 10:22:20.471005 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 10:22:20.471005 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 10:22:20.471005 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 10:22:20.471005 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eb851ab6-0e89-41d2-be52-d76cdc8644d6 could not be found. Jun 22 10:22:20.471005 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi Jun 22 10:22:20.472248 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-d79296b0-8b12-4253-b9d5-01be100c47b2 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] Returning 404 to user: Instance eb851ab6-0e89-41d2-be52-d76cdc8644d6 could not be found. {{(pid=117873) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 10:22:20.472248 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [None req-d79296b0-8b12-4253-b9d5-01be100c47b2 tempest-AttachVolumeTestJSON-1901268930 tempest-AttachVolumeTestJSON-1901268930-project] 10.222.0.43 "GET /compute/v2.1/servers/eb851ab6-0e89-41d2-be52-d76cdc8644d6" status: 404 len: 111 microversion: 2.1 time: 0.029058 Jun 22 10:22:20.472248 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 408/823] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:22:20 2022] GET /compute/v2.1/servers/eb851ab6-0e89-41d2-be52-d76cdc8644d6 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 22 10:22:24.207138 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-030757ad-0268-4c3e-9295-a5cbe3790cf1 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Calling method '>' {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:22:24.208186 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.compute.api [None req-030757ad-0268-4c3e-9295-a5cbe3790cf1 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] [instance: b357b60f-93be-4898-a651-4a407a7dc490] Fetching instance by UUID {{(pid=117874) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:22:24.214689 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-030757ad-0268-4c3e-9295-a5cbe3790cf1 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:22:24.215327 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-030757ad-0268-4c3e-9295-a5cbe3790cf1 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:22:24.216232 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-030757ad-0268-4c3e-9295-a5cbe3790cf1 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:22:24.216718 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-030757ad-0268-4c3e-9295-a5cbe3790cf1 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:22:24.250901 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [None req-030757ad-0268-4c3e-9295-a5cbe3790cf1 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] 10.222.0.43 "GET /compute/v2.1/servers/b357b60f-93be-4898-a651-4a407a7dc490/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.048619 Jun 22 10:22:24.251465 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 416/824] 10.222.0.43 () {60 vars in 1342 bytes} [Wed Jun 22 10:22:24 2022] GET /compute/v2.1/servers/b357b60f-93be-4898-a651-4a407a7dc490/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:22:24.313055 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-21e1d37e-84a9-4107-a207-6ad60e48a157 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Calling method '>' {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:22:24.313612 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.compute.api [None req-21e1d37e-84a9-4107-a207-6ad60e48a157 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] [instance: b357b60f-93be-4898-a651-4a407a7dc490] Fetching instance by UUID {{(pid=117873) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:22:24.320199 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-21e1d37e-84a9-4107-a207-6ad60e48a157 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:22:24.320650 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-21e1d37e-84a9-4107-a207-6ad60e48a157 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:22:24.321418 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-21e1d37e-84a9-4107-a207-6ad60e48a157 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:22:24.321891 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-21e1d37e-84a9-4107-a207-6ad60e48a157 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:22:24.350173 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.compute.api [None req-21e1d37e-84a9-4107-a207-6ad60e48a157 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] [instance: b357b60f-93be-4898-a651-4a407a7dc490] Going to try to terminate instance {{(pid=117873) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 22 10:22:24.434962 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [None req-21e1d37e-84a9-4107-a207-6ad60e48a157 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] 10.222.0.43 "DELETE /compute/v2.1/servers/b357b60f-93be-4898-a651-4a407a7dc490" status: 204 len: 0 microversion: 2.20 time: 0.125492 Jun 22 10:22:24.435739 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 409/825] 10.222.0.43 () {60 vars in 1279 bytes} [Wed Jun 22 10:22:24 2022] DELETE /compute/v2.1/servers/b357b60f-93be-4898-a651-4a407a7dc490 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Jun 22 10:22:24.444509 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-6d14d05b-030c-4f7e-95fa-e8b01174ec8b tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Calling method '>' {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:22:24.445123 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.compute.api [None req-6d14d05b-030c-4f7e-95fa-e8b01174ec8b tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] [instance: b357b60f-93be-4898-a651-4a407a7dc490] Fetching instance by UUID {{(pid=117874) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:22:24.451301 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-6d14d05b-030c-4f7e-95fa-e8b01174ec8b tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:22:24.451759 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-6d14d05b-030c-4f7e-95fa-e8b01174ec8b tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:22:24.453390 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-6d14d05b-030c-4f7e-95fa-e8b01174ec8b tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:22:24.454112 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-6d14d05b-030c-4f7e-95fa-e8b01174ec8b tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:22:24.608133 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.policy [None req-6d14d05b-030c-4f7e-95fa-e8b01174ec8b tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75753b29a78640df9622d4e2655baf9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee9d603d9cc4a8797f55d544f189720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117874) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:22:24.617083 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.policy [None req-6d14d05b-030c-4f7e-95fa-e8b01174ec8b tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75753b29a78640df9622d4e2655baf9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee9d603d9cc4a8797f55d544f189720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117874) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:22:24.618626 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.policy [None req-6d14d05b-030c-4f7e-95fa-e8b01174ec8b tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75753b29a78640df9622d4e2655baf9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee9d603d9cc4a8797f55d544f189720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117874) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:22:24.619796 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [None req-6d14d05b-030c-4f7e-95fa-e8b01174ec8b tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] 10.222.0.43 "GET /compute/v2.1/servers/b357b60f-93be-4898-a651-4a407a7dc490" status: 200 len: 1721 microversion: 2.20 time: 0.179343 Jun 22 10:22:24.620668 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 417/826] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jun 22 10:22:24 2022] GET /compute/v2.1/servers/b357b60f-93be-4898-a651-4a407a7dc490 => generated 1721 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 10:22:25.639443 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-c328072f-cf17-41d1-b3f7-605aa05456d9 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Calling method '>' {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:22:25.640648 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.compute.api [None req-c328072f-cf17-41d1-b3f7-605aa05456d9 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] [instance: b357b60f-93be-4898-a651-4a407a7dc490] Fetching instance by UUID {{(pid=117873) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:22:25.646649 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-c328072f-cf17-41d1-b3f7-605aa05456d9 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:22:25.647091 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-c328072f-cf17-41d1-b3f7-605aa05456d9 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:22:25.647836 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-c328072f-cf17-41d1-b3f7-605aa05456d9 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:22:25.648263 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-c328072f-cf17-41d1-b3f7-605aa05456d9 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:22:25.787694 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.policy [None req-c328072f-cf17-41d1-b3f7-605aa05456d9 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75753b29a78640df9622d4e2655baf9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee9d603d9cc4a8797f55d544f189720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117873) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:22:25.795457 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.policy [None req-c328072f-cf17-41d1-b3f7-605aa05456d9 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75753b29a78640df9622d4e2655baf9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee9d603d9cc4a8797f55d544f189720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117873) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:22:25.797343 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.policy [None req-c328072f-cf17-41d1-b3f7-605aa05456d9 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75753b29a78640df9622d4e2655baf9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee9d603d9cc4a8797f55d544f189720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117873) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:22:25.798766 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [None req-c328072f-cf17-41d1-b3f7-605aa05456d9 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] 10.222.0.43 "GET /compute/v2.1/servers/b357b60f-93be-4898-a651-4a407a7dc490" status: 200 len: 1721 microversion: 2.20 time: 0.163702 Jun 22 10:22:25.799297 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 410/827] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jun 22 10:22:25 2022] GET /compute/v2.1/servers/b357b60f-93be-4898-a651-4a407a7dc490 => generated 1721 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 10:22:26.817117 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-7da3c79d-ef94-462e-86c6-448c807e0ed1 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Calling method '>' {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:22:26.818048 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.compute.api [None req-7da3c79d-ef94-462e-86c6-448c807e0ed1 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] [instance: b357b60f-93be-4898-a651-4a407a7dc490] Fetching instance by UUID {{(pid=117874) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:22:26.826006 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-7da3c79d-ef94-462e-86c6-448c807e0ed1 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:22:26.826502 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-7da3c79d-ef94-462e-86c6-448c807e0ed1 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:22:26.827917 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-7da3c79d-ef94-462e-86c6-448c807e0ed1 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:22:26.828557 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-7da3c79d-ef94-462e-86c6-448c807e0ed1 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:22:26.915132 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-f7298053-28e3-4990-9868-569127b08b90 tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] Calling method '>' {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:22:26.915717 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.compute.api [None req-f7298053-28e3-4990-9868-569127b08b90 tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] [instance: 28c617f3-3db0-484a-9d66-15fef4010ec4] Fetching instance by UUID {{(pid=117873) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:22:26.929864 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-f7298053-28e3-4990-9868-569127b08b90 tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:22:26.930571 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-f7298053-28e3-4990-9868-569127b08b90 tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:22:26.931466 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-f7298053-28e3-4990-9868-569127b08b90 tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:22:26.931911 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-f7298053-28e3-4990-9868-569127b08b90 tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:22:26.981579 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.compute.api [None req-f7298053-28e3-4990-9868-569127b08b90 tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] [instance: 28c617f3-3db0-484a-9d66-15fef4010ec4] Going to try to terminate instance {{(pid=117873) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 22 10:22:26.993648 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.policy [None req-7da3c79d-ef94-462e-86c6-448c807e0ed1 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75753b29a78640df9622d4e2655baf9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee9d603d9cc4a8797f55d544f189720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117874) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:22:27.007970 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.policy [None req-7da3c79d-ef94-462e-86c6-448c807e0ed1 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75753b29a78640df9622d4e2655baf9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee9d603d9cc4a8797f55d544f189720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117874) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:22:27.011109 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.policy [None req-7da3c79d-ef94-462e-86c6-448c807e0ed1 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75753b29a78640df9622d4e2655baf9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee9d603d9cc4a8797f55d544f189720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117874) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:22:27.012298 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [None req-7da3c79d-ef94-462e-86c6-448c807e0ed1 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] 10.222.0.43 "GET /compute/v2.1/servers/b357b60f-93be-4898-a651-4a407a7dc490" status: 200 len: 1654 microversion: 2.20 time: 0.199912 Jun 22 10:22:27.012971 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 418/828] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jun 22 10:22:26 2022] GET /compute/v2.1/servers/b357b60f-93be-4898-a651-4a407a7dc490 => generated 1654 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 10:22:27.060496 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [req-efbad370-b3ce-4864-a4f5-fef1c6bd6640 req-3fc5e38a-4bd9-47ce-8d0a-961ce2dde321 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b357b60f-93be-4898-a651-4a407a7dc490", "name": "network-vif-deleted", "tag": "41dc4ae0-ddcc-4582-8858-4f23e4695e4a"}]} {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:22:27.074233 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [req-efbad370-b3ce-4864-a4f5-fef1c6bd6640 req-3fc5e38a-4bd9-47ce-8d0a-961ce2dde321 service nova] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:22:27.074684 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [req-efbad370-b3ce-4864-a4f5-fef1c6bd6640 req-3fc5e38a-4bd9-47ce-8d0a-961ce2dde321 service nova] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:22:27.094932 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.compute.server_external_events [req-efbad370-b3ce-4864-a4f5-fef1c6bd6640 req-3fc5e38a-4bd9-47ce-8d0a-961ce2dde321 service nova] Creating event network-vif-deleted:41dc4ae0-ddcc-4582-8858-4f23e4695e4a for instance b357b60f-93be-4898-a651-4a407a7dc490 on hv-cinder-84713 Jun 22 10:22:27.102015 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [req-efbad370-b3ce-4864-a4f5-fef1c6bd6640 req-3fc5e38a-4bd9-47ce-8d0a-961ce2dde321 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045664 Jun 22 10:22:27.103636 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 419/829] 10.222.0.43 () {64 vars in 1317 bytes} [Wed Jun 22 10:22:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 22 10:22:27.118499 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [None req-f7298053-28e3-4990-9868-569127b08b90 tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] 10.222.0.43 "DELETE /compute/v2.1/servers/28c617f3-3db0-484a-9d66-15fef4010ec4" status: 204 len: 0 microversion: 2.1 time: 0.207552 Jun 22 10:22:27.119293 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 411/830] 10.222.0.43 () {58 vars in 1238 bytes} [Wed Jun 22 10:22:26 2022] DELETE /compute/v2.1/servers/28c617f3-3db0-484a-9d66-15fef4010ec4 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 22 10:22:27.128435 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-14c4376b-4457-45bb-91b1-c70ba13c98ad tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] Calling method '>' {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:22:27.130342 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.compute.api [None req-14c4376b-4457-45bb-91b1-c70ba13c98ad tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] [instance: 28c617f3-3db0-484a-9d66-15fef4010ec4] Fetching instance by UUID {{(pid=117874) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:22:27.146067 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-14c4376b-4457-45bb-91b1-c70ba13c98ad tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:22:27.146583 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-14c4376b-4457-45bb-91b1-c70ba13c98ad tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:22:27.147396 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-14c4376b-4457-45bb-91b1-c70ba13c98ad tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:22:27.147827 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-14c4376b-4457-45bb-91b1-c70ba13c98ad tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:22:27.471037 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.policy [None req-14c4376b-4457-45bb-91b1-c70ba13c98ad tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2d3aa18a0a146808f584127411a1cf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1af845e594466b12a11b7cab99a7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117874) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:22:27.480911 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [None req-14c4376b-4457-45bb-91b1-c70ba13c98ad tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] 10.222.0.43 "GET /compute/v2.1/servers/28c617f3-3db0-484a-9d66-15fef4010ec4" status: 200 len: 1578 microversion: 2.1 time: 0.356824 Jun 22 10:22:27.482538 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 420/831] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:22:27 2022] GET /compute/v2.1/servers/28c617f3-3db0-484a-9d66-15fef4010ec4 => generated 1578 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:22:28.033855 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-eeeab737-6f9c-4165-8c83-a54143a9136e tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Calling method '>' {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:22:28.035455 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.compute.api [None req-eeeab737-6f9c-4165-8c83-a54143a9136e tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] [instance: b357b60f-93be-4898-a651-4a407a7dc490] Fetching instance by UUID {{(pid=117873) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:22:28.046469 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-eeeab737-6f9c-4165-8c83-a54143a9136e tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:22:28.046921 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-eeeab737-6f9c-4165-8c83-a54143a9136e tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:22:28.047705 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-eeeab737-6f9c-4165-8c83-a54143a9136e tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:22:28.048148 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-eeeab737-6f9c-4165-8c83-a54143a9136e tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:22:28.104219 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-eeeab737-6f9c-4165-8c83-a54143a9136e tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:22:28.104219 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-eeeab737-6f9c-4165-8c83-a54143a9136e tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:22:28.104219 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.objects.instance [None req-eeeab737-6f9c-4165-8c83-a54143a9136e tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lazy-loading 'fault' on Instance uuid b357b60f-93be-4898-a651-4a407a7dc490 {{(pid=117873) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 22 10:22:28.153472 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.policy [None req-eeeab737-6f9c-4165-8c83-a54143a9136e tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75753b29a78640df9622d4e2655baf9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee9d603d9cc4a8797f55d544f189720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117873) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:22:28.167026 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.policy [None req-eeeab737-6f9c-4165-8c83-a54143a9136e tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '75753b29a78640df9622d4e2655baf9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee9d603d9cc4a8797f55d544f189720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117873) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:22:28.169981 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.policy [None req-eeeab737-6f9c-4165-8c83-a54143a9136e tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '75753b29a78640df9622d4e2655baf9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee9d603d9cc4a8797f55d544f189720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117873) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:22:28.173257 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [None req-eeeab737-6f9c-4165-8c83-a54143a9136e tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] 10.222.0.43 "GET /compute/v2.1/servers/b357b60f-93be-4898-a651-4a407a7dc490" status: 200 len: 1369 microversion: 2.20 time: 0.144970 Jun 22 10:22:28.174614 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 412/832] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jun 22 10:22:28 2022] GET /compute/v2.1/servers/b357b60f-93be-4898-a651-4a407a7dc490 => generated 1369 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 10:22:28.500651 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-cd248d66-3f5f-4cc1-81e5-7f86b396b168 tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] Calling method '>' {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:22:28.502148 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.compute.api [None req-cd248d66-3f5f-4cc1-81e5-7f86b396b168 tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] [instance: 28c617f3-3db0-484a-9d66-15fef4010ec4] Fetching instance by UUID {{(pid=117874) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:22:28.521182 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-cd248d66-3f5f-4cc1-81e5-7f86b396b168 tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:22:28.521968 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-cd248d66-3f5f-4cc1-81e5-7f86b396b168 tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:22:28.522930 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-cd248d66-3f5f-4cc1-81e5-7f86b396b168 tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:22:28.523549 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-cd248d66-3f5f-4cc1-81e5-7f86b396b168 tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:22:28.694660 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.policy [None req-cd248d66-3f5f-4cc1-81e5-7f86b396b168 tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2d3aa18a0a146808f584127411a1cf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1af845e594466b12a11b7cab99a7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117874) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:22:28.704141 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [None req-cd248d66-3f5f-4cc1-81e5-7f86b396b168 tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] 10.222.0.43 "GET /compute/v2.1/servers/28c617f3-3db0-484a-9d66-15fef4010ec4" status: 200 len: 1578 microversion: 2.1 time: 0.208581 Jun 22 10:22:28.705319 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 421/833] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:22:28 2022] GET /compute/v2.1/servers/28c617f3-3db0-484a-9d66-15fef4010ec4 => generated 1578 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:22:29.192133 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-e75a21f5-9712-4fbd-9ca2-bcae13bccf2e tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Calling method '>' {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:22:29.193821 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.compute.api [None req-e75a21f5-9712-4fbd-9ca2-bcae13bccf2e tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] [instance: b357b60f-93be-4898-a651-4a407a7dc490] Fetching instance by UUID {{(pid=117873) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:22:29.202932 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-e75a21f5-9712-4fbd-9ca2-bcae13bccf2e tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:22:29.203627 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-e75a21f5-9712-4fbd-9ca2-bcae13bccf2e tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:22:29.204475 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-e75a21f5-9712-4fbd-9ca2-bcae13bccf2e tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:22:29.205079 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-e75a21f5-9712-4fbd-9ca2-bcae13bccf2e tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:22:29.221960 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.wsgi [None req-e75a21f5-9712-4fbd-9ca2-bcae13bccf2e tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] HTTP exception thrown: Instance b357b60f-93be-4898-a651-4a407a7dc490 could not be found. Jun 22 10:22:29.223804 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-e75a21f5-9712-4fbd-9ca2-bcae13bccf2e tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Request method failure captured: Jun 22 10:22:29.223804 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: request: GET /compute/v2.1/servers/b357b60f-93be-4898-a651-4a407a7dc490 HTTP/1.1 Jun 22 10:22:29.223804 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: Accept: application/json Jun 22 10:22:29.223804 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: Accept-Encoding: identity Jun 22 10:22:29.223804 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: Connection: close Jun 22 10:22:29.223804 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: Content-Length: 0 Jun 22 10:22:29.223804 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: Content-Type: application/json Jun 22 10:22:29.223804 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: Host: 10.222.0.43 Jun 22 10:22:29.223804 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: Openstack-System-Scope: None Jun 22 10:22:29.223804 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: User-Agent: python-urllib3/1.26.9 Jun 22 10:22:29.223804 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-Auth-Token: gAAAAABisuvYS2CXj8gCG7Yc42bXsdyTNZGez3H7ko4foQwezMJLTIf_Gnp6Bb6FBbV0UL-h7nopQ4Zbjw32tlioI-fzkdCmRzFS-ECXrTtuGF0yr0Jygcyn8ziPm4NY4mS70dt4GHZiefYTRmBJ0pCpEOrQP-y8Yi9B62jLLANooAtVTJOUQzg Jun 22 10:22:29.223804 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-Domain-Id: None Jun 22 10:22:29.223804 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-Domain-Name: None Jun 22 10:22:29.223804 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-Identity-Status: Confirmed Jun 22 10:22:29.223804 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-Is-Admin-Project: True Jun 22 10:22:29.223804 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-Openstack-Nova-Api-Version: 2.20 Jun 22 10:22:29.223804 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-Project-Domain-Id: default Jun 22 10:22:29.223804 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-Project-Domain-Name: Default Jun 22 10:22:29.223804 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-Project-Id: 5ee9d603d9cc4a8797f55d544f189720 Jun 22 10:22:29.223804 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1985965461 Jun 22 10:22:29.223804 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-Role: reader,member Jun 22 10:22:29.223804 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-Roles: reader,member Jun 22 10:22:29.225475 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/5ee9d603d9cc4a8797f55d544f189720"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/5ee9d603d9cc4a8797f55d544f189720"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_5ee9d603d9cc4a8797f55d544f189720", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/5ee9d603d9cc4a8797f55d544f189720"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}] Jun 22 10:22:29.225475 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1985965461 Jun 22 10:22:29.225475 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-Tenant-Id: 5ee9d603d9cc4a8797f55d544f189720 Jun 22 10:22:29.225475 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1985965461 Jun 22 10:22:29.225475 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-User: tempest-AttachVolumeShelveTestJSON-1985965461-project Jun 22 10:22:29.225475 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-User-Domain-Id: default Jun 22 10:22:29.225475 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-User-Domain-Name: Default Jun 22 10:22:29.225475 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-User-Id: 75753b29a78640df9622d4e2655baf9b Jun 22 10:22:29.225475 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1985965461-project Jun 22 10:22:29.225475 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: method: > Jun 22 10:22:29.225475 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: exception: Instance b357b60f-93be-4898-a651-4a407a7dc490 could not be found. Jun 22 10:22:29.225475 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: action_args: {'id': 'b357b60f-93be-4898-a651-4a407a7dc490'} Jun 22 10:22:29.226409 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 10:22:29.226409 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:22:29.226409 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 22 10:22:29.226409 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 22 10:22:29.226409 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 22 10:22:29.226409 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 22 10:22:29.226409 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 22 10:22:29.226409 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 22 10:22:29.226409 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 22 10:22:29.226409 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 22 10:22:29.226409 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b357b60f-93be-4898-a651-4a407a7dc490 could not be found. Jun 22 10:22:29.226409 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi Jun 22 10:22:29.226409 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 10:22:29.226409 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi Jun 22 10:22:29.226409 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:22:29.226409 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 10:22:29.226409 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 10:22:29.226409 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 10:22:29.226409 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 10:22:29.226409 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 10:22:29.227843 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 10:22:29.227843 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 22 10:22:29.227843 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 22 10:22:29.227843 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 22 10:22:29.227843 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 22 10:22:29.227843 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 22 10:22:29.227843 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 22 10:22:29.227843 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b357b60f-93be-4898-a651-4a407a7dc490 could not be found. Jun 22 10:22:29.227843 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi Jun 22 10:22:29.227843 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 10:22:29.227843 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi Jun 22 10:22:29.227843 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:22:29.227843 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 10:22:29.227843 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 10:22:29.227843 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 10:22:29.227843 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 10:22:29.227843 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b357b60f-93be-4898-a651-4a407a7dc490 could not be found. Jun 22 10:22:29.227843 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi Jun 22 10:22:29.230859 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-e75a21f5-9712-4fbd-9ca2-bcae13bccf2e tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Returning 404 to user: Instance b357b60f-93be-4898-a651-4a407a7dc490 could not be found. {{(pid=117873) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 10:22:29.232052 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [None req-e75a21f5-9712-4fbd-9ca2-bcae13bccf2e tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] 10.222.0.43 "GET /compute/v2.1/servers/b357b60f-93be-4898-a651-4a407a7dc490" status: 404 len: 111 microversion: 2.20 time: 0.043834 Jun 22 10:22:29.232832 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 413/834] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jun 22 10:22:29 2022] GET /compute/v2.1/servers/b357b60f-93be-4898-a651-4a407a7dc490 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 22 10:22:29.242491 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-ebab187e-9216-44a9-957f-1e7037284f7e tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Calling method '.version_select at 0x7f36bdb9f940>' {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:22:29.264317 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [None req-ebab187e-9216-44a9-957f-1e7037284f7e tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] 10.222.0.43 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-10225989" status: 204 len: 0 microversion: 2.20 time: 0.026022 Jun 22 10:22:29.266131 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 422/835] 10.222.0.43 () {60 vars in 1255 bytes} [Wed Jun 22 10:22:29 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-10225989 => generated 0 bytes in 28 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 22 10:22:29.722679 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-618515b5-26e4-42c3-9d89-c359ab73b932 tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] Calling method '>' {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:22:29.723290 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.compute.api [None req-618515b5-26e4-42c3-9d89-c359ab73b932 tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] [instance: 28c617f3-3db0-484a-9d66-15fef4010ec4] Fetching instance by UUID {{(pid=117873) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:22:29.732029 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-618515b5-26e4-42c3-9d89-c359ab73b932 tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:22:29.732684 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-618515b5-26e4-42c3-9d89-c359ab73b932 tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:22:29.735126 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-618515b5-26e4-42c3-9d89-c359ab73b932 tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:22:29.735775 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-618515b5-26e4-42c3-9d89-c359ab73b932 tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:22:29.864150 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [req-048f8d2b-4de9-4aab-89c9-8dd11b87c766 req-d1b4f6b0-e33a-47f5-85aa-7b6fb17ab8a0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "28c617f3-3db0-484a-9d66-15fef4010ec4", "name": "network-vif-deleted", "tag": "13d80eb1-6fcf-4d7d-864a-8e6485a20811"}]} {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:22:29.904389 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.policy [None req-618515b5-26e4-42c3-9d89-c359ab73b932 tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2d3aa18a0a146808f584127411a1cf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1af845e594466b12a11b7cab99a7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117873) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:22:29.910024 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG dbcounter [-] [117873] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=117873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:22:29.918764 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [None req-618515b5-26e4-42c3-9d89-c359ab73b932 tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] 10.222.0.43 "GET /compute/v2.1/servers/28c617f3-3db0-484a-9d66-15fef4010ec4" status: 200 len: 1510 microversion: 2.1 time: 0.199904 Jun 22 10:22:29.919855 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [req-048f8d2b-4de9-4aab-89c9-8dd11b87c766 req-d1b4f6b0-e33a-47f5-85aa-7b6fb17ab8a0 service nova] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:22:29.926297 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [req-048f8d2b-4de9-4aab-89c9-8dd11b87c766 req-d1b4f6b0-e33a-47f5-85aa-7b6fb17ab8a0 service nova] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:22:29.937537 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 414/836] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:22:29 2022] GET /compute/v2.1/servers/28c617f3-3db0-484a-9d66-15fef4010ec4 => generated 1510 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:22:29.967439 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.compute.server_external_events [req-048f8d2b-4de9-4aab-89c9-8dd11b87c766 req-d1b4f6b0-e33a-47f5-85aa-7b6fb17ab8a0 service nova] Creating event network-vif-deleted:13d80eb1-6fcf-4d7d-864a-8e6485a20811 for instance 28c617f3-3db0-484a-9d66-15fef4010ec4 on hv-cinder-84713 Jun 22 10:22:29.978598 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [req-048f8d2b-4de9-4aab-89c9-8dd11b87c766 req-d1b4f6b0-e33a-47f5-85aa-7b6fb17ab8a0 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.119838 Jun 22 10:22:29.981603 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 423/837] 10.222.0.43 () {64 vars in 1317 bytes} [Wed Jun 22 10:22:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 10:22:30.944422 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-79dbb93c-5817-4ba2-b156-c6b404113e6b tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] Calling method '>' {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:22:30.945603 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.compute.api [None req-79dbb93c-5817-4ba2-b156-c6b404113e6b tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] [instance: 28c617f3-3db0-484a-9d66-15fef4010ec4] Fetching instance by UUID {{(pid=117873) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:22:30.953777 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-79dbb93c-5817-4ba2-b156-c6b404113e6b tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:22:30.954295 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-79dbb93c-5817-4ba2-b156-c6b404113e6b tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:22:30.955060 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-79dbb93c-5817-4ba2-b156-c6b404113e6b tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:22:30.955496 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-79dbb93c-5817-4ba2-b156-c6b404113e6b tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:22:30.975868 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.wsgi [None req-79dbb93c-5817-4ba2-b156-c6b404113e6b tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] HTTP exception thrown: Instance 28c617f3-3db0-484a-9d66-15fef4010ec4 could not be found. Jun 22 10:22:30.977795 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-79dbb93c-5817-4ba2-b156-c6b404113e6b tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] Request method failure captured: Jun 22 10:22:30.977795 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: request: GET /compute/v2.1/servers/28c617f3-3db0-484a-9d66-15fef4010ec4 HTTP/1.1 Jun 22 10:22:30.977795 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: Accept: application/json Jun 22 10:22:30.977795 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: Accept-Encoding: identity Jun 22 10:22:30.977795 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: Connection: close Jun 22 10:22:30.977795 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: Content-Length: 0 Jun 22 10:22:30.977795 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: Content-Type: application/json Jun 22 10:22:30.977795 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: Host: 10.222.0.43 Jun 22 10:22:30.977795 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: Openstack-System-Scope: None Jun 22 10:22:30.977795 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: User-Agent: python-urllib3/1.26.9 Jun 22 10:22:30.977795 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-Auth-Token: gAAAAABisuy7PrqqyQesr95LVxly_fatV6so_rFauU71Lw0pOw-ec0qUNAiC-EM1bAwBV1rPBZdA7E7mV9Oe2uLSl52XJ9WLluPcBa8oGMYSVSd49ZrBqsF265LVYBKWbjX1LZSIWucQhbL7aKyV-q-u7AWOD1AY5xCUr3aEOBnlMEnzTVCOqVA Jun 22 10:22:30.977795 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-Domain-Id: None Jun 22 10:22:30.977795 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-Domain-Name: None Jun 22 10:22:30.977795 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-Identity-Status: Confirmed Jun 22 10:22:30.977795 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-Is-Admin-Project: True Jun 22 10:22:30.977795 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-Project-Domain-Id: default Jun 22 10:22:30.977795 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-Project-Domain-Name: Default Jun 22 10:22:30.977795 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-Project-Id: 1cb1af845e594466b12a11b7cab99a7c Jun 22 10:22:30.977795 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-Project-Name: tempest-TestVolumeBootPattern-1609151323 Jun 22 10:22:30.977795 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-Role: reader,member Jun 22 10:22:30.977795 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-Roles: reader,member Jun 22 10:22:30.979125 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/1cb1af845e594466b12a11b7cab99a7c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/1cb1af845e594466b12a11b7cab99a7c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_1cb1af845e594466b12a11b7cab99a7c", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/1cb1af845e594466b12a11b7cab99a7c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}] Jun 22 10:22:30.979125 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-Tenant: tempest-TestVolumeBootPattern-1609151323 Jun 22 10:22:30.979125 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-Tenant-Id: 1cb1af845e594466b12a11b7cab99a7c Jun 22 10:22:30.979125 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-Tenant-Name: tempest-TestVolumeBootPattern-1609151323 Jun 22 10:22:30.979125 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-User: tempest-TestVolumeBootPattern-1609151323-project Jun 22 10:22:30.979125 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-User-Domain-Id: default Jun 22 10:22:30.979125 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-User-Domain-Name: Default Jun 22 10:22:30.979125 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-User-Id: b2d3aa18a0a146808f584127411a1cf5 Jun 22 10:22:30.979125 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-User-Name: tempest-TestVolumeBootPattern-1609151323-project Jun 22 10:22:30.979125 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: method: > Jun 22 10:22:30.979125 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: exception: Instance 28c617f3-3db0-484a-9d66-15fef4010ec4 could not be found. Jun 22 10:22:30.979125 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: action_args: {'id': '28c617f3-3db0-484a-9d66-15fef4010ec4'} Jun 22 10:22:30.980058 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 10:22:30.980058 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:22:30.980058 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 22 10:22:30.980058 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 22 10:22:30.980058 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 22 10:22:30.980058 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 22 10:22:30.980058 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 22 10:22:30.980058 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 22 10:22:30.980058 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 22 10:22:30.980058 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 22 10:22:30.980058 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 28c617f3-3db0-484a-9d66-15fef4010ec4 could not be found. Jun 22 10:22:30.980058 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi Jun 22 10:22:30.980058 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 10:22:30.980058 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi Jun 22 10:22:30.980058 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:22:30.980058 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 10:22:30.980058 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 10:22:30.980058 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 10:22:30.980058 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 10:22:30.980058 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 10:22:30.981242 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 10:22:30.981242 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 22 10:22:30.981242 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 22 10:22:30.981242 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 22 10:22:30.981242 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 22 10:22:30.981242 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 22 10:22:30.981242 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 22 10:22:30.981242 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 28c617f3-3db0-484a-9d66-15fef4010ec4 could not be found. Jun 22 10:22:30.981242 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi Jun 22 10:22:30.981242 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 10:22:30.981242 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi Jun 22 10:22:30.981242 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:22:30.981242 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 10:22:30.981242 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 10:22:30.981242 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 10:22:30.981242 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 10:22:30.981242 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 28c617f3-3db0-484a-9d66-15fef4010ec4 could not be found. Jun 22 10:22:30.981242 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi Jun 22 10:22:30.982420 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-79dbb93c-5817-4ba2-b156-c6b404113e6b tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] Returning 404 to user: Instance 28c617f3-3db0-484a-9d66-15fef4010ec4 could not be found. {{(pid=117873) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 10:22:30.982420 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [None req-79dbb93c-5817-4ba2-b156-c6b404113e6b tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] 10.222.0.43 "GET /compute/v2.1/servers/28c617f3-3db0-484a-9d66-15fef4010ec4" status: 404 len: 111 microversion: 2.1 time: 0.038905 Jun 22 10:22:30.982420 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 415/838] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:22:30 2022] GET /compute/v2.1/servers/28c617f3-3db0-484a-9d66-15fef4010ec4 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 22 10:22:31.091021 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-6507edf3-4c53-4324-ab25-65904357143f tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1856447444", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1986835772", "security_groups": [{"name": "tempest-secgroup-smoke-1789065302"}], "block_device_mapping_v2": [{"uuid": "b9dd562c-2b45-41ba-8033-15ca2966df92", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "96156af8-0bc3-4b6c-bec6-429f61356c8a"}]}} {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:22:31.102876 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG dbcounter [-] [117874] Writing DB stats nova_api:SELECT=47,nova_api:DELETE=1 {{(pid=117874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:22:31.241916 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.network.neutron [None req-6507edf3-4c53-4324-ab25-65904357143f tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] validate_networks() for [('96156af8-0bc3-4b6c-bec6-429f61356c8a', None, None, None, None, None)] {{(pid=117874) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 22 10:22:31.582025 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-79eb8760-3adb-42e1-9541-7a97b861303f tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Calling method '>' {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:22:31.582698 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.compute.api [None req-79eb8760-3adb-42e1-9541-7a97b861303f tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] [instance: b357b60f-93be-4898-a651-4a407a7dc490] Fetching instance by UUID {{(pid=117873) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:22:31.590965 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-79eb8760-3adb-42e1-9541-7a97b861303f tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:22:31.591415 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-79eb8760-3adb-42e1-9541-7a97b861303f tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:22:31.592304 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-79eb8760-3adb-42e1-9541-7a97b861303f tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:22:31.592621 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-79eb8760-3adb-42e1-9541-7a97b861303f tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:22:31.608227 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.wsgi [None req-79eb8760-3adb-42e1-9541-7a97b861303f tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] HTTP exception thrown: Instance b357b60f-93be-4898-a651-4a407a7dc490 could not be found. Jun 22 10:22:31.609949 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-79eb8760-3adb-42e1-9541-7a97b861303f tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Request method failure captured: Jun 22 10:22:31.609949 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: request: DELETE /compute/v2.1/servers/b357b60f-93be-4898-a651-4a407a7dc490 HTTP/1.1 Jun 22 10:22:31.609949 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: Accept: application/json Jun 22 10:22:31.609949 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: Accept-Encoding: identity Jun 22 10:22:31.609949 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: Connection: close Jun 22 10:22:31.609949 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: Content-Length: 0 Jun 22 10:22:31.609949 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: Content-Type: application/json Jun 22 10:22:31.609949 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: Host: 10.222.0.43 Jun 22 10:22:31.609949 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: Openstack-System-Scope: None Jun 22 10:22:31.609949 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: User-Agent: python-urllib3/1.26.9 Jun 22 10:22:31.609949 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-Auth-Token: gAAAAABisuvYS2CXj8gCG7Yc42bXsdyTNZGez3H7ko4foQwezMJLTIf_Gnp6Bb6FBbV0UL-h7nopQ4Zbjw32tlioI-fzkdCmRzFS-ECXrTtuGF0yr0Jygcyn8ziPm4NY4mS70dt4GHZiefYTRmBJ0pCpEOrQP-y8Yi9B62jLLANooAtVTJOUQzg Jun 22 10:22:31.609949 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-Domain-Id: None Jun 22 10:22:31.609949 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-Domain-Name: None Jun 22 10:22:31.609949 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-Identity-Status: Confirmed Jun 22 10:22:31.609949 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-Is-Admin-Project: True Jun 22 10:22:31.609949 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-Openstack-Nova-Api-Version: 2.20 Jun 22 10:22:31.609949 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-Project-Domain-Id: default Jun 22 10:22:31.609949 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-Project-Domain-Name: Default Jun 22 10:22:31.609949 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-Project-Id: 5ee9d603d9cc4a8797f55d544f189720 Jun 22 10:22:31.609949 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1985965461 Jun 22 10:22:31.609949 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-Role: reader,member Jun 22 10:22:31.609949 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-Roles: reader,member Jun 22 10:22:31.611377 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/5ee9d603d9cc4a8797f55d544f189720"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/5ee9d603d9cc4a8797f55d544f189720"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_5ee9d603d9cc4a8797f55d544f189720", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/5ee9d603d9cc4a8797f55d544f189720"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}] Jun 22 10:22:31.611377 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1985965461 Jun 22 10:22:31.611377 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-Tenant-Id: 5ee9d603d9cc4a8797f55d544f189720 Jun 22 10:22:31.611377 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1985965461 Jun 22 10:22:31.611377 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-User: tempest-AttachVolumeShelveTestJSON-1985965461-project Jun 22 10:22:31.611377 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-User-Domain-Id: default Jun 22 10:22:31.611377 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-User-Domain-Name: Default Jun 22 10:22:31.611377 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-User-Id: 75753b29a78640df9622d4e2655baf9b Jun 22 10:22:31.611377 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1985965461-project Jun 22 10:22:31.611377 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: method: > Jun 22 10:22:31.611377 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: exception: Instance b357b60f-93be-4898-a651-4a407a7dc490 could not be found. Jun 22 10:22:31.611377 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: action_args: {'id': 'b357b60f-93be-4898-a651-4a407a7dc490'} Jun 22 10:22:31.612138 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 10:22:31.612138 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:22:31.612138 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 22 10:22:31.612138 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 22 10:22:31.612138 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 22 10:22:31.612138 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 22 10:22:31.612138 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 22 10:22:31.612138 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 22 10:22:31.612138 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 22 10:22:31.612138 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 22 10:22:31.612138 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b357b60f-93be-4898-a651-4a407a7dc490 could not be found. Jun 22 10:22:31.612138 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi Jun 22 10:22:31.612138 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 10:22:31.612138 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi Jun 22 10:22:31.612138 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:22:31.612138 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 10:22:31.612138 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 10:22:31.612138 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 10:22:31.612138 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 10:22:31.612138 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 10:22:31.613379 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 10:22:31.613379 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 22 10:22:31.613379 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 22 10:22:31.613379 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 22 10:22:31.613379 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 22 10:22:31.613379 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 22 10:22:31.613379 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 22 10:22:31.613379 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 22 10:22:31.613379 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 22 10:22:31.613379 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b357b60f-93be-4898-a651-4a407a7dc490 could not be found. Jun 22 10:22:31.613379 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi Jun 22 10:22:31.613379 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 10:22:31.613379 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi Jun 22 10:22:31.613379 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:22:31.613379 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 10:22:31.613379 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 10:22:31.613379 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 10:22:31.613379 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 10:22:31.613379 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b357b60f-93be-4898-a651-4a407a7dc490 could not be found. Jun 22 10:22:31.613379 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi Jun 22 10:22:31.615569 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-79eb8760-3adb-42e1-9541-7a97b861303f tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Returning 404 to user: Instance b357b60f-93be-4898-a651-4a407a7dc490 could not be found. {{(pid=117873) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 10:22:31.615569 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [None req-79eb8760-3adb-42e1-9541-7a97b861303f tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] 10.222.0.43 "DELETE /compute/v2.1/servers/b357b60f-93be-4898-a651-4a407a7dc490" status: 404 len: 111 microversion: 2.20 time: 0.045252 Jun 22 10:22:31.615569 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 416/839] 10.222.0.43 () {60 vars in 1279 bytes} [Wed Jun 22 10:22:31 2022] DELETE /compute/v2.1/servers/b357b60f-93be-4898-a651-4a407a7dc490 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 22 10:22:31.619832 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-55c34e2f-6a2b-4a8c-9df2-f2ee638a8137 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Calling method '>' {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:22:31.620434 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.compute.api [None req-55c34e2f-6a2b-4a8c-9df2-f2ee638a8137 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] [instance: b357b60f-93be-4898-a651-4a407a7dc490] Fetching instance by UUID {{(pid=117873) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:22:31.626999 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-55c34e2f-6a2b-4a8c-9df2-f2ee638a8137 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:22:31.627450 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-55c34e2f-6a2b-4a8c-9df2-f2ee638a8137 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:22:31.628276 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-55c34e2f-6a2b-4a8c-9df2-f2ee638a8137 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:22:31.628711 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-55c34e2f-6a2b-4a8c-9df2-f2ee638a8137 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:22:31.642713 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.wsgi [None req-55c34e2f-6a2b-4a8c-9df2-f2ee638a8137 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] HTTP exception thrown: Instance b357b60f-93be-4898-a651-4a407a7dc490 could not be found. Jun 22 10:22:31.644363 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-55c34e2f-6a2b-4a8c-9df2-f2ee638a8137 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Request method failure captured: Jun 22 10:22:31.644363 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: request: GET /compute/v2.1/servers/b357b60f-93be-4898-a651-4a407a7dc490 HTTP/1.1 Jun 22 10:22:31.644363 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: Accept: application/json Jun 22 10:22:31.644363 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: Accept-Encoding: identity Jun 22 10:22:31.644363 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: Connection: close Jun 22 10:22:31.644363 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: Content-Length: 0 Jun 22 10:22:31.644363 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: Content-Type: application/json Jun 22 10:22:31.644363 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: Host: 10.222.0.43 Jun 22 10:22:31.644363 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: Openstack-System-Scope: None Jun 22 10:22:31.644363 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: User-Agent: python-urllib3/1.26.9 Jun 22 10:22:31.644363 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-Auth-Token: gAAAAABisuvYS2CXj8gCG7Yc42bXsdyTNZGez3H7ko4foQwezMJLTIf_Gnp6Bb6FBbV0UL-h7nopQ4Zbjw32tlioI-fzkdCmRzFS-ECXrTtuGF0yr0Jygcyn8ziPm4NY4mS70dt4GHZiefYTRmBJ0pCpEOrQP-y8Yi9B62jLLANooAtVTJOUQzg Jun 22 10:22:31.644363 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-Domain-Id: None Jun 22 10:22:31.644363 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-Domain-Name: None Jun 22 10:22:31.644363 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-Identity-Status: Confirmed Jun 22 10:22:31.644363 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-Is-Admin-Project: True Jun 22 10:22:31.644363 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-Openstack-Nova-Api-Version: 2.20 Jun 22 10:22:31.644363 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-Project-Domain-Id: default Jun 22 10:22:31.644363 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-Project-Domain-Name: Default Jun 22 10:22:31.644363 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-Project-Id: 5ee9d603d9cc4a8797f55d544f189720 Jun 22 10:22:31.644363 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1985965461 Jun 22 10:22:31.644363 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-Role: reader,member Jun 22 10:22:31.644363 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-Roles: reader,member Jun 22 10:22:31.645876 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/5ee9d603d9cc4a8797f55d544f189720"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/5ee9d603d9cc4a8797f55d544f189720"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_5ee9d603d9cc4a8797f55d544f189720", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/5ee9d603d9cc4a8797f55d544f189720"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}] Jun 22 10:22:31.645876 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1985965461 Jun 22 10:22:31.645876 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-Tenant-Id: 5ee9d603d9cc4a8797f55d544f189720 Jun 22 10:22:31.645876 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1985965461 Jun 22 10:22:31.645876 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-User: tempest-AttachVolumeShelveTestJSON-1985965461-project Jun 22 10:22:31.645876 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-User-Domain-Id: default Jun 22 10:22:31.645876 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-User-Domain-Name: Default Jun 22 10:22:31.645876 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-User-Id: 75753b29a78640df9622d4e2655baf9b Jun 22 10:22:31.645876 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1985965461-project Jun 22 10:22:31.645876 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: method: > Jun 22 10:22:31.645876 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: exception: Instance b357b60f-93be-4898-a651-4a407a7dc490 could not be found. Jun 22 10:22:31.645876 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: action_args: {'id': 'b357b60f-93be-4898-a651-4a407a7dc490'} Jun 22 10:22:31.646754 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 10:22:31.646754 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:22:31.646754 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 22 10:22:31.646754 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 22 10:22:31.646754 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 22 10:22:31.646754 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 22 10:22:31.646754 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 22 10:22:31.646754 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 22 10:22:31.646754 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 22 10:22:31.646754 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 22 10:22:31.646754 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b357b60f-93be-4898-a651-4a407a7dc490 could not be found. Jun 22 10:22:31.646754 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi Jun 22 10:22:31.646754 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 10:22:31.646754 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi Jun 22 10:22:31.646754 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:22:31.646754 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 10:22:31.646754 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 10:22:31.646754 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 10:22:31.646754 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 10:22:31.646754 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 10:22:31.647926 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 10:22:31.647926 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 22 10:22:31.647926 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 22 10:22:31.647926 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 22 10:22:31.647926 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 22 10:22:31.647926 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 22 10:22:31.647926 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 22 10:22:31.647926 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b357b60f-93be-4898-a651-4a407a7dc490 could not be found. Jun 22 10:22:31.647926 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi Jun 22 10:22:31.647926 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 10:22:31.647926 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi Jun 22 10:22:31.647926 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:22:31.647926 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 10:22:31.647926 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 10:22:31.647926 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 10:22:31.647926 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 10:22:31.647926 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b357b60f-93be-4898-a651-4a407a7dc490 could not be found. Jun 22 10:22:31.647926 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi Jun 22 10:22:31.648990 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-55c34e2f-6a2b-4a8c-9df2-f2ee638a8137 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Returning 404 to user: Instance b357b60f-93be-4898-a651-4a407a7dc490 could not be found. {{(pid=117873) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 10:22:31.648990 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [None req-55c34e2f-6a2b-4a8c-9df2-f2ee638a8137 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] 10.222.0.43 "GET /compute/v2.1/servers/b357b60f-93be-4898-a651-4a407a7dc490" status: 404 len: 111 microversion: 2.20 time: 0.029830 Jun 22 10:22:31.648990 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 417/840] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jun 22 10:22:31 2022] GET /compute/v2.1/servers/b357b60f-93be-4898-a651-4a407a7dc490 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Jun 22 10:22:31.754144 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.virt.hardware [None req-6507edf3-4c53-4324-ab25-65904357143f tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] Flavor limits 0:0:0 {{(pid=117874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 22 10:22:31.754563 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.virt.hardware [None req-6507edf3-4c53-4324-ab25-65904357143f tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] Image limits 0:0:0 {{(pid=117874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 22 10:22:31.755059 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.virt.hardware [None req-6507edf3-4c53-4324-ab25-65904357143f tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] Flavor pref 0:0:0 {{(pid=117874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 22 10:22:31.755461 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.virt.hardware [None req-6507edf3-4c53-4324-ab25-65904357143f tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] Image pref 0:0:0 {{(pid=117874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 22 10:22:31.755863 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.virt.hardware [None req-6507edf3-4c53-4324-ab25-65904357143f tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 22 10:22:31.765234 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-6507edf3-4c53-4324-ab25-65904357143f tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:22:31.765675 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-6507edf3-4c53-4324-ab25-65904357143f tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:22:31.766481 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-6507edf3-4c53-4324-ab25-65904357143f tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:22:31.766907 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-6507edf3-4c53-4324-ab25-65904357143f tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:22:31.783762 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.quota [None req-6507edf3-4c53-4324-ab25-65904357143f tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] Getting quotas for project 1cb1af845e594466b12a11b7cab99a7c. Resources: {'instances', 'cores', 'ram'} {{(pid=117874) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 22 10:22:31.787642 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.quota [None req-6507edf3-4c53-4324-ab25-65904357143f tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] Getting quotas for user b2d3aa18a0a146808f584127411a1cf5 and project 1cb1af845e594466b12a11b7cab99a7c. Resources: {'instances', 'cores', 'ram'} {{(pid=117874) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 22 10:22:31.846891 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.compute.api [None req-6507edf3-4c53-4324-ab25-65904357143f tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] Going to run 1 instances... {{(pid=117874) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 22 10:22:31.849120 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.compute.api [None req-6507edf3-4c53-4324-ab25-65904357143f tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] [instance: 7d67cb6e-5968-4e4d-961f-5fb5e33c186f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='b9dd562c-2b45-41ba-8033-15ca2966df92',volume_size=None,volume_type=None)] {{(pid=117874) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 22 10:22:31.980764 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [None req-6507edf3-4c53-4324-ab25-65904357143f tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.894070 Jun 22 10:22:31.981342 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 424/841] 10.222.0.43 () {60 vars in 1146 bytes} [Wed Jun 22 10:22:31 2022] POST /compute/v2.1/servers => generated 406 bytes in 896 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 22 10:22:31.993838 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-8af28dba-77b3-4aea-b632-dfb853f944d0 tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] Calling method '>' {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:22:31.994625 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.compute.api [None req-8af28dba-77b3-4aea-b632-dfb853f944d0 tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] [instance: 7d67cb6e-5968-4e4d-961f-5fb5e33c186f] Fetching instance by UUID {{(pid=117873) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:22:32.051193 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.policy [None req-8af28dba-77b3-4aea-b632-dfb853f944d0 tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2d3aa18a0a146808f584127411a1cf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1af845e594466b12a11b7cab99a7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117873) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:22:32.057923 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [None req-8af28dba-77b3-4aea-b632-dfb853f944d0 tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] 10.222.0.43 "GET /compute/v2.1/servers/7d67cb6e-5968-4e4d-961f-5fb5e33c186f" status: 200 len: 1095 microversion: 2.1 time: 0.069801 Jun 22 10:22:32.058668 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 418/842] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:22:31 2022] GET /compute/v2.1/servers/7d67cb6e-5968-4e4d-961f-5fb5e33c186f => generated 1095 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 10:22:32.795288 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-2ed79958-1518-4b42-ac7c-1f21869c310d tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Calling method '>' {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:22:32.796130 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.compute.api [None req-2ed79958-1518-4b42-ac7c-1f21869c310d tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] [instance: 73dbd5ab-5688-4de4-9da2-0b89d7cefb11] Fetching instance by UUID {{(pid=117874) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:22:32.802989 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-2ed79958-1518-4b42-ac7c-1f21869c310d tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:22:32.803663 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-2ed79958-1518-4b42-ac7c-1f21869c310d tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:22:32.804383 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-2ed79958-1518-4b42-ac7c-1f21869c310d tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:22:32.804883 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-2ed79958-1518-4b42-ac7c-1f21869c310d tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:22:32.820134 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.wsgi [None req-2ed79958-1518-4b42-ac7c-1f21869c310d tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] HTTP exception thrown: Instance 73dbd5ab-5688-4de4-9da2-0b89d7cefb11 could not be found. Jun 22 10:22:32.821959 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-2ed79958-1518-4b42-ac7c-1f21869c310d tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Request method failure captured: Jun 22 10:22:32.821959 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: request: DELETE /compute/v2.1/servers/73dbd5ab-5688-4de4-9da2-0b89d7cefb11 HTTP/1.1 Jun 22 10:22:32.821959 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: Accept: application/json Jun 22 10:22:32.821959 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: Accept-Encoding: identity Jun 22 10:22:32.821959 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: Connection: close Jun 22 10:22:32.821959 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: Content-Length: 0 Jun 22 10:22:32.821959 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: Content-Type: application/json Jun 22 10:22:32.821959 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: Host: 10.222.0.43 Jun 22 10:22:32.821959 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: Openstack-System-Scope: None Jun 22 10:22:32.821959 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: User-Agent: python-urllib3/1.26.9 Jun 22 10:22:32.821959 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-Auth-Token: gAAAAABisuvYS2CXj8gCG7Yc42bXsdyTNZGez3H7ko4foQwezMJLTIf_Gnp6Bb6FBbV0UL-h7nopQ4Zbjw32tlioI-fzkdCmRzFS-ECXrTtuGF0yr0Jygcyn8ziPm4NY4mS70dt4GHZiefYTRmBJ0pCpEOrQP-y8Yi9B62jLLANooAtVTJOUQzg Jun 22 10:22:32.821959 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-Domain-Id: None Jun 22 10:22:32.821959 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-Domain-Name: None Jun 22 10:22:32.821959 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-Identity-Status: Confirmed Jun 22 10:22:32.821959 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-Is-Admin-Project: True Jun 22 10:22:32.821959 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-Openstack-Nova-Api-Version: 2.20 Jun 22 10:22:32.821959 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-Project-Domain-Id: default Jun 22 10:22:32.821959 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-Project-Domain-Name: Default Jun 22 10:22:32.821959 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-Project-Id: 5ee9d603d9cc4a8797f55d544f189720 Jun 22 10:22:32.821959 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1985965461 Jun 22 10:22:32.821959 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-Role: reader,member Jun 22 10:22:32.821959 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-Roles: reader,member Jun 22 10:22:32.823683 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/5ee9d603d9cc4a8797f55d544f189720"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/5ee9d603d9cc4a8797f55d544f189720"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_5ee9d603d9cc4a8797f55d544f189720", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/5ee9d603d9cc4a8797f55d544f189720"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}] Jun 22 10:22:32.823683 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1985965461 Jun 22 10:22:32.823683 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-Tenant-Id: 5ee9d603d9cc4a8797f55d544f189720 Jun 22 10:22:32.823683 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1985965461 Jun 22 10:22:32.823683 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-User: tempest-AttachVolumeShelveTestJSON-1985965461-project Jun 22 10:22:32.823683 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-User-Domain-Id: default Jun 22 10:22:32.823683 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-User-Domain-Name: Default Jun 22 10:22:32.823683 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-User-Id: 75753b29a78640df9622d4e2655baf9b Jun 22 10:22:32.823683 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1985965461-project Jun 22 10:22:32.823683 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: method: > Jun 22 10:22:32.823683 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: exception: Instance 73dbd5ab-5688-4de4-9da2-0b89d7cefb11 could not be found. Jun 22 10:22:32.823683 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: action_args: {'id': '73dbd5ab-5688-4de4-9da2-0b89d7cefb11'} Jun 22 10:22:32.824572 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 10:22:32.824572 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:22:32.824572 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 22 10:22:32.824572 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 22 10:22:32.824572 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 22 10:22:32.824572 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 22 10:22:32.824572 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 22 10:22:32.824572 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 22 10:22:32.824572 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 22 10:22:32.824572 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 22 10:22:32.824572 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 73dbd5ab-5688-4de4-9da2-0b89d7cefb11 could not be found. Jun 22 10:22:32.824572 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi Jun 22 10:22:32.824572 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 10:22:32.824572 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi Jun 22 10:22:32.824572 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:22:32.824572 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 10:22:32.824572 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 10:22:32.824572 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 10:22:32.824572 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 10:22:32.824572 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 10:22:32.826031 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 10:22:32.826031 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 22 10:22:32.826031 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 22 10:22:32.826031 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 22 10:22:32.826031 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 22 10:22:32.826031 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 22 10:22:32.826031 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 22 10:22:32.826031 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 22 10:22:32.826031 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 22 10:22:32.826031 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 73dbd5ab-5688-4de4-9da2-0b89d7cefb11 could not be found. Jun 22 10:22:32.826031 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi Jun 22 10:22:32.826031 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 10:22:32.826031 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi Jun 22 10:22:32.826031 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:22:32.826031 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 10:22:32.826031 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 10:22:32.826031 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 10:22:32.826031 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 10:22:32.826031 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 73dbd5ab-5688-4de4-9da2-0b89d7cefb11 could not be found. Jun 22 10:22:32.826031 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi Jun 22 10:22:32.827913 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-2ed79958-1518-4b42-ac7c-1f21869c310d tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Returning 404 to user: Instance 73dbd5ab-5688-4de4-9da2-0b89d7cefb11 could not be found. {{(pid=117874) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 10:22:32.827913 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [None req-2ed79958-1518-4b42-ac7c-1f21869c310d tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] 10.222.0.43 "DELETE /compute/v2.1/servers/73dbd5ab-5688-4de4-9da2-0b89d7cefb11" status: 404 len: 111 microversion: 2.20 time: 0.034399 Jun 22 10:22:32.827913 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 425/843] 10.222.0.43 () {60 vars in 1279 bytes} [Wed Jun 22 10:22:32 2022] DELETE /compute/v2.1/servers/73dbd5ab-5688-4de4-9da2-0b89d7cefb11 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 22 10:22:32.835590 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-63231c21-3f8e-46e1-a4ed-fb9696eae698 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Calling method '>' {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:22:32.836190 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.compute.api [None req-63231c21-3f8e-46e1-a4ed-fb9696eae698 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] [instance: 73dbd5ab-5688-4de4-9da2-0b89d7cefb11] Fetching instance by UUID {{(pid=117873) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:22:32.844034 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-63231c21-3f8e-46e1-a4ed-fb9696eae698 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:22:32.844477 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-63231c21-3f8e-46e1-a4ed-fb9696eae698 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:22:32.845243 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-63231c21-3f8e-46e1-a4ed-fb9696eae698 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:22:32.845678 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-63231c21-3f8e-46e1-a4ed-fb9696eae698 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:22:32.859028 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.wsgi [None req-63231c21-3f8e-46e1-a4ed-fb9696eae698 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] HTTP exception thrown: Instance 73dbd5ab-5688-4de4-9da2-0b89d7cefb11 could not be found. Jun 22 10:22:32.860567 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-63231c21-3f8e-46e1-a4ed-fb9696eae698 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Request method failure captured: Jun 22 10:22:32.860567 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: request: GET /compute/v2.1/servers/73dbd5ab-5688-4de4-9da2-0b89d7cefb11 HTTP/1.1 Jun 22 10:22:32.860567 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: Accept: application/json Jun 22 10:22:32.860567 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: Accept-Encoding: identity Jun 22 10:22:32.860567 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: Connection: close Jun 22 10:22:32.860567 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: Content-Length: 0 Jun 22 10:22:32.860567 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: Content-Type: application/json Jun 22 10:22:32.860567 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: Host: 10.222.0.43 Jun 22 10:22:32.860567 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: Openstack-System-Scope: None Jun 22 10:22:32.860567 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: User-Agent: python-urllib3/1.26.9 Jun 22 10:22:32.860567 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-Auth-Token: gAAAAABisuvYS2CXj8gCG7Yc42bXsdyTNZGez3H7ko4foQwezMJLTIf_Gnp6Bb6FBbV0UL-h7nopQ4Zbjw32tlioI-fzkdCmRzFS-ECXrTtuGF0yr0Jygcyn8ziPm4NY4mS70dt4GHZiefYTRmBJ0pCpEOrQP-y8Yi9B62jLLANooAtVTJOUQzg Jun 22 10:22:32.860567 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-Domain-Id: None Jun 22 10:22:32.860567 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-Domain-Name: None Jun 22 10:22:32.860567 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-Identity-Status: Confirmed Jun 22 10:22:32.860567 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-Is-Admin-Project: True Jun 22 10:22:32.860567 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-Openstack-Nova-Api-Version: 2.20 Jun 22 10:22:32.860567 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-Project-Domain-Id: default Jun 22 10:22:32.860567 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-Project-Domain-Name: Default Jun 22 10:22:32.860567 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-Project-Id: 5ee9d603d9cc4a8797f55d544f189720 Jun 22 10:22:32.860567 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1985965461 Jun 22 10:22:32.860567 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-Role: reader,member Jun 22 10:22:32.860567 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-Roles: reader,member Jun 22 10:22:32.862163 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/5ee9d603d9cc4a8797f55d544f189720"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/5ee9d603d9cc4a8797f55d544f189720"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_5ee9d603d9cc4a8797f55d544f189720", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/5ee9d603d9cc4a8797f55d544f189720"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}] Jun 22 10:22:32.862163 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1985965461 Jun 22 10:22:32.862163 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-Tenant-Id: 5ee9d603d9cc4a8797f55d544f189720 Jun 22 10:22:32.862163 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1985965461 Jun 22 10:22:32.862163 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-User: tempest-AttachVolumeShelveTestJSON-1985965461-project Jun 22 10:22:32.862163 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-User-Domain-Id: default Jun 22 10:22:32.862163 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-User-Domain-Name: Default Jun 22 10:22:32.862163 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-User-Id: 75753b29a78640df9622d4e2655baf9b Jun 22 10:22:32.862163 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1985965461-project Jun 22 10:22:32.862163 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: method: > Jun 22 10:22:32.862163 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: exception: Instance 73dbd5ab-5688-4de4-9da2-0b89d7cefb11 could not be found. Jun 22 10:22:32.862163 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: action_args: {'id': '73dbd5ab-5688-4de4-9da2-0b89d7cefb11'} Jun 22 10:22:32.863005 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 10:22:32.863005 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:22:32.863005 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 22 10:22:32.863005 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 22 10:22:32.863005 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 22 10:22:32.863005 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 22 10:22:32.863005 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 22 10:22:32.863005 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 22 10:22:32.863005 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 22 10:22:32.863005 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 22 10:22:32.863005 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 73dbd5ab-5688-4de4-9da2-0b89d7cefb11 could not be found. Jun 22 10:22:32.863005 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi Jun 22 10:22:32.863005 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 10:22:32.863005 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi Jun 22 10:22:32.863005 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:22:32.863005 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 10:22:32.863005 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 10:22:32.863005 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 10:22:32.863005 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 10:22:32.863005 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 10:22:32.864194 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 10:22:32.864194 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 22 10:22:32.864194 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 22 10:22:32.864194 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 22 10:22:32.864194 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 22 10:22:32.864194 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 22 10:22:32.864194 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 22 10:22:32.864194 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 73dbd5ab-5688-4de4-9da2-0b89d7cefb11 could not be found. Jun 22 10:22:32.864194 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi Jun 22 10:22:32.864194 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 10:22:32.864194 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi Jun 22 10:22:32.864194 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:22:32.864194 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 10:22:32.864194 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 10:22:32.864194 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 10:22:32.864194 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 10:22:32.864194 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 73dbd5ab-5688-4de4-9da2-0b89d7cefb11 could not be found. Jun 22 10:22:32.864194 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi Jun 22 10:22:32.865259 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-63231c21-3f8e-46e1-a4ed-fb9696eae698 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] Returning 404 to user: Instance 73dbd5ab-5688-4de4-9da2-0b89d7cefb11 could not be found. {{(pid=117873) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 10:22:32.865259 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [None req-63231c21-3f8e-46e1-a4ed-fb9696eae698 tempest-AttachVolumeShelveTestJSON-1985965461 tempest-AttachVolumeShelveTestJSON-1985965461-project] 10.222.0.43 "GET /compute/v2.1/servers/73dbd5ab-5688-4de4-9da2-0b89d7cefb11" status: 404 len: 111 microversion: 2.20 time: 0.030341 Jun 22 10:22:32.865259 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 419/844] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jun 22 10:22:32 2022] GET /compute/v2.1/servers/73dbd5ab-5688-4de4-9da2-0b89d7cefb11 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Jun 22 10:22:33.080418 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-5f0c729f-17c3-4119-8f96-a54ddcd07e88 tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] Calling method '>' {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:22:33.080950 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.compute.api [None req-5f0c729f-17c3-4119-8f96-a54ddcd07e88 tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] [instance: 7d67cb6e-5968-4e4d-961f-5fb5e33c186f] Fetching instance by UUID {{(pid=117874) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:22:33.087006 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-5f0c729f-17c3-4119-8f96-a54ddcd07e88 tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:22:33.087448 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-5f0c729f-17c3-4119-8f96-a54ddcd07e88 tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:22:33.088403 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-5f0c729f-17c3-4119-8f96-a54ddcd07e88 tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:22:33.088839 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-5f0c729f-17c3-4119-8f96-a54ddcd07e88 tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:22:33.157681 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.policy [None req-5f0c729f-17c3-4119-8f96-a54ddcd07e88 tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2d3aa18a0a146808f584127411a1cf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1af845e594466b12a11b7cab99a7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117874) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:22:33.165139 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [None req-5f0c729f-17c3-4119-8f96-a54ddcd07e88 tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] 10.222.0.43 "GET /compute/v2.1/servers/7d67cb6e-5968-4e4d-961f-5fb5e33c186f" status: 200 len: 1193 microversion: 2.1 time: 0.093730 Jun 22 10:22:33.165712 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 426/845] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:22:33 2022] GET /compute/v2.1/servers/7d67cb6e-5968-4e4d-961f-5fb5e33c186f => generated 1193 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:22:34.182885 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-484d6dfb-87b1-4165-ba89-9d2995101b20 tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] Calling method '>' {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:22:34.183658 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.compute.api [None req-484d6dfb-87b1-4165-ba89-9d2995101b20 tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] [instance: 7d67cb6e-5968-4e4d-961f-5fb5e33c186f] Fetching instance by UUID {{(pid=117873) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:22:34.196388 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-484d6dfb-87b1-4165-ba89-9d2995101b20 tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:22:34.197019 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-484d6dfb-87b1-4165-ba89-9d2995101b20 tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:22:34.197908 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-484d6dfb-87b1-4165-ba89-9d2995101b20 tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:22:34.198515 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-484d6dfb-87b1-4165-ba89-9d2995101b20 tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:22:34.266049 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.policy [None req-484d6dfb-87b1-4165-ba89-9d2995101b20 tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2d3aa18a0a146808f584127411a1cf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1af845e594466b12a11b7cab99a7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117873) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:22:34.274341 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [None req-484d6dfb-87b1-4165-ba89-9d2995101b20 tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] 10.222.0.43 "GET /compute/v2.1/servers/7d67cb6e-5968-4e4d-961f-5fb5e33c186f" status: 200 len: 1193 microversion: 2.1 time: 0.095268 Jun 22 10:22:34.275003 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 420/846] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:22:34 2022] GET /compute/v2.1/servers/7d67cb6e-5968-4e4d-961f-5fb5e33c186f => generated 1193 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:22:35.292370 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-8074d866-d5b7-4a8f-93bb-2fbc7ae45c64 tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] Calling method '>' {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:22:35.292975 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.compute.api [None req-8074d866-d5b7-4a8f-93bb-2fbc7ae45c64 tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] [instance: 7d67cb6e-5968-4e4d-961f-5fb5e33c186f] Fetching instance by UUID {{(pid=117874) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:22:35.300446 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-8074d866-d5b7-4a8f-93bb-2fbc7ae45c64 tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:22:35.300895 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-8074d866-d5b7-4a8f-93bb-2fbc7ae45c64 tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:22:35.301654 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-8074d866-d5b7-4a8f-93bb-2fbc7ae45c64 tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:22:35.302293 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-8074d866-d5b7-4a8f-93bb-2fbc7ae45c64 tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:22:35.369768 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.policy [None req-8074d866-d5b7-4a8f-93bb-2fbc7ae45c64 tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2d3aa18a0a146808f584127411a1cf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1af845e594466b12a11b7cab99a7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117874) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:22:35.378083 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [None req-8074d866-d5b7-4a8f-93bb-2fbc7ae45c64 tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] 10.222.0.43 "GET /compute/v2.1/servers/7d67cb6e-5968-4e4d-961f-5fb5e33c186f" status: 200 len: 1211 microversion: 2.1 time: 0.089775 Jun 22 10:22:35.378751 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 427/847] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:22:35 2022] GET /compute/v2.1/servers/7d67cb6e-5968-4e4d-961f-5fb5e33c186f => generated 1211 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 10:22:36.398304 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-91e4d133-9d85-42e7-b542-2de7c44108b6 tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] Calling method '>' {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:22:36.399712 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.compute.api [None req-91e4d133-9d85-42e7-b542-2de7c44108b6 tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] [instance: 7d67cb6e-5968-4e4d-961f-5fb5e33c186f] Fetching instance by UUID {{(pid=117873) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:22:36.416655 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-91e4d133-9d85-42e7-b542-2de7c44108b6 tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:22:36.417111 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-91e4d133-9d85-42e7-b542-2de7c44108b6 tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:22:36.427683 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-91e4d133-9d85-42e7-b542-2de7c44108b6 tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:22:36.428135 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-91e4d133-9d85-42e7-b542-2de7c44108b6 tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:22:36.709005 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.policy [None req-91e4d133-9d85-42e7-b542-2de7c44108b6 tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2d3aa18a0a146808f584127411a1cf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1af845e594466b12a11b7cab99a7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117873) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:22:36.722451 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [None req-91e4d133-9d85-42e7-b542-2de7c44108b6 tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] 10.222.0.43 "GET /compute/v2.1/servers/7d67cb6e-5968-4e4d-961f-5fb5e33c186f" status: 200 len: 1267 microversion: 2.1 time: 0.323350 Jun 22 10:22:36.732429 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 421/848] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:22:36 2022] GET /compute/v2.1/servers/7d67cb6e-5968-4e4d-961f-5fb5e33c186f => generated 1267 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:22:37.481705 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [req-f3cb1a4c-5b44-4176-bf2b-d91c9404e91e req-bc87c126-57d3-494b-871a-0d8eb2dc78ea service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7d67cb6e-5968-4e4d-961f-5fb5e33c186f", "tag": "7c7fc779-1672-4d69-b57b-9dfc6fd1bf05"}]} {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:22:37.493778 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [req-f3cb1a4c-5b44-4176-bf2b-d91c9404e91e req-bc87c126-57d3-494b-871a-0d8eb2dc78ea service nova] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:22:37.494450 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [req-f3cb1a4c-5b44-4176-bf2b-d91c9404e91e req-bc87c126-57d3-494b-871a-0d8eb2dc78ea service nova] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:22:37.508707 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.compute.server_external_events [req-f3cb1a4c-5b44-4176-bf2b-d91c9404e91e req-bc87c126-57d3-494b-871a-0d8eb2dc78ea service nova] Creating event network-changed:7c7fc779-1672-4d69-b57b-9dfc6fd1bf05 for instance 7d67cb6e-5968-4e4d-961f-5fb5e33c186f on hv-cinder-84713 Jun 22 10:22:37.513987 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [req-f3cb1a4c-5b44-4176-bf2b-d91c9404e91e req-bc87c126-57d3-494b-871a-0d8eb2dc78ea service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036076 Jun 22 10:22:37.515933 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 428/849] 10.222.0.43 () {64 vars in 1317 bytes} [Wed Jun 22 10:22:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 10:22:37.740020 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-053290b8-0377-4c42-a41b-521ed69f9d82 tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] Calling method '>' {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:22:37.740818 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.compute.api [None req-053290b8-0377-4c42-a41b-521ed69f9d82 tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] [instance: 7d67cb6e-5968-4e4d-961f-5fb5e33c186f] Fetching instance by UUID {{(pid=117873) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:22:37.747859 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-053290b8-0377-4c42-a41b-521ed69f9d82 tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:22:37.751010 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-053290b8-0377-4c42-a41b-521ed69f9d82 tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:22:37.752048 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-053290b8-0377-4c42-a41b-521ed69f9d82 tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:22:37.752479 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-053290b8-0377-4c42-a41b-521ed69f9d82 tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:22:37.892021 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.policy [None req-053290b8-0377-4c42-a41b-521ed69f9d82 tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2d3aa18a0a146808f584127411a1cf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1af845e594466b12a11b7cab99a7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117873) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:22:37.900623 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [None req-053290b8-0377-4c42-a41b-521ed69f9d82 tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] 10.222.0.43 "GET /compute/v2.1/servers/7d67cb6e-5968-4e4d-961f-5fb5e33c186f" status: 200 len: 1267 microversion: 2.1 time: 0.164467 Jun 22 10:22:37.902193 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 422/850] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:22:37 2022] GET /compute/v2.1/servers/7d67cb6e-5968-4e4d-961f-5fb5e33c186f => generated 1267 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:22:38.921058 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-6f2e167e-632d-4c83-b616-f3faa180cb5e tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] Calling method '>' {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:22:38.922639 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.compute.api [None req-6f2e167e-632d-4c83-b616-f3faa180cb5e tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] [instance: 7d67cb6e-5968-4e4d-961f-5fb5e33c186f] Fetching instance by UUID {{(pid=117874) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:22:38.930894 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-6f2e167e-632d-4c83-b616-f3faa180cb5e tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:22:38.931343 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-6f2e167e-632d-4c83-b616-f3faa180cb5e tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:22:38.932363 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-6f2e167e-632d-4c83-b616-f3faa180cb5e tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:22:38.933198 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-6f2e167e-632d-4c83-b616-f3faa180cb5e tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:22:39.104110 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.policy [None req-6f2e167e-632d-4c83-b616-f3faa180cb5e tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2d3aa18a0a146808f584127411a1cf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1af845e594466b12a11b7cab99a7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117874) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:22:39.109568 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [None req-6f2e167e-632d-4c83-b616-f3faa180cb5e tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] 10.222.0.43 "GET /compute/v2.1/servers/7d67cb6e-5968-4e4d-961f-5fb5e33c186f" status: 200 len: 1267 microversion: 2.1 time: 0.193951 Jun 22 10:22:39.110195 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 429/851] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:22:38 2022] GET /compute/v2.1/servers/7d67cb6e-5968-4e4d-961f-5fb5e33c186f => generated 1267 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 10:22:40.127425 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-a4b0a9d1-5037-4c66-ab26-ed9c6e68ddc5 tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] Calling method '>' {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:22:40.128042 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.compute.api [None req-a4b0a9d1-5037-4c66-ab26-ed9c6e68ddc5 tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] [instance: 7d67cb6e-5968-4e4d-961f-5fb5e33c186f] Fetching instance by UUID {{(pid=117873) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:22:40.134545 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-a4b0a9d1-5037-4c66-ab26-ed9c6e68ddc5 tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:22:40.135000 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-a4b0a9d1-5037-4c66-ab26-ed9c6e68ddc5 tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:22:40.135770 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-a4b0a9d1-5037-4c66-ab26-ed9c6e68ddc5 tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:22:40.136205 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-a4b0a9d1-5037-4c66-ab26-ed9c6e68ddc5 tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:22:40.300485 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.policy [None req-a4b0a9d1-5037-4c66-ab26-ed9c6e68ddc5 tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2d3aa18a0a146808f584127411a1cf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1af845e594466b12a11b7cab99a7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117873) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:22:40.308027 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [None req-a4b0a9d1-5037-4c66-ab26-ed9c6e68ddc5 tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] 10.222.0.43 "GET /compute/v2.1/servers/7d67cb6e-5968-4e4d-961f-5fb5e33c186f" status: 200 len: 1267 microversion: 2.1 time: 0.184606 Jun 22 10:22:40.318382 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 423/852] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:22:40 2022] GET /compute/v2.1/servers/7d67cb6e-5968-4e4d-961f-5fb5e33c186f => generated 1267 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:22:41.329492 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-4842cb29-e070-43eb-b97d-5e50e5244d70 tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] Calling method '>' {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:22:41.331222 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.compute.api [None req-4842cb29-e070-43eb-b97d-5e50e5244d70 tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] [instance: 7d67cb6e-5968-4e4d-961f-5fb5e33c186f] Fetching instance by UUID {{(pid=117874) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:22:41.339837 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-4842cb29-e070-43eb-b97d-5e50e5244d70 tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:22:41.340348 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-4842cb29-e070-43eb-b97d-5e50e5244d70 tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:22:41.341213 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-4842cb29-e070-43eb-b97d-5e50e5244d70 tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:22:41.341869 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-4842cb29-e070-43eb-b97d-5e50e5244d70 tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:22:41.535304 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.policy [None req-4842cb29-e070-43eb-b97d-5e50e5244d70 tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2d3aa18a0a146808f584127411a1cf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1af845e594466b12a11b7cab99a7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117874) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:22:41.543199 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [None req-4842cb29-e070-43eb-b97d-5e50e5244d70 tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] 10.222.0.43 "GET /compute/v2.1/servers/7d67cb6e-5968-4e4d-961f-5fb5e33c186f" status: 200 len: 1267 microversion: 2.1 time: 0.220772 Jun 22 10:22:41.543716 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 430/853] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:22:41 2022] GET /compute/v2.1/servers/7d67cb6e-5968-4e4d-961f-5fb5e33c186f => generated 1267 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:22:42.557543 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG dbcounter [-] [117873] Writing DB stats nova_cell0:SELECT=2 {{(pid=117873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:22:42.564159 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-7a80c0fc-2942-4750-9a02-6361f4d425ef tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] Calling method '>' {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:22:42.565021 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.compute.api [None req-7a80c0fc-2942-4750-9a02-6361f4d425ef tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] [instance: 7d67cb6e-5968-4e4d-961f-5fb5e33c186f] Fetching instance by UUID {{(pid=117873) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:22:42.570943 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG dbcounter [-] [117873] Writing DB stats nova_api:SELECT=64,nova_api:UPDATE=3,nova_api:DELETE=1 {{(pid=117873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:22:42.580904 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-7a80c0fc-2942-4750-9a02-6361f4d425ef tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:22:42.581402 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-7a80c0fc-2942-4750-9a02-6361f4d425ef tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:22:42.582212 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-7a80c0fc-2942-4750-9a02-6361f4d425ef tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:22:42.582643 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-7a80c0fc-2942-4750-9a02-6361f4d425ef tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:22:42.919757 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.policy [None req-7a80c0fc-2942-4750-9a02-6361f4d425ef tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2d3aa18a0a146808f584127411a1cf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1af845e594466b12a11b7cab99a7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117873) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:22:42.928315 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [None req-7a80c0fc-2942-4750-9a02-6361f4d425ef tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] 10.222.0.43 "GET /compute/v2.1/servers/7d67cb6e-5968-4e4d-961f-5fb5e33c186f" status: 200 len: 1267 microversion: 2.1 time: 0.372038 Jun 22 10:22:42.928878 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 424/854] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:22:42 2022] GET /compute/v2.1/servers/7d67cb6e-5968-4e4d-961f-5fb5e33c186f => generated 1267 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 10:22:43.945050 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-219a5311-8377-4e77-b3cd-8a4111a23c3b tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] Calling method '>' {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:22:43.945647 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.compute.api [None req-219a5311-8377-4e77-b3cd-8a4111a23c3b tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] [instance: 7d67cb6e-5968-4e4d-961f-5fb5e33c186f] Fetching instance by UUID {{(pid=117874) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:22:43.947810 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG dbcounter [-] [117874] Writing DB stats nova_cell0:SELECT=2 {{(pid=117874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:22:43.948676 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG dbcounter [-] [117874] Writing DB stats nova_cell0:SELECT=6 {{(pid=117874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:22:43.956031 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-219a5311-8377-4e77-b3cd-8a4111a23c3b tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:22:43.956941 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-219a5311-8377-4e77-b3cd-8a4111a23c3b tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:22:43.957840 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-219a5311-8377-4e77-b3cd-8a4111a23c3b tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:22:43.958369 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-219a5311-8377-4e77-b3cd-8a4111a23c3b tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:22:43.962143 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG dbcounter [-] [117874] Writing DB stats nova_cell1:SELECT=78 {{(pid=117874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:22:44.292815 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.policy [None req-219a5311-8377-4e77-b3cd-8a4111a23c3b tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2d3aa18a0a146808f584127411a1cf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1af845e594466b12a11b7cab99a7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117874) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:22:44.302282 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [None req-219a5311-8377-4e77-b3cd-8a4111a23c3b tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] 10.222.0.43 "GET /compute/v2.1/servers/7d67cb6e-5968-4e4d-961f-5fb5e33c186f" status: 200 len: 1267 microversion: 2.1 time: 0.361209 Jun 22 10:22:44.303135 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 431/855] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:22:43 2022] GET /compute/v2.1/servers/7d67cb6e-5968-4e4d-961f-5fb5e33c186f => generated 1267 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:22:45.321168 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-f44fea3d-d1cd-4594-b20b-fdde0585b3ef tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] Calling method '>' {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:22:45.321828 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.compute.api [None req-f44fea3d-d1cd-4594-b20b-fdde0585b3ef tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] [instance: 7d67cb6e-5968-4e4d-961f-5fb5e33c186f] Fetching instance by UUID {{(pid=117873) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:22:45.329552 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-f44fea3d-d1cd-4594-b20b-fdde0585b3ef tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:22:45.330018 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-f44fea3d-d1cd-4594-b20b-fdde0585b3ef tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:22:45.330786 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-f44fea3d-d1cd-4594-b20b-fdde0585b3ef tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:22:45.331219 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-f44fea3d-d1cd-4594-b20b-fdde0585b3ef tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:22:45.542446 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.policy [None req-f44fea3d-d1cd-4594-b20b-fdde0585b3ef tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2d3aa18a0a146808f584127411a1cf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1af845e594466b12a11b7cab99a7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117873) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:22:45.554107 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [None req-f44fea3d-d1cd-4594-b20b-fdde0585b3ef tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] 10.222.0.43 "GET /compute/v2.1/servers/7d67cb6e-5968-4e4d-961f-5fb5e33c186f" status: 200 len: 1267 microversion: 2.1 time: 0.237251 Jun 22 10:22:45.559295 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 425/856] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:22:45 2022] GET /compute/v2.1/servers/7d67cb6e-5968-4e4d-961f-5fb5e33c186f => generated 1267 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:22:46.219781 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [req-e3ee96ba-dff0-4291-b491-b5527c0e1cc3 req-c248023f-0b90-438c-862d-9ca49d6bfb28 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7d67cb6e-5968-4e4d-961f-5fb5e33c186f", "name": "network-vif-plugged", "status": "completed", "tag": "7c7fc779-1672-4d69-b57b-9dfc6fd1bf05"}]} {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:22:46.231260 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [req-e3ee96ba-dff0-4291-b491-b5527c0e1cc3 req-c248023f-0b90-438c-862d-9ca49d6bfb28 service nova] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:22:46.231686 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [req-e3ee96ba-dff0-4291-b491-b5527c0e1cc3 req-c248023f-0b90-438c-862d-9ca49d6bfb28 service nova] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:22:46.246445 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.compute.server_external_events [req-e3ee96ba-dff0-4291-b491-b5527c0e1cc3 req-c248023f-0b90-438c-862d-9ca49d6bfb28 service nova] Creating event network-vif-plugged:7c7fc779-1672-4d69-b57b-9dfc6fd1bf05 for instance 7d67cb6e-5968-4e4d-961f-5fb5e33c186f on hv-cinder-84713 Jun 22 10:22:46.252206 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [req-e3ee96ba-dff0-4291-b491-b5527c0e1cc3 req-c248023f-0b90-438c-862d-9ca49d6bfb28 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039257 Jun 22 10:22:46.252779 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 432/857] 10.222.0.43 () {64 vars in 1317 bytes} [Wed Jun 22 10:22:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 10:22:46.577631 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-e58e13d6-c1c7-4eb4-9641-1a4647aa57d8 tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] Calling method '>' {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:22:46.584351 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.compute.api [None req-e58e13d6-c1c7-4eb4-9641-1a4647aa57d8 tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] [instance: 7d67cb6e-5968-4e4d-961f-5fb5e33c186f] Fetching instance by UUID {{(pid=117873) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:22:46.591563 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-e58e13d6-c1c7-4eb4-9641-1a4647aa57d8 tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:22:46.592230 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-e58e13d6-c1c7-4eb4-9641-1a4647aa57d8 tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:22:46.593364 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-e58e13d6-c1c7-4eb4-9641-1a4647aa57d8 tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:22:46.593815 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-e58e13d6-c1c7-4eb4-9641-1a4647aa57d8 tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:22:46.818239 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.policy [None req-e58e13d6-c1c7-4eb4-9641-1a4647aa57d8 tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2d3aa18a0a146808f584127411a1cf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1af845e594466b12a11b7cab99a7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117873) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:22:46.827010 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [None req-e58e13d6-c1c7-4eb4-9641-1a4647aa57d8 tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] 10.222.0.43 "GET /compute/v2.1/servers/7d67cb6e-5968-4e4d-961f-5fb5e33c186f" status: 200 len: 1267 microversion: 2.1 time: 0.258794 Jun 22 10:22:46.827899 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 426/858] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:22:46 2022] GET /compute/v2.1/servers/7d67cb6e-5968-4e4d-961f-5fb5e33c186f => generated 1267 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:22:47.845863 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-f059ec19-2739-490b-9a70-e9c571efe2e9 tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] Calling method '>' {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:22:47.846562 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.compute.api [None req-f059ec19-2739-490b-9a70-e9c571efe2e9 tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] [instance: 7d67cb6e-5968-4e4d-961f-5fb5e33c186f] Fetching instance by UUID {{(pid=117874) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:22:47.853763 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-f059ec19-2739-490b-9a70-e9c571efe2e9 tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:22:47.854218 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-f059ec19-2739-490b-9a70-e9c571efe2e9 tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:22:47.856973 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-f059ec19-2739-490b-9a70-e9c571efe2e9 tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:22:47.869430 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-f059ec19-2739-490b-9a70-e9c571efe2e9 tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:22:48.048622 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.policy [None req-f059ec19-2739-490b-9a70-e9c571efe2e9 tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2d3aa18a0a146808f584127411a1cf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1af845e594466b12a11b7cab99a7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117874) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:22:48.062590 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [None req-f059ec19-2739-490b-9a70-e9c571efe2e9 tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] 10.222.0.43 "GET /compute/v2.1/servers/7d67cb6e-5968-4e4d-961f-5fb5e33c186f" status: 200 len: 1454 microversion: 2.1 time: 0.221819 Jun 22 10:22:48.063359 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 433/859] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:22:47 2022] GET /compute/v2.1/servers/7d67cb6e-5968-4e4d-961f-5fb5e33c186f => generated 1454 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:22:48.079786 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-3687435a-affc-4027-82d7-ae3e186a6dfe tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] Calling method '>' {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:22:48.080399 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.compute.api [None req-3687435a-affc-4027-82d7-ae3e186a6dfe tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] [instance: 7d67cb6e-5968-4e4d-961f-5fb5e33c186f] Fetching instance by UUID {{(pid=117873) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:22:48.095370 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-3687435a-affc-4027-82d7-ae3e186a6dfe tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:22:48.095824 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-3687435a-affc-4027-82d7-ae3e186a6dfe tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:22:48.096615 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-3687435a-affc-4027-82d7-ae3e186a6dfe tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:22:48.097051 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-3687435a-affc-4027-82d7-ae3e186a6dfe tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:22:48.610770 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.policy [None req-3687435a-affc-4027-82d7-ae3e186a6dfe tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2d3aa18a0a146808f584127411a1cf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1af845e594466b12a11b7cab99a7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117873) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:22:48.624045 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [None req-3687435a-affc-4027-82d7-ae3e186a6dfe tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] 10.222.0.43 "GET /compute/v2.1/servers/7d67cb6e-5968-4e4d-961f-5fb5e33c186f" status: 200 len: 1454 microversion: 2.1 time: 0.547829 Jun 22 10:22:48.625163 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 427/860] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:22:48 2022] GET /compute/v2.1/servers/7d67cb6e-5968-4e4d-961f-5fb5e33c186f => generated 1454 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:22:50.847483 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [req-174e118b-3db5-474c-8e68-868f64bb4a8c req-5393ff48-6b84-466e-9e11-bc674553fe93 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7d67cb6e-5968-4e4d-961f-5fb5e33c186f", "tag": "7c7fc779-1672-4d69-b57b-9dfc6fd1bf05"}]} {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:22:50.870534 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [req-174e118b-3db5-474c-8e68-868f64bb4a8c req-5393ff48-6b84-466e-9e11-bc674553fe93 service nova] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:22:50.870986 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [req-174e118b-3db5-474c-8e68-868f64bb4a8c req-5393ff48-6b84-466e-9e11-bc674553fe93 service nova] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:22:50.886338 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.compute.server_external_events [req-174e118b-3db5-474c-8e68-868f64bb4a8c req-5393ff48-6b84-466e-9e11-bc674553fe93 service nova] Creating event network-changed:7c7fc779-1672-4d69-b57b-9dfc6fd1bf05 for instance 7d67cb6e-5968-4e4d-961f-5fb5e33c186f on hv-cinder-84713 Jun 22 10:22:50.891786 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [req-174e118b-3db5-474c-8e68-868f64bb4a8c req-5393ff48-6b84-466e-9e11-bc674553fe93 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047916 Jun 22 10:22:50.892390 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 434/861] 10.222.0.43 () {64 vars in 1317 bytes} [Wed Jun 22 10:22:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 10:23:34.876264 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG dbcounter [-] [117873] Writing DB stats nova_api:SELECT=7 {{(pid=117873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:23:34.877013 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG dbcounter [-] [117873] Writing DB stats nova_cell1:SELECT=57 {{(pid=117873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:23:35.108042 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-e2aeda2c-71e5-4e6b-b865-70ded66eefa8 tempest-TestShelveInstance-1869927250 tempest-TestShelveInstance-1869927250-project] Action: 'create', calling method: .version_select at 0x7f36be3a20d0>, body: {"keypair": {"name": "tempest-TestShelveInstance-503902195", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ3Sl8HOZv0tu0w6jhgTYH6/s2egib8AYUzVlAQJABZFN2Hx9jcrPUlsKQnSyc5tUVzrIh+fxeGamCuq7ByBGW2Ywbd/2qQ5FDXiyThjXdB5qvfLxmg4HHk2rKCdvGsyew=="}} {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:23:35.128045 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.quota [None req-e2aeda2c-71e5-4e6b-b865-70ded66eefa8 tempest-TestShelveInstance-1869927250 tempest-TestShelveInstance-1869927250-project] Getting quotas for project aa9a1da5cb5a4279abb88ec7bdb1ef6b. Resources: {'key_pairs'} {{(pid=117873) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 22 10:23:35.133006 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.quota [None req-e2aeda2c-71e5-4e6b-b865-70ded66eefa8 tempest-TestShelveInstance-1869927250 tempest-TestShelveInstance-1869927250-project] Getting quotas for user d6428e56cd9b46feb6a7b04e4d00c162 and project aa9a1da5cb5a4279abb88ec7bdb1ef6b. Resources: {'key_pairs'} {{(pid=117873) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 22 10:23:35.177215 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [None req-e2aeda2c-71e5-4e6b-b865-70ded66eefa8 tempest-TestShelveInstance-1869927250 tempest-TestShelveInstance-1869927250-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.306632 Jun 22 10:23:35.177990 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 428/862] 10.222.0.43 () {60 vars in 1158 bytes} [Wed Jun 22 10:23:34 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 10:23:55.627083 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG dbcounter [-] [117874] Writing DB stats nova_api:SELECT=34,nova_api:INSERT=3 {{(pid=117874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:23:55.627810 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG dbcounter [-] [117874] Writing DB stats nova_cell1:SELECT=15 {{(pid=117874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:23:55.632153 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-20c1333b-4370-4892-923b-07ca6a3b3da0 tempest-TestShelveInstance-1869927250 tempest-TestShelveInstance-1869927250-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1203216768", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-503902195", "security_groups": [{"name": "tempest-secgroup-smoke-1232309003"}], "networks": [{"uuid": "0e72ac4a-4b5a-48df-b530-d05f788ca8b5"}], "block_device_mapping_v2": [{"uuid": "57e80c31-6458-4877-9036-244ac911666e", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:23:55.746141 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.network.neutron [None req-20c1333b-4370-4892-923b-07ca6a3b3da0 tempest-TestShelveInstance-1869927250 tempest-TestShelveInstance-1869927250-project] validate_networks() for [('0e72ac4a-4b5a-48df-b530-d05f788ca8b5', None, None, None, None, None)] {{(pid=117874) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 22 10:23:56.107655 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.virt.hardware [None req-20c1333b-4370-4892-923b-07ca6a3b3da0 tempest-TestShelveInstance-1869927250 tempest-TestShelveInstance-1869927250-project] Flavor limits 0:0:0 {{(pid=117874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 22 10:23:56.108082 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.virt.hardware [None req-20c1333b-4370-4892-923b-07ca6a3b3da0 tempest-TestShelveInstance-1869927250 tempest-TestShelveInstance-1869927250-project] Image limits 0:0:0 {{(pid=117874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 22 10:23:56.108561 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.virt.hardware [None req-20c1333b-4370-4892-923b-07ca6a3b3da0 tempest-TestShelveInstance-1869927250 tempest-TestShelveInstance-1869927250-project] Flavor pref 0:0:0 {{(pid=117874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 22 10:23:56.108972 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.virt.hardware [None req-20c1333b-4370-4892-923b-07ca6a3b3da0 tempest-TestShelveInstance-1869927250 tempest-TestShelveInstance-1869927250-project] Image pref 0:0:0 {{(pid=117874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 22 10:23:56.109488 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.virt.hardware [None req-20c1333b-4370-4892-923b-07ca6a3b3da0 tempest-TestShelveInstance-1869927250 tempest-TestShelveInstance-1869927250-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 22 10:23:56.122405 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-20c1333b-4370-4892-923b-07ca6a3b3da0 tempest-TestShelveInstance-1869927250 tempest-TestShelveInstance-1869927250-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:23:56.122856 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-20c1333b-4370-4892-923b-07ca6a3b3da0 tempest-TestShelveInstance-1869927250 tempest-TestShelveInstance-1869927250-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:23:56.123656 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-20c1333b-4370-4892-923b-07ca6a3b3da0 tempest-TestShelveInstance-1869927250 tempest-TestShelveInstance-1869927250-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:23:56.124095 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-20c1333b-4370-4892-923b-07ca6a3b3da0 tempest-TestShelveInstance-1869927250 tempest-TestShelveInstance-1869927250-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:23:56.142086 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.quota [None req-20c1333b-4370-4892-923b-07ca6a3b3da0 tempest-TestShelveInstance-1869927250 tempest-TestShelveInstance-1869927250-project] Getting quotas for project aa9a1da5cb5a4279abb88ec7bdb1ef6b. Resources: {'instances', 'cores', 'ram'} {{(pid=117874) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 22 10:23:56.146031 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.quota [None req-20c1333b-4370-4892-923b-07ca6a3b3da0 tempest-TestShelveInstance-1869927250 tempest-TestShelveInstance-1869927250-project] Getting quotas for user d6428e56cd9b46feb6a7b04e4d00c162 and project aa9a1da5cb5a4279abb88ec7bdb1ef6b. Resources: {'instances', 'cores', 'ram'} {{(pid=117874) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 22 10:23:56.202312 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.compute.api [None req-20c1333b-4370-4892-923b-07ca6a3b3da0 tempest-TestShelveInstance-1869927250 tempest-TestShelveInstance-1869927250-project] Going to run 1 instances... {{(pid=117874) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 22 10:23:56.205223 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.compute.api [None req-20c1333b-4370-4892-923b-07ca6a3b3da0 tempest-TestShelveInstance-1869927250 tempest-TestShelveInstance-1869927250-project] [instance: 46804c86-520a-407d-84a9-2f6d1ea1cff0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='57e80c31-6458-4877-9036-244ac911666e',volume_size=None,volume_type=None)] {{(pid=117874) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 22 10:23:56.332738 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [None req-20c1333b-4370-4892-923b-07ca6a3b3da0 tempest-TestShelveInstance-1869927250 tempest-TestShelveInstance-1869927250-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.707659 Jun 22 10:23:56.333372 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 435/863] 10.222.0.43 () {60 vars in 1146 bytes} [Wed Jun 22 10:23:55 2022] POST /compute/v2.1/servers => generated 406 bytes in 709 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 22 10:23:56.340930 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG dbcounter [-] [117873] Writing DB stats nova_cell0:SELECT=4 {{(pid=117873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:23:56.342580 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG dbcounter [-] [117873] Writing DB stats nova_api:SELECT=11,nova_api:INSERT=1 {{(pid=117873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:23:56.347210 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-9ed61dd9-189c-4fec-af99-9ac46c6c4243 tempest-TestShelveInstance-1869927250 tempest-TestShelveInstance-1869927250-project] Calling method '>' {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:23:56.348689 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.compute.api [None req-9ed61dd9-189c-4fec-af99-9ac46c6c4243 tempest-TestShelveInstance-1869927250 tempest-TestShelveInstance-1869927250-project] [instance: 46804c86-520a-407d-84a9-2f6d1ea1cff0] Fetching instance by UUID {{(pid=117873) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:23:56.413978 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.policy [None req-9ed61dd9-189c-4fec-af99-9ac46c6c4243 tempest-TestShelveInstance-1869927250 tempest-TestShelveInstance-1869927250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6428e56cd9b46feb6a7b04e4d00c162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa9a1da5cb5a4279abb88ec7bdb1ef6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117873) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:23:56.420726 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [None req-9ed61dd9-189c-4fec-af99-9ac46c6c4243 tempest-TestShelveInstance-1869927250 tempest-TestShelveInstance-1869927250-project] 10.222.0.43 "GET /compute/v2.1/servers/46804c86-520a-407d-84a9-2f6d1ea1cff0" status: 200 len: 1088 microversion: 2.1 time: 0.081345 Jun 22 10:23:56.421280 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 429/864] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:23:56 2022] GET /compute/v2.1/servers/46804c86-520a-407d-84a9-2f6d1ea1cff0 => generated 1088 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:23:57.438036 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-46bf6af9-5f57-4b1b-9182-4ee14ca69a97 tempest-TestShelveInstance-1869927250 tempest-TestShelveInstance-1869927250-project] Calling method '>' {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:23:57.438644 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.compute.api [None req-46bf6af9-5f57-4b1b-9182-4ee14ca69a97 tempest-TestShelveInstance-1869927250 tempest-TestShelveInstance-1869927250-project] [instance: 46804c86-520a-407d-84a9-2f6d1ea1cff0] Fetching instance by UUID {{(pid=117874) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:23:57.446209 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-46bf6af9-5f57-4b1b-9182-4ee14ca69a97 tempest-TestShelveInstance-1869927250 tempest-TestShelveInstance-1869927250-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:23:57.446662 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-46bf6af9-5f57-4b1b-9182-4ee14ca69a97 tempest-TestShelveInstance-1869927250 tempest-TestShelveInstance-1869927250-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:23:57.447430 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-46bf6af9-5f57-4b1b-9182-4ee14ca69a97 tempest-TestShelveInstance-1869927250 tempest-TestShelveInstance-1869927250-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:23:57.447868 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-46bf6af9-5f57-4b1b-9182-4ee14ca69a97 tempest-TestShelveInstance-1869927250 tempest-TestShelveInstance-1869927250-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:23:57.515047 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.policy [None req-46bf6af9-5f57-4b1b-9182-4ee14ca69a97 tempest-TestShelveInstance-1869927250 tempest-TestShelveInstance-1869927250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6428e56cd9b46feb6a7b04e4d00c162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa9a1da5cb5a4279abb88ec7bdb1ef6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117874) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:23:57.523374 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [None req-46bf6af9-5f57-4b1b-9182-4ee14ca69a97 tempest-TestShelveInstance-1869927250 tempest-TestShelveInstance-1869927250-project] 10.222.0.43 "GET /compute/v2.1/servers/46804c86-520a-407d-84a9-2f6d1ea1cff0" status: 200 len: 1194 microversion: 2.1 time: 0.089643 Jun 22 10:23:57.524302 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 436/865] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:23:57 2022] GET /compute/v2.1/servers/46804c86-520a-407d-84a9-2f6d1ea1cff0 => generated 1194 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:23:58.540887 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-10525ce0-3036-475f-8068-5e5059423a3c tempest-TestShelveInstance-1869927250 tempest-TestShelveInstance-1869927250-project] Calling method '>' {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:23:58.541559 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.compute.api [None req-10525ce0-3036-475f-8068-5e5059423a3c tempest-TestShelveInstance-1869927250 tempest-TestShelveInstance-1869927250-project] [instance: 46804c86-520a-407d-84a9-2f6d1ea1cff0] Fetching instance by UUID {{(pid=117873) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:23:58.548966 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-10525ce0-3036-475f-8068-5e5059423a3c tempest-TestShelveInstance-1869927250 tempest-TestShelveInstance-1869927250-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:23:58.549525 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-10525ce0-3036-475f-8068-5e5059423a3c tempest-TestShelveInstance-1869927250 tempest-TestShelveInstance-1869927250-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:23:58.550420 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-10525ce0-3036-475f-8068-5e5059423a3c tempest-TestShelveInstance-1869927250 tempest-TestShelveInstance-1869927250-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:23:58.550981 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-10525ce0-3036-475f-8068-5e5059423a3c tempest-TestShelveInstance-1869927250 tempest-TestShelveInstance-1869927250-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:23:58.690510 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.policy [None req-10525ce0-3036-475f-8068-5e5059423a3c tempest-TestShelveInstance-1869927250 tempest-TestShelveInstance-1869927250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6428e56cd9b46feb6a7b04e4d00c162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa9a1da5cb5a4279abb88ec7bdb1ef6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117873) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:23:58.698686 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [None req-10525ce0-3036-475f-8068-5e5059423a3c tempest-TestShelveInstance-1869927250 tempest-TestShelveInstance-1869927250-project] 10.222.0.43 "GET /compute/v2.1/servers/46804c86-520a-407d-84a9-2f6d1ea1cff0" status: 200 len: 1260 microversion: 2.1 time: 0.161608 Jun 22 10:23:58.699390 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 430/866] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:23:58 2022] GET /compute/v2.1/servers/46804c86-520a-407d-84a9-2f6d1ea1cff0 => generated 1260 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 10:23:58.794364 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [req-cf4b5232-a224-4cd4-9a20-be3f10696495 req-65766edf-a1d2-4bb5-9bf7-1369454c7d28 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "46804c86-520a-407d-84a9-2f6d1ea1cff0", "tag": "377da38d-a656-43c8-babd-6b00935ec9f5"}]} {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:23:58.804456 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [req-cf4b5232-a224-4cd4-9a20-be3f10696495 req-65766edf-a1d2-4bb5-9bf7-1369454c7d28 service nova] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:23:58.804905 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [req-cf4b5232-a224-4cd4-9a20-be3f10696495 req-65766edf-a1d2-4bb5-9bf7-1369454c7d28 service nova] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:23:58.820470 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.compute.server_external_events [req-cf4b5232-a224-4cd4-9a20-be3f10696495 req-65766edf-a1d2-4bb5-9bf7-1369454c7d28 service nova] Creating event network-changed:377da38d-a656-43c8-babd-6b00935ec9f5 for instance 46804c86-520a-407d-84a9-2f6d1ea1cff0 on hv-cinder-84713 Jun 22 10:23:58.827181 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [req-cf4b5232-a224-4cd4-9a20-be3f10696495 req-65766edf-a1d2-4bb5-9bf7-1369454c7d28 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037549 Jun 22 10:23:58.828914 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 437/867] 10.222.0.43 () {64 vars in 1317 bytes} [Wed Jun 22 10:23:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 10:23:59.716341 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-dfb966dc-51d6-4be7-b8b9-a916461adfb1 tempest-TestShelveInstance-1869927250 tempest-TestShelveInstance-1869927250-project] Calling method '>' {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:23:59.717058 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.compute.api [None req-dfb966dc-51d6-4be7-b8b9-a916461adfb1 tempest-TestShelveInstance-1869927250 tempest-TestShelveInstance-1869927250-project] [instance: 46804c86-520a-407d-84a9-2f6d1ea1cff0] Fetching instance by UUID {{(pid=117873) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:23:59.724121 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-dfb966dc-51d6-4be7-b8b9-a916461adfb1 tempest-TestShelveInstance-1869927250 tempest-TestShelveInstance-1869927250-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:23:59.724566 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-dfb966dc-51d6-4be7-b8b9-a916461adfb1 tempest-TestShelveInstance-1869927250 tempest-TestShelveInstance-1869927250-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:23:59.725326 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-dfb966dc-51d6-4be7-b8b9-a916461adfb1 tempest-TestShelveInstance-1869927250 tempest-TestShelveInstance-1869927250-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:23:59.726043 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-dfb966dc-51d6-4be7-b8b9-a916461adfb1 tempest-TestShelveInstance-1869927250 tempest-TestShelveInstance-1869927250-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:23:59.867445 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.policy [None req-dfb966dc-51d6-4be7-b8b9-a916461adfb1 tempest-TestShelveInstance-1869927250 tempest-TestShelveInstance-1869927250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6428e56cd9b46feb6a7b04e4d00c162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa9a1da5cb5a4279abb88ec7bdb1ef6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117873) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:23:59.875627 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [None req-dfb966dc-51d6-4be7-b8b9-a916461adfb1 tempest-TestShelveInstance-1869927250 tempest-TestShelveInstance-1869927250-project] 10.222.0.43 "GET /compute/v2.1/servers/46804c86-520a-407d-84a9-2f6d1ea1cff0" status: 200 len: 1260 microversion: 2.1 time: 0.163116 Jun 22 10:23:59.885143 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 431/868] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:23:59 2022] GET /compute/v2.1/servers/46804c86-520a-407d-84a9-2f6d1ea1cff0 => generated 1260 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:24:00.893855 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-37abb995-b4b3-4904-accd-56a9dc504c83 tempest-TestShelveInstance-1869927250 tempest-TestShelveInstance-1869927250-project] Calling method '>' {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:24:00.894491 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.compute.api [None req-37abb995-b4b3-4904-accd-56a9dc504c83 tempest-TestShelveInstance-1869927250 tempest-TestShelveInstance-1869927250-project] [instance: 46804c86-520a-407d-84a9-2f6d1ea1cff0] Fetching instance by UUID {{(pid=117874) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:24:00.900866 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-37abb995-b4b3-4904-accd-56a9dc504c83 tempest-TestShelveInstance-1869927250 tempest-TestShelveInstance-1869927250-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:24:00.901309 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-37abb995-b4b3-4904-accd-56a9dc504c83 tempest-TestShelveInstance-1869927250 tempest-TestShelveInstance-1869927250-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:24:00.902083 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-37abb995-b4b3-4904-accd-56a9dc504c83 tempest-TestShelveInstance-1869927250 tempest-TestShelveInstance-1869927250-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:24:00.902513 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-37abb995-b4b3-4904-accd-56a9dc504c83 tempest-TestShelveInstance-1869927250 tempest-TestShelveInstance-1869927250-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:24:01.050969 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.policy [None req-37abb995-b4b3-4904-accd-56a9dc504c83 tempest-TestShelveInstance-1869927250 tempest-TestShelveInstance-1869927250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6428e56cd9b46feb6a7b04e4d00c162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa9a1da5cb5a4279abb88ec7bdb1ef6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117874) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:24:01.058448 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [None req-37abb995-b4b3-4904-accd-56a9dc504c83 tempest-TestShelveInstance-1869927250 tempest-TestShelveInstance-1869927250-project] 10.222.0.43 "GET /compute/v2.1/servers/46804c86-520a-407d-84a9-2f6d1ea1cff0" status: 200 len: 1260 microversion: 2.1 time: 0.170026 Jun 22 10:24:01.059009 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 438/869] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:24:00 2022] GET /compute/v2.1/servers/46804c86-520a-407d-84a9-2f6d1ea1cff0 => generated 1260 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:24:02.076067 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-c0ba300b-baef-4289-ac4d-c0909ceafab9 tempest-TestShelveInstance-1869927250 tempest-TestShelveInstance-1869927250-project] Calling method '>' {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:24:02.076671 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.compute.api [None req-c0ba300b-baef-4289-ac4d-c0909ceafab9 tempest-TestShelveInstance-1869927250 tempest-TestShelveInstance-1869927250-project] [instance: 46804c86-520a-407d-84a9-2f6d1ea1cff0] Fetching instance by UUID {{(pid=117873) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:24:02.083921 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-c0ba300b-baef-4289-ac4d-c0909ceafab9 tempest-TestShelveInstance-1869927250 tempest-TestShelveInstance-1869927250-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:24:02.084439 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-c0ba300b-baef-4289-ac4d-c0909ceafab9 tempest-TestShelveInstance-1869927250 tempest-TestShelveInstance-1869927250-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:24:02.085122 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-c0ba300b-baef-4289-ac4d-c0909ceafab9 tempest-TestShelveInstance-1869927250 tempest-TestShelveInstance-1869927250-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:24:02.085544 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-c0ba300b-baef-4289-ac4d-c0909ceafab9 tempest-TestShelveInstance-1869927250 tempest-TestShelveInstance-1869927250-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:24:02.216606 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.policy [None req-c0ba300b-baef-4289-ac4d-c0909ceafab9 tempest-TestShelveInstance-1869927250 tempest-TestShelveInstance-1869927250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6428e56cd9b46feb6a7b04e4d00c162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa9a1da5cb5a4279abb88ec7bdb1ef6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117873) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:24:02.224067 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [None req-c0ba300b-baef-4289-ac4d-c0909ceafab9 tempest-TestShelveInstance-1869927250 tempest-TestShelveInstance-1869927250-project] 10.222.0.43 "GET /compute/v2.1/servers/46804c86-520a-407d-84a9-2f6d1ea1cff0" status: 200 len: 1260 microversion: 2.1 time: 0.151983 Jun 22 10:24:02.224614 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 432/870] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:24:02 2022] GET /compute/v2.1/servers/46804c86-520a-407d-84a9-2f6d1ea1cff0 => generated 1260 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:24:03.241044 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-7fae29fb-8e04-483c-8a36-1464836a93e5 tempest-TestShelveInstance-1869927250 tempest-TestShelveInstance-1869927250-project] Calling method '>' {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:24:03.241648 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.compute.api [None req-7fae29fb-8e04-483c-8a36-1464836a93e5 tempest-TestShelveInstance-1869927250 tempest-TestShelveInstance-1869927250-project] [instance: 46804c86-520a-407d-84a9-2f6d1ea1cff0] Fetching instance by UUID {{(pid=117874) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:24:03.248141 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-7fae29fb-8e04-483c-8a36-1464836a93e5 tempest-TestShelveInstance-1869927250 tempest-TestShelveInstance-1869927250-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:24:03.248582 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-7fae29fb-8e04-483c-8a36-1464836a93e5 tempest-TestShelveInstance-1869927250 tempest-TestShelveInstance-1869927250-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:24:03.249353 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-7fae29fb-8e04-483c-8a36-1464836a93e5 tempest-TestShelveInstance-1869927250 tempest-TestShelveInstance-1869927250-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:24:03.249808 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-7fae29fb-8e04-483c-8a36-1464836a93e5 tempest-TestShelveInstance-1869927250 tempest-TestShelveInstance-1869927250-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:24:03.396347 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.policy [None req-7fae29fb-8e04-483c-8a36-1464836a93e5 tempest-TestShelveInstance-1869927250 tempest-TestShelveInstance-1869927250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6428e56cd9b46feb6a7b04e4d00c162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa9a1da5cb5a4279abb88ec7bdb1ef6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117874) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:24:03.403863 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [None req-7fae29fb-8e04-483c-8a36-1464836a93e5 tempest-TestShelveInstance-1869927250 tempest-TestShelveInstance-1869927250-project] 10.222.0.43 "GET /compute/v2.1/servers/46804c86-520a-407d-84a9-2f6d1ea1cff0" status: 200 len: 1260 microversion: 2.1 time: 0.166597 Jun 22 10:24:03.404421 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 439/871] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:24:03 2022] GET /compute/v2.1/servers/46804c86-520a-407d-84a9-2f6d1ea1cff0 => generated 1260 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:24:04.420907 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-363063f6-e873-45be-8c6b-e669edeeef9e tempest-TestShelveInstance-1869927250 tempest-TestShelveInstance-1869927250-project] Calling method '>' {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:24:04.421503 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.compute.api [None req-363063f6-e873-45be-8c6b-e669edeeef9e tempest-TestShelveInstance-1869927250 tempest-TestShelveInstance-1869927250-project] [instance: 46804c86-520a-407d-84a9-2f6d1ea1cff0] Fetching instance by UUID {{(pid=117873) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:24:04.428844 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-363063f6-e873-45be-8c6b-e669edeeef9e tempest-TestShelveInstance-1869927250 tempest-TestShelveInstance-1869927250-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:24:04.429280 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-363063f6-e873-45be-8c6b-e669edeeef9e tempest-TestShelveInstance-1869927250 tempest-TestShelveInstance-1869927250-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:24:04.430063 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-363063f6-e873-45be-8c6b-e669edeeef9e tempest-TestShelveInstance-1869927250 tempest-TestShelveInstance-1869927250-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:24:04.430491 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-363063f6-e873-45be-8c6b-e669edeeef9e tempest-TestShelveInstance-1869927250 tempest-TestShelveInstance-1869927250-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:24:04.559011 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.policy [None req-363063f6-e873-45be-8c6b-e669edeeef9e tempest-TestShelveInstance-1869927250 tempest-TestShelveInstance-1869927250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6428e56cd9b46feb6a7b04e4d00c162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa9a1da5cb5a4279abb88ec7bdb1ef6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117873) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:24:04.566452 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [None req-363063f6-e873-45be-8c6b-e669edeeef9e tempest-TestShelveInstance-1869927250 tempest-TestShelveInstance-1869927250-project] 10.222.0.43 "GET /compute/v2.1/servers/46804c86-520a-407d-84a9-2f6d1ea1cff0" status: 200 len: 1260 microversion: 2.1 time: 0.149342 Jun 22 10:24:04.567006 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 433/872] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:24:04 2022] GET /compute/v2.1/servers/46804c86-520a-407d-84a9-2f6d1ea1cff0 => generated 1260 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:24:05.587652 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-160b027e-7ecf-403d-b733-a7fd5c08df2a tempest-TestShelveInstance-1869927250 tempest-TestShelveInstance-1869927250-project] Calling method '>' {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:24:05.587652 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.compute.api [None req-160b027e-7ecf-403d-b733-a7fd5c08df2a tempest-TestShelveInstance-1869927250 tempest-TestShelveInstance-1869927250-project] [instance: 46804c86-520a-407d-84a9-2f6d1ea1cff0] Fetching instance by UUID {{(pid=117874) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:24:05.590221 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-160b027e-7ecf-403d-b733-a7fd5c08df2a tempest-TestShelveInstance-1869927250 tempest-TestShelveInstance-1869927250-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:24:05.591764 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-160b027e-7ecf-403d-b733-a7fd5c08df2a tempest-TestShelveInstance-1869927250 tempest-TestShelveInstance-1869927250-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:24:05.592581 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-160b027e-7ecf-403d-b733-a7fd5c08df2a tempest-TestShelveInstance-1869927250 tempest-TestShelveInstance-1869927250-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:24:05.593030 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-160b027e-7ecf-403d-b733-a7fd5c08df2a tempest-TestShelveInstance-1869927250 tempest-TestShelveInstance-1869927250-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:24:05.731311 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.policy [None req-160b027e-7ecf-403d-b733-a7fd5c08df2a tempest-TestShelveInstance-1869927250 tempest-TestShelveInstance-1869927250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6428e56cd9b46feb6a7b04e4d00c162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa9a1da5cb5a4279abb88ec7bdb1ef6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117874) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:24:05.739898 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [None req-160b027e-7ecf-403d-b733-a7fd5c08df2a tempest-TestShelveInstance-1869927250 tempest-TestShelveInstance-1869927250-project] 10.222.0.43 "GET /compute/v2.1/servers/46804c86-520a-407d-84a9-2f6d1ea1cff0" status: 200 len: 1260 microversion: 2.1 time: 0.161570 Jun 22 10:24:05.740638 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 440/873] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:24:05 2022] GET /compute/v2.1/servers/46804c86-520a-407d-84a9-2f6d1ea1cff0 => generated 1260 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:24:06.756964 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-ff4e5222-f42a-445a-a14b-837542d5972d tempest-TestShelveInstance-1869927250 tempest-TestShelveInstance-1869927250-project] Calling method '>' {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:24:06.757871 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.compute.api [None req-ff4e5222-f42a-445a-a14b-837542d5972d tempest-TestShelveInstance-1869927250 tempest-TestShelveInstance-1869927250-project] [instance: 46804c86-520a-407d-84a9-2f6d1ea1cff0] Fetching instance by UUID {{(pid=117873) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:24:06.769160 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG dbcounter [-] [117873] Writing DB stats nova_cell0:SELECT=2 {{(pid=117873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:24:06.771588 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-ff4e5222-f42a-445a-a14b-837542d5972d tempest-TestShelveInstance-1869927250 tempest-TestShelveInstance-1869927250-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:24:06.772225 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-ff4e5222-f42a-445a-a14b-837542d5972d tempest-TestShelveInstance-1869927250 tempest-TestShelveInstance-1869927250-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:24:06.773299 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-ff4e5222-f42a-445a-a14b-837542d5972d tempest-TestShelveInstance-1869927250 tempest-TestShelveInstance-1869927250-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:24:06.773757 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-ff4e5222-f42a-445a-a14b-837542d5972d tempest-TestShelveInstance-1869927250 tempest-TestShelveInstance-1869927250-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:24:06.933318 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.policy [None req-ff4e5222-f42a-445a-a14b-837542d5972d tempest-TestShelveInstance-1869927250 tempest-TestShelveInstance-1869927250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6428e56cd9b46feb6a7b04e4d00c162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa9a1da5cb5a4279abb88ec7bdb1ef6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117873) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:24:06.942044 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [None req-ff4e5222-f42a-445a-a14b-837542d5972d tempest-TestShelveInstance-1869927250 tempest-TestShelveInstance-1869927250-project] 10.222.0.43 "GET /compute/v2.1/servers/46804c86-520a-407d-84a9-2f6d1ea1cff0" status: 200 len: 1260 microversion: 2.1 time: 0.188847 Jun 22 10:24:06.942618 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 434/874] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:24:06 2022] GET /compute/v2.1/servers/46804c86-520a-407d-84a9-2f6d1ea1cff0 => generated 1260 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:24:07.958670 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-121b20cf-7faa-4585-984c-fce09167c57e tempest-TestShelveInstance-1869927250 tempest-TestShelveInstance-1869927250-project] Calling method '>' {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:24:07.959271 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.compute.api [None req-121b20cf-7faa-4585-984c-fce09167c57e tempest-TestShelveInstance-1869927250 tempest-TestShelveInstance-1869927250-project] [instance: 46804c86-520a-407d-84a9-2f6d1ea1cff0] Fetching instance by UUID {{(pid=117874) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:24:07.961196 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG dbcounter [-] [117874] Writing DB stats nova_cell0:SELECT=2 {{(pid=117874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:24:07.961940 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG dbcounter [-] [117874] Writing DB stats nova_cell0:SELECT=6 {{(pid=117874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:24:07.968359 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-121b20cf-7faa-4585-984c-fce09167c57e tempest-TestShelveInstance-1869927250 tempest-TestShelveInstance-1869927250-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:24:07.968801 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-121b20cf-7faa-4585-984c-fce09167c57e tempest-TestShelveInstance-1869927250 tempest-TestShelveInstance-1869927250-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:24:07.969548 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-121b20cf-7faa-4585-984c-fce09167c57e tempest-TestShelveInstance-1869927250 tempest-TestShelveInstance-1869927250-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:24:07.970000 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-121b20cf-7faa-4585-984c-fce09167c57e tempest-TestShelveInstance-1869927250 tempest-TestShelveInstance-1869927250-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:24:08.104291 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.policy [None req-121b20cf-7faa-4585-984c-fce09167c57e tempest-TestShelveInstance-1869927250 tempest-TestShelveInstance-1869927250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6428e56cd9b46feb6a7b04e4d00c162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa9a1da5cb5a4279abb88ec7bdb1ef6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117874) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:24:08.112564 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [None req-121b20cf-7faa-4585-984c-fce09167c57e tempest-TestShelveInstance-1869927250 tempest-TestShelveInstance-1869927250-project] 10.222.0.43 "GET /compute/v2.1/servers/46804c86-520a-407d-84a9-2f6d1ea1cff0" status: 200 len: 1260 microversion: 2.1 time: 0.157091 Jun 22 10:24:08.113145 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 441/875] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:24:07 2022] GET /compute/v2.1/servers/46804c86-520a-407d-84a9-2f6d1ea1cff0 => generated 1260 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:24:08.397627 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-855aceb4-7c65-4e7c-b998-1d12f75455c3 tempest-VolumesSnapshotTestJSON-1146371521 tempest-VolumesSnapshotTestJSON-1146371521-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1741670249", "imageRef": "22d2c064-5bf7-438e-bbb7-47259e4bdab5", "flavorRef": "452", "networks": [{"uuid": "20f65aeb-74a5-4851-b116-5aa3287c3229"}]}} {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:24:08.452737 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.network.neutron [None req-855aceb4-7c65-4e7c-b998-1d12f75455c3 tempest-VolumesSnapshotTestJSON-1146371521 tempest-VolumesSnapshotTestJSON-1146371521-project] validate_networks() for [('20f65aeb-74a5-4851-b116-5aa3287c3229', None, None, None, None, None)] {{(pid=117873) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 22 10:24:08.800066 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.virt.hardware [None req-855aceb4-7c65-4e7c-b998-1d12f75455c3 tempest-VolumesSnapshotTestJSON-1146371521 tempest-VolumesSnapshotTestJSON-1146371521-project] Flavor limits 0:0:0 {{(pid=117873) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 22 10:24:08.800512 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.virt.hardware [None req-855aceb4-7c65-4e7c-b998-1d12f75455c3 tempest-VolumesSnapshotTestJSON-1146371521 tempest-VolumesSnapshotTestJSON-1146371521-project] Image limits 0:0:0 {{(pid=117873) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 22 10:24:08.800995 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.virt.hardware [None req-855aceb4-7c65-4e7c-b998-1d12f75455c3 tempest-VolumesSnapshotTestJSON-1146371521 tempest-VolumesSnapshotTestJSON-1146371521-project] Flavor pref 0:0:0 {{(pid=117873) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 22 10:24:08.801396 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.virt.hardware [None req-855aceb4-7c65-4e7c-b998-1d12f75455c3 tempest-VolumesSnapshotTestJSON-1146371521 tempest-VolumesSnapshotTestJSON-1146371521-project] Image pref 0:0:0 {{(pid=117873) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 22 10:24:08.801829 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.virt.hardware [None req-855aceb4-7c65-4e7c-b998-1d12f75455c3 tempest-VolumesSnapshotTestJSON-1146371521 tempest-VolumesSnapshotTestJSON-1146371521-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117873) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 22 10:24:08.810632 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-855aceb4-7c65-4e7c-b998-1d12f75455c3 tempest-VolumesSnapshotTestJSON-1146371521 tempest-VolumesSnapshotTestJSON-1146371521-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:24:08.811010 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-855aceb4-7c65-4e7c-b998-1d12f75455c3 tempest-VolumesSnapshotTestJSON-1146371521 tempest-VolumesSnapshotTestJSON-1146371521-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:24:08.811783 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-855aceb4-7c65-4e7c-b998-1d12f75455c3 tempest-VolumesSnapshotTestJSON-1146371521 tempest-VolumesSnapshotTestJSON-1146371521-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:24:08.812206 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-855aceb4-7c65-4e7c-b998-1d12f75455c3 tempest-VolumesSnapshotTestJSON-1146371521 tempest-VolumesSnapshotTestJSON-1146371521-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:24:08.828723 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.quota [None req-855aceb4-7c65-4e7c-b998-1d12f75455c3 tempest-VolumesSnapshotTestJSON-1146371521 tempest-VolumesSnapshotTestJSON-1146371521-project] Getting quotas for project 60103a2f42f244e3af1d92a8a378fece. Resources: {'instances', 'cores', 'ram'} {{(pid=117873) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 22 10:24:08.833332 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.quota [None req-855aceb4-7c65-4e7c-b998-1d12f75455c3 tempest-VolumesSnapshotTestJSON-1146371521 tempest-VolumesSnapshotTestJSON-1146371521-project] Getting quotas for user b402c2d3251a411a818b61b872dca060 and project 60103a2f42f244e3af1d92a8a378fece. Resources: {'instances', 'cores', 'ram'} {{(pid=117873) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 22 10:24:08.844061 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.compute.api [None req-855aceb4-7c65-4e7c-b998-1d12f75455c3 tempest-VolumesSnapshotTestJSON-1146371521 tempest-VolumesSnapshotTestJSON-1146371521-project] Going to run 1 instances... {{(pid=117873) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 22 10:24:08.846306 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.compute.api [None req-855aceb4-7c65-4e7c-b998-1d12f75455c3 tempest-VolumesSnapshotTestJSON-1146371521 tempest-VolumesSnapshotTestJSON-1146371521-project] [instance: d281b861-2925-41cc-a964-79e622dcbfdc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='22d2c064-5bf7-438e-bbb7-47259e4bdab5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117873) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 22 10:24:08.888393 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR oslo.messaging._drivers.impl_rabbit [None req-855aceb4-7c65-4e7c-b998-1d12f75455c3 tempest-VolumesSnapshotTestJSON-1146371521 tempest-VolumesSnapshotTestJSON-1146371521-project] [6787de45-3ed9-45ae-947c-168ab9e92b7c] AMQP server on 10.222.0.43:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jun 22 10:24:09.129495 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-32aac978-6143-436b-a47c-1b762f284d21 tempest-TestShelveInstance-1869927250 tempest-TestShelveInstance-1869927250-project] Calling method '>' {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:24:09.130138 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.compute.api [None req-32aac978-6143-436b-a47c-1b762f284d21 tempest-TestShelveInstance-1869927250 tempest-TestShelveInstance-1869927250-project] [instance: 46804c86-520a-407d-84a9-2f6d1ea1cff0] Fetching instance by UUID {{(pid=117874) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:24:09.136734 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-32aac978-6143-436b-a47c-1b762f284d21 tempest-TestShelveInstance-1869927250 tempest-TestShelveInstance-1869927250-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:24:09.137182 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-32aac978-6143-436b-a47c-1b762f284d21 tempest-TestShelveInstance-1869927250 tempest-TestShelveInstance-1869927250-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:24:09.137973 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-32aac978-6143-436b-a47c-1b762f284d21 tempest-TestShelveInstance-1869927250 tempest-TestShelveInstance-1869927250-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:24:09.138412 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-32aac978-6143-436b-a47c-1b762f284d21 tempest-TestShelveInstance-1869927250 tempest-TestShelveInstance-1869927250-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:24:09.278047 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.policy [None req-32aac978-6143-436b-a47c-1b762f284d21 tempest-TestShelveInstance-1869927250 tempest-TestShelveInstance-1869927250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6428e56cd9b46feb6a7b04e4d00c162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa9a1da5cb5a4279abb88ec7bdb1ef6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117874) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:24:09.287404 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [None req-32aac978-6143-436b-a47c-1b762f284d21 tempest-TestShelveInstance-1869927250 tempest-TestShelveInstance-1869927250-project] 10.222.0.43 "GET /compute/v2.1/servers/46804c86-520a-407d-84a9-2f6d1ea1cff0" status: 200 len: 1260 microversion: 2.1 time: 0.162786 Jun 22 10:24:09.288218 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 442/876] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:24:09 2022] GET /compute/v2.1/servers/46804c86-520a-407d-84a9-2f6d1ea1cff0 => generated 1260 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 10:24:09.293341 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [req-259f06e7-777b-4cd2-bbaa-380d15a406ba req-b2e73589-20fa-4664-a53f-d92132a9dae0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "46804c86-520a-407d-84a9-2f6d1ea1cff0", "name": "network-vif-plugged", "status": "completed", "tag": "377da38d-a656-43c8-babd-6b00935ec9f5"}]} {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:24:09.302932 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [req-259f06e7-777b-4cd2-bbaa-380d15a406ba req-b2e73589-20fa-4664-a53f-d92132a9dae0 service nova] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:24:09.303371 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [req-259f06e7-777b-4cd2-bbaa-380d15a406ba req-b2e73589-20fa-4664-a53f-d92132a9dae0 service nova] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:24:09.314572 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.compute.server_external_events [req-259f06e7-777b-4cd2-bbaa-380d15a406ba req-b2e73589-20fa-4664-a53f-d92132a9dae0 service nova] Creating event network-vif-plugged:377da38d-a656-43c8-babd-6b00935ec9f5 for instance 46804c86-520a-407d-84a9-2f6d1ea1cff0 on hv-cinder-84713 Jun 22 10:24:09.320638 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [req-259f06e7-777b-4cd2-bbaa-380d15a406ba req-b2e73589-20fa-4664-a53f-d92132a9dae0 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030901 Jun 22 10:24:09.321415 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 443/877] 10.222.0.43 () {64 vars in 1317 bytes} [Wed Jun 22 10:24:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 10:24:09.896017 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO oslo.messaging._drivers.impl_rabbit [None req-855aceb4-7c65-4e7c-b998-1d12f75455c3 tempest-VolumesSnapshotTestJSON-1146371521 tempest-VolumesSnapshotTestJSON-1146371521-project] [6787de45-3ed9-45ae-947c-168ab9e92b7c] Reconnected to AMQP server on 10.222.0.43:5672 via [amqp] client with port 53108. Jun 22 10:24:09.900039 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [None req-855aceb4-7c65-4e7c-b998-1d12f75455c3 tempest-VolumesSnapshotTestJSON-1146371521 tempest-VolumesSnapshotTestJSON-1146371521-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.507875 Jun 22 10:24:09.900686 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 435/878] 10.222.0.43 () {60 vars in 1146 bytes} [Wed Jun 22 10:24:08 2022] POST /compute/v2.1/servers => generated 380 bytes in 1509 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 22 10:24:09.911944 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-3a09f85b-2b21-44e5-abb0-367636e0123f tempest-VolumesSnapshotTestJSON-1146371521 tempest-VolumesSnapshotTestJSON-1146371521-project] Calling method '>' {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:24:09.912637 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.compute.api [None req-3a09f85b-2b21-44e5-abb0-367636e0123f tempest-VolumesSnapshotTestJSON-1146371521 tempest-VolumesSnapshotTestJSON-1146371521-project] [instance: d281b861-2925-41cc-a964-79e622dcbfdc] Fetching instance by UUID {{(pid=117874) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:24:09.967811 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.policy [None req-3a09f85b-2b21-44e5-abb0-367636e0123f tempest-VolumesSnapshotTestJSON-1146371521 tempest-VolumesSnapshotTestJSON-1146371521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b402c2d3251a411a818b61b872dca060', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60103a2f42f244e3af1d92a8a378fece', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117874) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:24:09.975045 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [None req-3a09f85b-2b21-44e5-abb0-367636e0123f tempest-VolumesSnapshotTestJSON-1146371521 tempest-VolumesSnapshotTestJSON-1146371521-project] 10.222.0.43 "GET /compute/v2.1/servers/d281b861-2925-41cc-a964-79e622dcbfdc" status: 200 len: 1219 microversion: 2.1 time: 0.068072 Jun 22 10:24:09.975878 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 444/879] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:24:09 2022] GET /compute/v2.1/servers/d281b861-2925-41cc-a964-79e622dcbfdc => generated 1219 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:24:10.305028 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-986fb01a-3754-4595-8210-796a4441f903 tempest-TestShelveInstance-1869927250 tempest-TestShelveInstance-1869927250-project] Calling method '>' {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:24:10.305641 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.compute.api [None req-986fb01a-3754-4595-8210-796a4441f903 tempest-TestShelveInstance-1869927250 tempest-TestShelveInstance-1869927250-project] [instance: 46804c86-520a-407d-84a9-2f6d1ea1cff0] Fetching instance by UUID {{(pid=117873) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:24:10.312217 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-986fb01a-3754-4595-8210-796a4441f903 tempest-TestShelveInstance-1869927250 tempest-TestShelveInstance-1869927250-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:24:10.312838 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-986fb01a-3754-4595-8210-796a4441f903 tempest-TestShelveInstance-1869927250 tempest-TestShelveInstance-1869927250-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:24:10.313636 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-986fb01a-3754-4595-8210-796a4441f903 tempest-TestShelveInstance-1869927250 tempest-TestShelveInstance-1869927250-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:24:10.314169 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-986fb01a-3754-4595-8210-796a4441f903 tempest-TestShelveInstance-1869927250 tempest-TestShelveInstance-1869927250-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:24:10.451250 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.policy [None req-986fb01a-3754-4595-8210-796a4441f903 tempest-TestShelveInstance-1869927250 tempest-TestShelveInstance-1869927250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6428e56cd9b46feb6a7b04e4d00c162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa9a1da5cb5a4279abb88ec7bdb1ef6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117873) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:24:10.459802 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [None req-986fb01a-3754-4595-8210-796a4441f903 tempest-TestShelveInstance-1869927250 tempest-TestShelveInstance-1869927250-project] 10.222.0.43 "GET /compute/v2.1/servers/46804c86-520a-407d-84a9-2f6d1ea1cff0" status: 200 len: 1260 microversion: 2.1 time: 0.158986 Jun 22 10:24:10.460454 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 436/880] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:24:10 2022] GET /compute/v2.1/servers/46804c86-520a-407d-84a9-2f6d1ea1cff0 => generated 1260 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:24:10.992980 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-ac85d1e0-afca-47de-828f-0df0b774e6db tempest-VolumesSnapshotTestJSON-1146371521 tempest-VolumesSnapshotTestJSON-1146371521-project] Calling method '>' {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:24:10.993492 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.compute.api [None req-ac85d1e0-afca-47de-828f-0df0b774e6db tempest-VolumesSnapshotTestJSON-1146371521 tempest-VolumesSnapshotTestJSON-1146371521-project] [instance: d281b861-2925-41cc-a964-79e622dcbfdc] Fetching instance by UUID {{(pid=117874) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:24:11.001187 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-ac85d1e0-afca-47de-828f-0df0b774e6db tempest-VolumesSnapshotTestJSON-1146371521 tempest-VolumesSnapshotTestJSON-1146371521-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:24:11.001621 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-ac85d1e0-afca-47de-828f-0df0b774e6db tempest-VolumesSnapshotTestJSON-1146371521 tempest-VolumesSnapshotTestJSON-1146371521-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:24:11.003266 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-ac85d1e0-afca-47de-828f-0df0b774e6db tempest-VolumesSnapshotTestJSON-1146371521 tempest-VolumesSnapshotTestJSON-1146371521-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:24:11.003743 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-ac85d1e0-afca-47de-828f-0df0b774e6db tempest-VolumesSnapshotTestJSON-1146371521 tempest-VolumesSnapshotTestJSON-1146371521-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:24:11.066932 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.policy [None req-ac85d1e0-afca-47de-828f-0df0b774e6db tempest-VolumesSnapshotTestJSON-1146371521 tempest-VolumesSnapshotTestJSON-1146371521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b402c2d3251a411a818b61b872dca060', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60103a2f42f244e3af1d92a8a378fece', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117874) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:24:11.074469 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [None req-ac85d1e0-afca-47de-828f-0df0b774e6db tempest-VolumesSnapshotTestJSON-1146371521 tempest-VolumesSnapshotTestJSON-1146371521-project] 10.222.0.43 "GET /compute/v2.1/servers/d281b861-2925-41cc-a964-79e622dcbfdc" status: 200 len: 1271 microversion: 2.1 time: 0.085495 Jun 22 10:24:11.075031 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 445/881] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:24:10 2022] GET /compute/v2.1/servers/d281b861-2925-41cc-a964-79e622dcbfdc => generated 1271 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:24:11.477305 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-23400b2b-46ec-4f27-af39-408241e5cbb1 tempest-TestShelveInstance-1869927250 tempest-TestShelveInstance-1869927250-project] Calling method '>' {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:24:11.478169 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.compute.api [None req-23400b2b-46ec-4f27-af39-408241e5cbb1 tempest-TestShelveInstance-1869927250 tempest-TestShelveInstance-1869927250-project] [instance: 46804c86-520a-407d-84a9-2f6d1ea1cff0] Fetching instance by UUID {{(pid=117873) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:24:11.484562 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-23400b2b-46ec-4f27-af39-408241e5cbb1 tempest-TestShelveInstance-1869927250 tempest-TestShelveInstance-1869927250-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:24:11.485013 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-23400b2b-46ec-4f27-af39-408241e5cbb1 tempest-TestShelveInstance-1869927250 tempest-TestShelveInstance-1869927250-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:24:11.485801 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-23400b2b-46ec-4f27-af39-408241e5cbb1 tempest-TestShelveInstance-1869927250 tempest-TestShelveInstance-1869927250-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:24:11.486257 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-23400b2b-46ec-4f27-af39-408241e5cbb1 tempest-TestShelveInstance-1869927250 tempest-TestShelveInstance-1869927250-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:24:11.631865 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.policy [None req-23400b2b-46ec-4f27-af39-408241e5cbb1 tempest-TestShelveInstance-1869927250 tempest-TestShelveInstance-1869927250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6428e56cd9b46feb6a7b04e4d00c162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa9a1da5cb5a4279abb88ec7bdb1ef6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117873) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:24:11.641571 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [None req-23400b2b-46ec-4f27-af39-408241e5cbb1 tempest-TestShelveInstance-1869927250 tempest-TestShelveInstance-1869927250-project] 10.222.0.43 "GET /compute/v2.1/servers/46804c86-520a-407d-84a9-2f6d1ea1cff0" status: 200 len: 1443 microversion: 2.1 time: 0.168360 Jun 22 10:24:11.642170 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 437/882] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:24:11 2022] GET /compute/v2.1/servers/46804c86-520a-407d-84a9-2f6d1ea1cff0 => generated 1443 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:24:11.657809 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-8d1ec63f-b403-4f3c-8b7e-1f205b023b34 tempest-TestShelveInstance-1869927250 tempest-TestShelveInstance-1869927250-project] Calling method '>' {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:24:11.659426 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.compute.api [None req-8d1ec63f-b403-4f3c-8b7e-1f205b023b34 tempest-TestShelveInstance-1869927250 tempest-TestShelveInstance-1869927250-project] [instance: 46804c86-520a-407d-84a9-2f6d1ea1cff0] Fetching instance by UUID {{(pid=117874) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:24:11.665130 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-8d1ec63f-b403-4f3c-8b7e-1f205b023b34 tempest-TestShelveInstance-1869927250 tempest-TestShelveInstance-1869927250-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:24:11.665570 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-8d1ec63f-b403-4f3c-8b7e-1f205b023b34 tempest-TestShelveInstance-1869927250 tempest-TestShelveInstance-1869927250-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:24:11.666357 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-8d1ec63f-b403-4f3c-8b7e-1f205b023b34 tempest-TestShelveInstance-1869927250 tempest-TestShelveInstance-1869927250-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:24:11.666782 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-8d1ec63f-b403-4f3c-8b7e-1f205b023b34 tempest-TestShelveInstance-1869927250 tempest-TestShelveInstance-1869927250-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:24:11.801952 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.policy [None req-8d1ec63f-b403-4f3c-8b7e-1f205b023b34 tempest-TestShelveInstance-1869927250 tempest-TestShelveInstance-1869927250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6428e56cd9b46feb6a7b04e4d00c162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa9a1da5cb5a4279abb88ec7bdb1ef6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117874) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:24:11.809400 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [None req-8d1ec63f-b403-4f3c-8b7e-1f205b023b34 tempest-TestShelveInstance-1869927250 tempest-TestShelveInstance-1869927250-project] 10.222.0.43 "GET /compute/v2.1/servers/46804c86-520a-407d-84a9-2f6d1ea1cff0" status: 200 len: 1443 microversion: 2.1 time: 0.155443 Jun 22 10:24:11.809992 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 446/883] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:24:11 2022] GET /compute/v2.1/servers/46804c86-520a-407d-84a9-2f6d1ea1cff0 => generated 1443 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:24:12.094598 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-088594f4-54ef-45b7-88ad-b298f5d9fbd1 tempest-VolumesSnapshotTestJSON-1146371521 tempest-VolumesSnapshotTestJSON-1146371521-project] Calling method '>' {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:24:12.096518 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.compute.api [None req-088594f4-54ef-45b7-88ad-b298f5d9fbd1 tempest-VolumesSnapshotTestJSON-1146371521 tempest-VolumesSnapshotTestJSON-1146371521-project] [instance: d281b861-2925-41cc-a964-79e622dcbfdc] Fetching instance by UUID {{(pid=117873) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:24:12.105299 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-088594f4-54ef-45b7-88ad-b298f5d9fbd1 tempest-VolumesSnapshotTestJSON-1146371521 tempest-VolumesSnapshotTestJSON-1146371521-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:24:12.105779 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-088594f4-54ef-45b7-88ad-b298f5d9fbd1 tempest-VolumesSnapshotTestJSON-1146371521 tempest-VolumesSnapshotTestJSON-1146371521-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:24:12.107386 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-088594f4-54ef-45b7-88ad-b298f5d9fbd1 tempest-VolumesSnapshotTestJSON-1146371521 tempest-VolumesSnapshotTestJSON-1146371521-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:24:12.108088 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-088594f4-54ef-45b7-88ad-b298f5d9fbd1 tempest-VolumesSnapshotTestJSON-1146371521 tempest-VolumesSnapshotTestJSON-1146371521-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:24:12.329104 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.policy [None req-088594f4-54ef-45b7-88ad-b298f5d9fbd1 tempest-VolumesSnapshotTestJSON-1146371521 tempest-VolumesSnapshotTestJSON-1146371521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b402c2d3251a411a818b61b872dca060', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60103a2f42f244e3af1d92a8a378fece', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117873) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:24:12.336970 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [None req-088594f4-54ef-45b7-88ad-b298f5d9fbd1 tempest-VolumesSnapshotTestJSON-1146371521 tempest-VolumesSnapshotTestJSON-1146371521-project] 10.222.0.43 "GET /compute/v2.1/servers/d281b861-2925-41cc-a964-79e622dcbfdc" status: 200 len: 1319 microversion: 2.1 time: 0.248107 Jun 22 10:24:12.337814 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 438/884] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:24:12 2022] GET /compute/v2.1/servers/d281b861-2925-41cc-a964-79e622dcbfdc => generated 1319 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:24:12.696216 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [req-c40fbf01-d0c1-48f8-8dfa-4ffedb6f71df req-93a5af3c-e54c-4380-9df5-693cfb46f4e8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d281b861-2925-41cc-a964-79e622dcbfdc", "tag": "1203a959-9e1d-4f8a-8cd2-be55ac1d8869"}]} {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:24:12.707984 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [req-c40fbf01-d0c1-48f8-8dfa-4ffedb6f71df req-93a5af3c-e54c-4380-9df5-693cfb46f4e8 service nova] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:24:12.708584 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [req-c40fbf01-d0c1-48f8-8dfa-4ffedb6f71df req-93a5af3c-e54c-4380-9df5-693cfb46f4e8 service nova] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:24:12.722997 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.compute.server_external_events [req-c40fbf01-d0c1-48f8-8dfa-4ffedb6f71df req-93a5af3c-e54c-4380-9df5-693cfb46f4e8 service nova] Creating event network-changed:1203a959-9e1d-4f8a-8cd2-be55ac1d8869 for instance d281b861-2925-41cc-a964-79e622dcbfdc on hv-cinder-84713 Jun 22 10:24:12.728589 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [req-c40fbf01-d0c1-48f8-8dfa-4ffedb6f71df req-93a5af3c-e54c-4380-9df5-693cfb46f4e8 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037912 Jun 22 10:24:12.729346 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 447/885] 10.222.0.43 () {64 vars in 1317 bytes} [Wed Jun 22 10:24:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 10:24:13.354844 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-8f0d6804-0ef9-42b3-a4cb-19bb849bbc91 tempest-VolumesSnapshotTestJSON-1146371521 tempest-VolumesSnapshotTestJSON-1146371521-project] Calling method '>' {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:24:13.355451 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.compute.api [None req-8f0d6804-0ef9-42b3-a4cb-19bb849bbc91 tempest-VolumesSnapshotTestJSON-1146371521 tempest-VolumesSnapshotTestJSON-1146371521-project] [instance: d281b861-2925-41cc-a964-79e622dcbfdc] Fetching instance by UUID {{(pid=117873) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:24:13.362240 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-8f0d6804-0ef9-42b3-a4cb-19bb849bbc91 tempest-VolumesSnapshotTestJSON-1146371521 tempest-VolumesSnapshotTestJSON-1146371521-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:24:13.362684 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-8f0d6804-0ef9-42b3-a4cb-19bb849bbc91 tempest-VolumesSnapshotTestJSON-1146371521 tempest-VolumesSnapshotTestJSON-1146371521-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:24:13.363452 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-8f0d6804-0ef9-42b3-a4cb-19bb849bbc91 tempest-VolumesSnapshotTestJSON-1146371521 tempest-VolumesSnapshotTestJSON-1146371521-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:24:13.363879 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-8f0d6804-0ef9-42b3-a4cb-19bb849bbc91 tempest-VolumesSnapshotTestJSON-1146371521 tempest-VolumesSnapshotTestJSON-1146371521-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:24:13.600155 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.policy [None req-8f0d6804-0ef9-42b3-a4cb-19bb849bbc91 tempest-VolumesSnapshotTestJSON-1146371521 tempest-VolumesSnapshotTestJSON-1146371521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b402c2d3251a411a818b61b872dca060', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60103a2f42f244e3af1d92a8a378fece', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117873) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:24:13.607757 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [None req-8f0d6804-0ef9-42b3-a4cb-19bb849bbc91 tempest-VolumesSnapshotTestJSON-1146371521 tempest-VolumesSnapshotTestJSON-1146371521-project] 10.222.0.43 "GET /compute/v2.1/servers/d281b861-2925-41cc-a964-79e622dcbfdc" status: 200 len: 1319 microversion: 2.1 time: 0.257078 Jun 22 10:24:13.608317 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 439/886] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:24:13 2022] GET /compute/v2.1/servers/d281b861-2925-41cc-a964-79e622dcbfdc => generated 1319 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:24:14.109521 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [req-85ff7151-9f02-4be5-bdf2-2faa4654bf3c req-ab937463-ad17-49eb-bb91-b6c7a8ceba08 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "46804c86-520a-407d-84a9-2f6d1ea1cff0", "tag": "377da38d-a656-43c8-babd-6b00935ec9f5"}]} {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:24:14.119253 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [req-85ff7151-9f02-4be5-bdf2-2faa4654bf3c req-ab937463-ad17-49eb-bb91-b6c7a8ceba08 service nova] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:24:14.119699 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [req-85ff7151-9f02-4be5-bdf2-2faa4654bf3c req-ab937463-ad17-49eb-bb91-b6c7a8ceba08 service nova] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:24:14.132576 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.compute.server_external_events [req-85ff7151-9f02-4be5-bdf2-2faa4654bf3c req-ab937463-ad17-49eb-bb91-b6c7a8ceba08 service nova] Creating event network-changed:377da38d-a656-43c8-babd-6b00935ec9f5 for instance 46804c86-520a-407d-84a9-2f6d1ea1cff0 on hv-cinder-84713 Jun 22 10:24:14.138029 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [req-85ff7151-9f02-4be5-bdf2-2faa4654bf3c req-ab937463-ad17-49eb-bb91-b6c7a8ceba08 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.175041 Jun 22 10:24:14.141537 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 448/887] 10.222.0.43 () {64 vars in 1317 bytes} [Wed Jun 22 10:24:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 10:24:14.625561 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-82860dff-f2c6-4b55-a030-7a0267d1d15b tempest-VolumesSnapshotTestJSON-1146371521 tempest-VolumesSnapshotTestJSON-1146371521-project] Calling method '>' {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:24:14.626401 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.compute.api [None req-82860dff-f2c6-4b55-a030-7a0267d1d15b tempest-VolumesSnapshotTestJSON-1146371521 tempest-VolumesSnapshotTestJSON-1146371521-project] [instance: d281b861-2925-41cc-a964-79e622dcbfdc] Fetching instance by UUID {{(pid=117873) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:24:14.633743 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-82860dff-f2c6-4b55-a030-7a0267d1d15b tempest-VolumesSnapshotTestJSON-1146371521 tempest-VolumesSnapshotTestJSON-1146371521-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:24:14.634266 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-82860dff-f2c6-4b55-a030-7a0267d1d15b tempest-VolumesSnapshotTestJSON-1146371521 tempest-VolumesSnapshotTestJSON-1146371521-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:24:14.635093 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-82860dff-f2c6-4b55-a030-7a0267d1d15b tempest-VolumesSnapshotTestJSON-1146371521 tempest-VolumesSnapshotTestJSON-1146371521-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:24:14.635594 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-82860dff-f2c6-4b55-a030-7a0267d1d15b tempest-VolumesSnapshotTestJSON-1146371521 tempest-VolumesSnapshotTestJSON-1146371521-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:24:14.773507 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.policy [None req-82860dff-f2c6-4b55-a030-7a0267d1d15b tempest-VolumesSnapshotTestJSON-1146371521 tempest-VolumesSnapshotTestJSON-1146371521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b402c2d3251a411a818b61b872dca060', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60103a2f42f244e3af1d92a8a378fece', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117873) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:24:14.782435 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [None req-82860dff-f2c6-4b55-a030-7a0267d1d15b tempest-VolumesSnapshotTestJSON-1146371521 tempest-VolumesSnapshotTestJSON-1146371521-project] 10.222.0.43 "GET /compute/v2.1/servers/d281b861-2925-41cc-a964-79e622dcbfdc" status: 200 len: 1319 microversion: 2.1 time: 0.161144 Jun 22 10:24:14.792133 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 440/888] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:24:14 2022] GET /compute/v2.1/servers/d281b861-2925-41cc-a964-79e622dcbfdc => generated 1319 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 10:24:15.801106 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-d8bae099-bae6-4681-9bba-2f9da34f1ee7 tempest-VolumesSnapshotTestJSON-1146371521 tempest-VolumesSnapshotTestJSON-1146371521-project] Calling method '>' {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:24:15.801771 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.compute.api [None req-d8bae099-bae6-4681-9bba-2f9da34f1ee7 tempest-VolumesSnapshotTestJSON-1146371521 tempest-VolumesSnapshotTestJSON-1146371521-project] [instance: d281b861-2925-41cc-a964-79e622dcbfdc] Fetching instance by UUID {{(pid=117874) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:24:15.808293 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-d8bae099-bae6-4681-9bba-2f9da34f1ee7 tempest-VolumesSnapshotTestJSON-1146371521 tempest-VolumesSnapshotTestJSON-1146371521-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:24:15.808778 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-d8bae099-bae6-4681-9bba-2f9da34f1ee7 tempest-VolumesSnapshotTestJSON-1146371521 tempest-VolumesSnapshotTestJSON-1146371521-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:24:15.809582 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-d8bae099-bae6-4681-9bba-2f9da34f1ee7 tempest-VolumesSnapshotTestJSON-1146371521 tempest-VolumesSnapshotTestJSON-1146371521-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:24:15.810048 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-d8bae099-bae6-4681-9bba-2f9da34f1ee7 tempest-VolumesSnapshotTestJSON-1146371521 tempest-VolumesSnapshotTestJSON-1146371521-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:24:15.955742 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.policy [None req-d8bae099-bae6-4681-9bba-2f9da34f1ee7 tempest-VolumesSnapshotTestJSON-1146371521 tempest-VolumesSnapshotTestJSON-1146371521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b402c2d3251a411a818b61b872dca060', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60103a2f42f244e3af1d92a8a378fece', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117874) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:24:15.963463 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [None req-d8bae099-bae6-4681-9bba-2f9da34f1ee7 tempest-VolumesSnapshotTestJSON-1146371521 tempest-VolumesSnapshotTestJSON-1146371521-project] 10.222.0.43 "GET /compute/v2.1/servers/d281b861-2925-41cc-a964-79e622dcbfdc" status: 200 len: 1319 microversion: 2.1 time: 0.167929 Jun 22 10:24:15.964076 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 449/889] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:24:15 2022] GET /compute/v2.1/servers/d281b861-2925-41cc-a964-79e622dcbfdc => generated 1319 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:24:16.981039 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-3383f3b0-e95c-4286-b8ec-0c006dc20f65 tempest-VolumesSnapshotTestJSON-1146371521 tempest-VolumesSnapshotTestJSON-1146371521-project] Calling method '>' {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:24:16.981647 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.compute.api [None req-3383f3b0-e95c-4286-b8ec-0c006dc20f65 tempest-VolumesSnapshotTestJSON-1146371521 tempest-VolumesSnapshotTestJSON-1146371521-project] [instance: d281b861-2925-41cc-a964-79e622dcbfdc] Fetching instance by UUID {{(pid=117873) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:24:16.988949 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-3383f3b0-e95c-4286-b8ec-0c006dc20f65 tempest-VolumesSnapshotTestJSON-1146371521 tempest-VolumesSnapshotTestJSON-1146371521-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:24:16.989393 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-3383f3b0-e95c-4286-b8ec-0c006dc20f65 tempest-VolumesSnapshotTestJSON-1146371521 tempest-VolumesSnapshotTestJSON-1146371521-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:24:16.990178 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-3383f3b0-e95c-4286-b8ec-0c006dc20f65 tempest-VolumesSnapshotTestJSON-1146371521 tempest-VolumesSnapshotTestJSON-1146371521-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:24:16.990613 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-3383f3b0-e95c-4286-b8ec-0c006dc20f65 tempest-VolumesSnapshotTestJSON-1146371521 tempest-VolumesSnapshotTestJSON-1146371521-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:24:17.121413 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.policy [None req-3383f3b0-e95c-4286-b8ec-0c006dc20f65 tempest-VolumesSnapshotTestJSON-1146371521 tempest-VolumesSnapshotTestJSON-1146371521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b402c2d3251a411a818b61b872dca060', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60103a2f42f244e3af1d92a8a378fece', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117873) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:24:17.128974 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [None req-3383f3b0-e95c-4286-b8ec-0c006dc20f65 tempest-VolumesSnapshotTestJSON-1146371521 tempest-VolumesSnapshotTestJSON-1146371521-project] 10.222.0.43 "GET /compute/v2.1/servers/d281b861-2925-41cc-a964-79e622dcbfdc" status: 200 len: 1319 microversion: 2.1 time: 0.152193 Jun 22 10:24:17.129540 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 441/890] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:24:16 2022] GET /compute/v2.1/servers/d281b861-2925-41cc-a964-79e622dcbfdc => generated 1319 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 10:24:17.276116 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [req-a1edb728-c548-449f-8a00-0a1cbf730d05 req-3a59d427-6d82-46bd-bded-385342d86a4d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d281b861-2925-41cc-a964-79e622dcbfdc", "name": "network-vif-plugged", "status": "completed", "tag": "1203a959-9e1d-4f8a-8cd2-be55ac1d8869"}]} {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:24:17.286044 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [req-a1edb728-c548-449f-8a00-0a1cbf730d05 req-3a59d427-6d82-46bd-bded-385342d86a4d service nova] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:24:17.286499 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [req-a1edb728-c548-449f-8a00-0a1cbf730d05 req-3a59d427-6d82-46bd-bded-385342d86a4d service nova] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:24:17.301157 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.compute.server_external_events [req-a1edb728-c548-449f-8a00-0a1cbf730d05 req-3a59d427-6d82-46bd-bded-385342d86a4d service nova] Creating event network-vif-plugged:1203a959-9e1d-4f8a-8cd2-be55ac1d8869 for instance d281b861-2925-41cc-a964-79e622dcbfdc on hv-cinder-84713 Jun 22 10:24:17.306028 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [req-a1edb728-c548-449f-8a00-0a1cbf730d05 req-3a59d427-6d82-46bd-bded-385342d86a4d service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034091 Jun 22 10:24:17.306938 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 450/891] 10.222.0.43 () {64 vars in 1317 bytes} [Wed Jun 22 10:24:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 10:24:18.146650 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-a9502dd1-c03e-446a-b3cb-cdd23c83cf84 tempest-VolumesSnapshotTestJSON-1146371521 tempest-VolumesSnapshotTestJSON-1146371521-project] Calling method '>' {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:24:18.147258 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.compute.api [None req-a9502dd1-c03e-446a-b3cb-cdd23c83cf84 tempest-VolumesSnapshotTestJSON-1146371521 tempest-VolumesSnapshotTestJSON-1146371521-project] [instance: d281b861-2925-41cc-a964-79e622dcbfdc] Fetching instance by UUID {{(pid=117873) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:24:18.153272 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-a9502dd1-c03e-446a-b3cb-cdd23c83cf84 tempest-VolumesSnapshotTestJSON-1146371521 tempest-VolumesSnapshotTestJSON-1146371521-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:24:18.153741 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-a9502dd1-c03e-446a-b3cb-cdd23c83cf84 tempest-VolumesSnapshotTestJSON-1146371521 tempest-VolumesSnapshotTestJSON-1146371521-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:24:18.154504 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-a9502dd1-c03e-446a-b3cb-cdd23c83cf84 tempest-VolumesSnapshotTestJSON-1146371521 tempest-VolumesSnapshotTestJSON-1146371521-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:24:18.154933 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-a9502dd1-c03e-446a-b3cb-cdd23c83cf84 tempest-VolumesSnapshotTestJSON-1146371521 tempest-VolumesSnapshotTestJSON-1146371521-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:24:18.284176 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.policy [None req-a9502dd1-c03e-446a-b3cb-cdd23c83cf84 tempest-VolumesSnapshotTestJSON-1146371521 tempest-VolumesSnapshotTestJSON-1146371521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b402c2d3251a411a818b61b872dca060', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60103a2f42f244e3af1d92a8a378fece', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117873) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:24:18.291544 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [None req-a9502dd1-c03e-446a-b3cb-cdd23c83cf84 tempest-VolumesSnapshotTestJSON-1146371521 tempest-VolumesSnapshotTestJSON-1146371521-project] 10.222.0.43 "GET /compute/v2.1/servers/d281b861-2925-41cc-a964-79e622dcbfdc" status: 200 len: 1319 microversion: 2.1 time: 0.149590 Jun 22 10:24:18.292101 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 442/892] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:24:18 2022] GET /compute/v2.1/servers/d281b861-2925-41cc-a964-79e622dcbfdc => generated 1319 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:24:19.310049 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-07e3fc96-3ef3-45c6-aab5-9605815e7691 tempest-VolumesSnapshotTestJSON-1146371521 tempest-VolumesSnapshotTestJSON-1146371521-project] Calling method '>' {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:24:19.310732 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.compute.api [None req-07e3fc96-3ef3-45c6-aab5-9605815e7691 tempest-VolumesSnapshotTestJSON-1146371521 tempest-VolumesSnapshotTestJSON-1146371521-project] [instance: d281b861-2925-41cc-a964-79e622dcbfdc] Fetching instance by UUID {{(pid=117874) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:24:19.319197 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-07e3fc96-3ef3-45c6-aab5-9605815e7691 tempest-VolumesSnapshotTestJSON-1146371521 tempest-VolumesSnapshotTestJSON-1146371521-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:24:19.319642 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-07e3fc96-3ef3-45c6-aab5-9605815e7691 tempest-VolumesSnapshotTestJSON-1146371521 tempest-VolumesSnapshotTestJSON-1146371521-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:24:19.320397 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-07e3fc96-3ef3-45c6-aab5-9605815e7691 tempest-VolumesSnapshotTestJSON-1146371521 tempest-VolumesSnapshotTestJSON-1146371521-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:24:19.320828 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-07e3fc96-3ef3-45c6-aab5-9605815e7691 tempest-VolumesSnapshotTestJSON-1146371521 tempest-VolumesSnapshotTestJSON-1146371521-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:24:19.453577 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.policy [None req-07e3fc96-3ef3-45c6-aab5-9605815e7691 tempest-VolumesSnapshotTestJSON-1146371521 tempest-VolumesSnapshotTestJSON-1146371521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b402c2d3251a411a818b61b872dca060', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60103a2f42f244e3af1d92a8a378fece', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117874) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:24:19.460977 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [None req-07e3fc96-3ef3-45c6-aab5-9605815e7691 tempest-VolumesSnapshotTestJSON-1146371521 tempest-VolumesSnapshotTestJSON-1146371521-project] 10.222.0.43 "GET /compute/v2.1/servers/d281b861-2925-41cc-a964-79e622dcbfdc" status: 200 len: 1509 microversion: 2.1 time: 0.155136 Jun 22 10:24:19.461530 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 451/893] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:24:19 2022] GET /compute/v2.1/servers/d281b861-2925-41cc-a964-79e622dcbfdc => generated 1509 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:24:35.626641 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-d3d21899-a47a-49ae-92ee-2bc5878aa84e tempest-VolumesSnapshotTestJSON-1146371521 tempest-VolumesSnapshotTestJSON-1146371521-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3126fb48-05fd-4d8e-ad20-c3f0c77ce9ba", "device": "/dev/sdb"}} {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:24:35.628273 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.compute.api [None req-d3d21899-a47a-49ae-92ee-2bc5878aa84e tempest-VolumesSnapshotTestJSON-1146371521 tempest-VolumesSnapshotTestJSON-1146371521-project] [instance: d281b861-2925-41cc-a964-79e622dcbfdc] Fetching instance by UUID {{(pid=117873) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:24:35.630237 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG dbcounter [-] [117873] Writing DB stats nova_cell0:SELECT=2 {{(pid=117873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:24:35.631034 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG dbcounter [-] [117873] Writing DB stats nova_cell0:SELECT=6 {{(pid=117873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:24:35.632271 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG dbcounter [-] [117873] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=3 {{(pid=117873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:24:35.632999 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG dbcounter [-] [117873] Writing DB stats nova_cell1:SELECT=74 {{(pid=117873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:24:35.639967 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-d3d21899-a47a-49ae-92ee-2bc5878aa84e tempest-VolumesSnapshotTestJSON-1146371521 tempest-VolumesSnapshotTestJSON-1146371521-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:24:35.640434 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-d3d21899-a47a-49ae-92ee-2bc5878aa84e tempest-VolumesSnapshotTestJSON-1146371521 tempest-VolumesSnapshotTestJSON-1146371521-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:24:35.641166 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-d3d21899-a47a-49ae-92ee-2bc5878aa84e tempest-VolumesSnapshotTestJSON-1146371521 tempest-VolumesSnapshotTestJSON-1146371521-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:24:35.641595 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-d3d21899-a47a-49ae-92ee-2bc5878aa84e tempest-VolumesSnapshotTestJSON-1146371521 tempest-VolumesSnapshotTestJSON-1146371521-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:24:35.720648 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR oslo.messaging._drivers.impl_rabbit [None req-d3d21899-a47a-49ae-92ee-2bc5878aa84e tempest-VolumesSnapshotTestJSON-1146371521 tempest-VolumesSnapshotTestJSON-1146371521-project] [722c141d-b5be-4169-a340-eeae0c77ee4e] AMQP server on 10.222.0.43:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jun 22 10:24:36.728767 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO oslo.messaging._drivers.impl_rabbit [None req-d3d21899-a47a-49ae-92ee-2bc5878aa84e tempest-VolumesSnapshotTestJSON-1146371521 tempest-VolumesSnapshotTestJSON-1146371521-project] [722c141d-b5be-4169-a340-eeae0c77ee4e] Reconnected to AMQP server on 10.222.0.43:5672 via [amqp] client with port 53270. Jun 22 10:24:36.889146 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [None req-d3d21899-a47a-49ae-92ee-2bc5878aa84e tempest-VolumesSnapshotTestJSON-1146371521 tempest-VolumesSnapshotTestJSON-1146371521-project] 10.222.0.43 "POST /compute/v2.1/servers/d281b861-2925-41cc-a964-79e622dcbfdc/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.266310 Jun 22 10:24:36.889906 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 443/894] 10.222.0.43 () {60 vars in 1322 bytes} [Wed Jun 22 10:24:35 2022] POST /compute/v2.1/servers/d281b861-2925-41cc-a964-79e622dcbfdc/os-volume_attachments => generated 194 bytes in 1268 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 10:24:52.521033 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-a26644a9-f0e3-4e3b-af92-e4d007d3b5a3 tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-2130427334", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1986835772", "security_groups": [{"name": "tempest-secgroup-smoke-1789065302"}], "block_device_mapping_v2": [{"uuid": "6e8ded8c-5f07-4c40-b366-655d4712b3fa", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "96156af8-0bc3-4b6c-bec6-429f61356c8a"}]}} {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:24:52.529284 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG dbcounter [-] [117874] Writing DB stats nova_cell0:SELECT=2 {{(pid=117874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:24:52.530088 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG dbcounter [-] [117874] Writing DB stats nova_api:SELECT=49,nova_api:INSERT=3 {{(pid=117874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:24:52.530776 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG dbcounter [-] [117874] Writing DB stats nova_cell1:SELECT=72 {{(pid=117874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:24:52.635625 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.network.neutron [None req-a26644a9-f0e3-4e3b-af92-e4d007d3b5a3 tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] validate_networks() for [('96156af8-0bc3-4b6c-bec6-429f61356c8a', None, None, None, None, None)] {{(pid=117874) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 22 10:24:52.996990 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.virt.hardware [None req-a26644a9-f0e3-4e3b-af92-e4d007d3b5a3 tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] Flavor limits 0:0:0 {{(pid=117874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 22 10:24:52.997417 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.virt.hardware [None req-a26644a9-f0e3-4e3b-af92-e4d007d3b5a3 tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] Image limits 0:0:0 {{(pid=117874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 22 10:24:52.997930 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.virt.hardware [None req-a26644a9-f0e3-4e3b-af92-e4d007d3b5a3 tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] Flavor pref 0:0:0 {{(pid=117874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 22 10:24:52.998341 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.virt.hardware [None req-a26644a9-f0e3-4e3b-af92-e4d007d3b5a3 tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] Image pref 0:0:0 {{(pid=117874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 22 10:24:52.998753 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.virt.hardware [None req-a26644a9-f0e3-4e3b-af92-e4d007d3b5a3 tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 22 10:24:53.008361 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-a26644a9-f0e3-4e3b-af92-e4d007d3b5a3 tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:24:53.008817 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-a26644a9-f0e3-4e3b-af92-e4d007d3b5a3 tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:24:53.009620 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-a26644a9-f0e3-4e3b-af92-e4d007d3b5a3 tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:24:53.010090 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-a26644a9-f0e3-4e3b-af92-e4d007d3b5a3 tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:24:53.027449 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.quota [None req-a26644a9-f0e3-4e3b-af92-e4d007d3b5a3 tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] Getting quotas for project 1cb1af845e594466b12a11b7cab99a7c. Resources: {'instances', 'cores', 'ram'} {{(pid=117874) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 22 10:24:53.031424 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.quota [None req-a26644a9-f0e3-4e3b-af92-e4d007d3b5a3 tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] Getting quotas for user b2d3aa18a0a146808f584127411a1cf5 and project 1cb1af845e594466b12a11b7cab99a7c. Resources: {'instances', 'cores', 'ram'} {{(pid=117874) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 22 10:24:53.089013 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.compute.api [None req-a26644a9-f0e3-4e3b-af92-e4d007d3b5a3 tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] Going to run 1 instances... {{(pid=117874) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 22 10:24:53.091270 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.compute.api [None req-a26644a9-f0e3-4e3b-af92-e4d007d3b5a3 tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] [instance: 8d4bd5f5-1caa-4165-a7d3-73f338df3073] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='6e8ded8c-5f07-4c40-b366-655d4712b3fa',volume_size=None,volume_type=None)] {{(pid=117874) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 22 10:24:53.220147 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [None req-a26644a9-f0e3-4e3b-af92-e4d007d3b5a3 tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.703845 Jun 22 10:24:53.220784 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 452/895] 10.222.0.43 () {60 vars in 1146 bytes} [Wed Jun 22 10:24:52 2022] POST /compute/v2.1/servers => generated 406 bytes in 705 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 22 10:24:53.232418 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-f00ebe7f-3d42-4621-895c-38e38fc4cd53 tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] Calling method '>' {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:24:53.233110 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.compute.api [None req-f00ebe7f-3d42-4621-895c-38e38fc4cd53 tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] [instance: 8d4bd5f5-1caa-4165-a7d3-73f338df3073] Fetching instance by UUID {{(pid=117873) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:24:53.235593 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG dbcounter [-] [117873] Writing DB stats nova_api:SELECT=2 {{(pid=117873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:24:53.236983 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG dbcounter [-] [117873] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:24:53.294563 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.policy [None req-f00ebe7f-3d42-4621-895c-38e38fc4cd53 tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2d3aa18a0a146808f584127411a1cf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1af845e594466b12a11b7cab99a7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117873) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:24:53.304627 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [None req-f00ebe7f-3d42-4621-895c-38e38fc4cd53 tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] 10.222.0.43 "GET /compute/v2.1/servers/8d4bd5f5-1caa-4165-a7d3-73f338df3073" status: 200 len: 1095 microversion: 2.1 time: 0.076357 Jun 22 10:24:53.305195 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 444/896] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:24:53 2022] GET /compute/v2.1/servers/8d4bd5f5-1caa-4165-a7d3-73f338df3073 => generated 1095 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:24:54.323071 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-9ddd6593-7cd2-48f0-8e82-208c373b6247 tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] Calling method '>' {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:24:54.323591 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.compute.api [None req-9ddd6593-7cd2-48f0-8e82-208c373b6247 tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] [instance: 8d4bd5f5-1caa-4165-a7d3-73f338df3073] Fetching instance by UUID {{(pid=117874) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:24:54.329724 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-9ddd6593-7cd2-48f0-8e82-208c373b6247 tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:24:54.330173 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-9ddd6593-7cd2-48f0-8e82-208c373b6247 tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:24:54.330923 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-9ddd6593-7cd2-48f0-8e82-208c373b6247 tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:24:54.331361 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-9ddd6593-7cd2-48f0-8e82-208c373b6247 tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:24:54.394678 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.policy [None req-9ddd6593-7cd2-48f0-8e82-208c373b6247 tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2d3aa18a0a146808f584127411a1cf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1af845e594466b12a11b7cab99a7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117874) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:24:54.402245 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [None req-9ddd6593-7cd2-48f0-8e82-208c373b6247 tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] 10.222.0.43 "GET /compute/v2.1/servers/8d4bd5f5-1caa-4165-a7d3-73f338df3073" status: 200 len: 1145 microversion: 2.1 time: 0.083716 Jun 22 10:24:54.402824 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 453/897] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:24:54 2022] GET /compute/v2.1/servers/8d4bd5f5-1caa-4165-a7d3-73f338df3073 => generated 1145 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:24:55.419539 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-8dfa9380-21b5-4c7d-8309-0206d033e0e5 tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] Calling method '>' {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:24:55.420147 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.compute.api [None req-8dfa9380-21b5-4c7d-8309-0206d033e0e5 tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] [instance: 8d4bd5f5-1caa-4165-a7d3-73f338df3073] Fetching instance by UUID {{(pid=117873) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:24:55.427277 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-8dfa9380-21b5-4c7d-8309-0206d033e0e5 tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:24:55.428049 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-8dfa9380-21b5-4c7d-8309-0206d033e0e5 tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:24:55.429407 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-8dfa9380-21b5-4c7d-8309-0206d033e0e5 tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:24:55.430182 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-8dfa9380-21b5-4c7d-8309-0206d033e0e5 tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:24:55.494136 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.policy [None req-8dfa9380-21b5-4c7d-8309-0206d033e0e5 tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2d3aa18a0a146808f584127411a1cf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1af845e594466b12a11b7cab99a7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117873) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:24:55.501505 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [None req-8dfa9380-21b5-4c7d-8309-0206d033e0e5 tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] 10.222.0.43 "GET /compute/v2.1/servers/8d4bd5f5-1caa-4165-a7d3-73f338df3073" status: 200 len: 1137 microversion: 2.1 time: 0.085896 Jun 22 10:24:55.502102 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 445/898] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:24:55 2022] GET /compute/v2.1/servers/8d4bd5f5-1caa-4165-a7d3-73f338df3073 => generated 1137 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:24:56.518891 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-67e3bd67-507f-4d21-8c55-882bf1803db7 tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] Calling method '>' {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:24:56.519495 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.compute.api [None req-67e3bd67-507f-4d21-8c55-882bf1803db7 tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] [instance: 8d4bd5f5-1caa-4165-a7d3-73f338df3073] Fetching instance by UUID {{(pid=117874) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:24:56.526171 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-67e3bd67-507f-4d21-8c55-882bf1803db7 tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:24:56.526601 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-67e3bd67-507f-4d21-8c55-882bf1803db7 tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:24:56.527371 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-67e3bd67-507f-4d21-8c55-882bf1803db7 tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:24:56.527806 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-67e3bd67-507f-4d21-8c55-882bf1803db7 tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:24:56.592264 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.policy [None req-67e3bd67-507f-4d21-8c55-882bf1803db7 tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2d3aa18a0a146808f584127411a1cf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1af845e594466b12a11b7cab99a7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117874) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:24:56.599752 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [None req-67e3bd67-507f-4d21-8c55-882bf1803db7 tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] 10.222.0.43 "GET /compute/v2.1/servers/8d4bd5f5-1caa-4165-a7d3-73f338df3073" status: 200 len: 1211 microversion: 2.1 time: 0.085475 Jun 22 10:24:56.600575 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 454/899] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:24:56 2022] GET /compute/v2.1/servers/8d4bd5f5-1caa-4165-a7d3-73f338df3073 => generated 1211 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:24:57.617920 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-4cbb8a2a-e9e8-4132-98e5-2e2619ad7123 tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] Calling method '>' {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:24:57.618446 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.compute.api [None req-4cbb8a2a-e9e8-4132-98e5-2e2619ad7123 tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] [instance: 8d4bd5f5-1caa-4165-a7d3-73f338df3073] Fetching instance by UUID {{(pid=117873) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:24:57.625173 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-4cbb8a2a-e9e8-4132-98e5-2e2619ad7123 tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:24:57.625614 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-4cbb8a2a-e9e8-4132-98e5-2e2619ad7123 tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:24:57.626383 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-4cbb8a2a-e9e8-4132-98e5-2e2619ad7123 tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:24:57.626809 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-4cbb8a2a-e9e8-4132-98e5-2e2619ad7123 tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:24:57.754246 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.policy [None req-4cbb8a2a-e9e8-4132-98e5-2e2619ad7123 tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2d3aa18a0a146808f584127411a1cf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1af845e594466b12a11b7cab99a7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117873) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:24:57.762237 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [None req-4cbb8a2a-e9e8-4132-98e5-2e2619ad7123 tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] 10.222.0.43 "GET /compute/v2.1/servers/8d4bd5f5-1caa-4165-a7d3-73f338df3073" status: 200 len: 1279 microversion: 2.1 time: 0.148486 Jun 22 10:24:57.762803 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 446/900] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:24:57 2022] GET /compute/v2.1/servers/8d4bd5f5-1caa-4165-a7d3-73f338df3073 => generated 1279 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:24:58.782270 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [req-c0bf590f-6e80-4bb8-b73f-e69ea613c5f1 req-cc46c101-b481-4e53-9260-01da4df7d88a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8d4bd5f5-1caa-4165-a7d3-73f338df3073", "tag": "fe534632-1c33-4794-bbcb-a54d9a87fefd"}]} {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:24:58.783107 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-d2c2ba12-7d6e-4dff-8403-c89e569c5286 tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] Calling method '>' {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:24:58.783737 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.compute.api [None req-d2c2ba12-7d6e-4dff-8403-c89e569c5286 tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] [instance: 8d4bd5f5-1caa-4165-a7d3-73f338df3073] Fetching instance by UUID {{(pid=117873) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:24:58.794692 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-d2c2ba12-7d6e-4dff-8403-c89e569c5286 tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:24:58.794917 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-d2c2ba12-7d6e-4dff-8403-c89e569c5286 tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:24:58.795689 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-d2c2ba12-7d6e-4dff-8403-c89e569c5286 tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:24:58.796124 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-d2c2ba12-7d6e-4dff-8403-c89e569c5286 tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:24:58.809521 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [req-c0bf590f-6e80-4bb8-b73f-e69ea613c5f1 req-cc46c101-b481-4e53-9260-01da4df7d88a service nova] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:24:58.809995 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [req-c0bf590f-6e80-4bb8-b73f-e69ea613c5f1 req-cc46c101-b481-4e53-9260-01da4df7d88a service nova] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:24:58.822288 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.compute.server_external_events [req-c0bf590f-6e80-4bb8-b73f-e69ea613c5f1 req-cc46c101-b481-4e53-9260-01da4df7d88a service nova] Creating event network-changed:fe534632-1c33-4794-bbcb-a54d9a87fefd for instance 8d4bd5f5-1caa-4165-a7d3-73f338df3073 on hv-cinder-84713 Jun 22 10:24:58.827185 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [req-c0bf590f-6e80-4bb8-b73f-e69ea613c5f1 req-cc46c101-b481-4e53-9260-01da4df7d88a service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053829 Jun 22 10:24:58.828092 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 455/901] 10.222.0.43 () {64 vars in 1317 bytes} [Wed Jun 22 10:24:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 10:24:58.958165 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.policy [None req-d2c2ba12-7d6e-4dff-8403-c89e569c5286 tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2d3aa18a0a146808f584127411a1cf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1af845e594466b12a11b7cab99a7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117873) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:24:58.966203 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [None req-d2c2ba12-7d6e-4dff-8403-c89e569c5286 tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] 10.222.0.43 "GET /compute/v2.1/servers/8d4bd5f5-1caa-4165-a7d3-73f338df3073" status: 200 len: 1279 microversion: 2.1 time: 0.189008 Jun 22 10:24:58.966767 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 447/902] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:24:58 2022] GET /compute/v2.1/servers/8d4bd5f5-1caa-4165-a7d3-73f338df3073 => generated 1279 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:24:59.984059 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-b3784d3d-7369-4dca-8c79-535f4d0c8fb3 tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] Calling method '>' {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:24:59.984667 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.compute.api [None req-b3784d3d-7369-4dca-8c79-535f4d0c8fb3 tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] [instance: 8d4bd5f5-1caa-4165-a7d3-73f338df3073] Fetching instance by UUID {{(pid=117874) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:24:59.990871 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-b3784d3d-7369-4dca-8c79-535f4d0c8fb3 tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:24:59.991320 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-b3784d3d-7369-4dca-8c79-535f4d0c8fb3 tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:24:59.992083 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-b3784d3d-7369-4dca-8c79-535f4d0c8fb3 tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:24:59.992519 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-b3784d3d-7369-4dca-8c79-535f4d0c8fb3 tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:25:00.123033 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.policy [None req-b3784d3d-7369-4dca-8c79-535f4d0c8fb3 tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2d3aa18a0a146808f584127411a1cf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1af845e594466b12a11b7cab99a7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117874) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:25:00.130692 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [None req-b3784d3d-7369-4dca-8c79-535f4d0c8fb3 tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] 10.222.0.43 "GET /compute/v2.1/servers/8d4bd5f5-1caa-4165-a7d3-73f338df3073" status: 200 len: 1267 microversion: 2.1 time: 0.151454 Jun 22 10:25:00.131254 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 456/903] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:24:59 2022] GET /compute/v2.1/servers/8d4bd5f5-1caa-4165-a7d3-73f338df3073 => generated 1267 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:25:01.148619 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-a2f04e99-fdc2-4783-9ac0-8631cbeefd8e tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] Calling method '>' {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:25:01.149228 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.compute.api [None req-a2f04e99-fdc2-4783-9ac0-8631cbeefd8e tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] [instance: 8d4bd5f5-1caa-4165-a7d3-73f338df3073] Fetching instance by UUID {{(pid=117873) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:25:01.155711 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-a2f04e99-fdc2-4783-9ac0-8631cbeefd8e tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:25:01.156157 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-a2f04e99-fdc2-4783-9ac0-8631cbeefd8e tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:25:01.156914 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-a2f04e99-fdc2-4783-9ac0-8631cbeefd8e tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:25:01.157345 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-a2f04e99-fdc2-4783-9ac0-8631cbeefd8e tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:25:01.290188 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.policy [None req-a2f04e99-fdc2-4783-9ac0-8631cbeefd8e tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2d3aa18a0a146808f584127411a1cf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1af845e594466b12a11b7cab99a7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117873) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:25:01.297643 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [None req-a2f04e99-fdc2-4783-9ac0-8631cbeefd8e tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] 10.222.0.43 "GET /compute/v2.1/servers/8d4bd5f5-1caa-4165-a7d3-73f338df3073" status: 200 len: 1267 microversion: 2.1 time: 0.153593 Jun 22 10:25:01.298223 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 448/904] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:25:01 2022] GET /compute/v2.1/servers/8d4bd5f5-1caa-4165-a7d3-73f338df3073 => generated 1267 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:25:02.313923 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-9ee9540f-24be-4127-8543-ac1aea0c1e4e tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] Calling method '>' {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:25:02.314529 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.compute.api [None req-9ee9540f-24be-4127-8543-ac1aea0c1e4e tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] [instance: 8d4bd5f5-1caa-4165-a7d3-73f338df3073] Fetching instance by UUID {{(pid=117874) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:25:02.321146 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-9ee9540f-24be-4127-8543-ac1aea0c1e4e tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:25:02.321596 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-9ee9540f-24be-4127-8543-ac1aea0c1e4e tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:25:02.322376 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-9ee9540f-24be-4127-8543-ac1aea0c1e4e tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:25:02.322806 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-9ee9540f-24be-4127-8543-ac1aea0c1e4e tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:25:02.451294 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.policy [None req-9ee9540f-24be-4127-8543-ac1aea0c1e4e tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2d3aa18a0a146808f584127411a1cf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1af845e594466b12a11b7cab99a7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117874) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:25:02.458718 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [None req-9ee9540f-24be-4127-8543-ac1aea0c1e4e tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] 10.222.0.43 "GET /compute/v2.1/servers/8d4bd5f5-1caa-4165-a7d3-73f338df3073" status: 200 len: 1267 microversion: 2.1 time: 0.148697 Jun 22 10:25:02.459283 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 457/905] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:25:02 2022] GET /compute/v2.1/servers/8d4bd5f5-1caa-4165-a7d3-73f338df3073 => generated 1267 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:25:03.476721 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-63b2ec87-a522-4976-a3a3-41d29968a577 tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] Calling method '>' {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:25:03.477365 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.compute.api [None req-63b2ec87-a522-4976-a3a3-41d29968a577 tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] [instance: 8d4bd5f5-1caa-4165-a7d3-73f338df3073] Fetching instance by UUID {{(pid=117873) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:25:03.479737 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG dbcounter [-] [117873] Writing DB stats nova_cell0:SELECT=2 {{(pid=117873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:25:03.485225 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-63b2ec87-a522-4976-a3a3-41d29968a577 tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:25:03.485673 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-63b2ec87-a522-4976-a3a3-41d29968a577 tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:25:03.486547 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-63b2ec87-a522-4976-a3a3-41d29968a577 tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:25:03.486985 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-63b2ec87-a522-4976-a3a3-41d29968a577 tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:25:03.622088 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.policy [None req-63b2ec87-a522-4976-a3a3-41d29968a577 tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2d3aa18a0a146808f584127411a1cf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1af845e594466b12a11b7cab99a7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117873) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:25:03.629412 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [None req-63b2ec87-a522-4976-a3a3-41d29968a577 tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] 10.222.0.43 "GET /compute/v2.1/servers/8d4bd5f5-1caa-4165-a7d3-73f338df3073" status: 200 len: 1267 microversion: 2.1 time: 0.157346 Jun 22 10:25:03.629989 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 449/906] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:25:03 2022] GET /compute/v2.1/servers/8d4bd5f5-1caa-4165-a7d3-73f338df3073 => generated 1267 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:25:03.700060 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-7d6022c7-7bb2-4f6e-b2c5-ab2566c44349 tempest-VolumesSnapshotTestJSON-1146371521 tempest-VolumesSnapshotTestJSON-1146371521-project] Calling method '>' {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:25:03.700551 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.compute.api [None req-7d6022c7-7bb2-4f6e-b2c5-ab2566c44349 tempest-VolumesSnapshotTestJSON-1146371521 tempest-VolumesSnapshotTestJSON-1146371521-project] [instance: d281b861-2925-41cc-a964-79e622dcbfdc] Fetching instance by UUID {{(pid=117874) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:25:03.702525 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG dbcounter [-] [117874] Writing DB stats nova_cell0:SELECT=2 {{(pid=117874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:25:03.703190 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG dbcounter [-] [117874] Writing DB stats nova_cell0:SELECT=6 {{(pid=117874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:25:03.709261 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-7d6022c7-7bb2-4f6e-b2c5-ab2566c44349 tempest-VolumesSnapshotTestJSON-1146371521 tempest-VolumesSnapshotTestJSON-1146371521-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:25:03.709724 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-7d6022c7-7bb2-4f6e-b2c5-ab2566c44349 tempest-VolumesSnapshotTestJSON-1146371521 tempest-VolumesSnapshotTestJSON-1146371521-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:25:03.711096 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-7d6022c7-7bb2-4f6e-b2c5-ab2566c44349 tempest-VolumesSnapshotTestJSON-1146371521 tempest-VolumesSnapshotTestJSON-1146371521-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:25:03.711531 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-7d6022c7-7bb2-4f6e-b2c5-ab2566c44349 tempest-VolumesSnapshotTestJSON-1146371521 tempest-VolumesSnapshotTestJSON-1146371521-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:25:03.794512 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.objects.instance [None req-7d6022c7-7bb2-4f6e-b2c5-ab2566c44349 tempest-VolumesSnapshotTestJSON-1146371521 tempest-VolumesSnapshotTestJSON-1146371521-project] Lazy-loading 'services' on Instance uuid d281b861-2925-41cc-a964-79e622dcbfdc {{(pid=117874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 22 10:25:03.869192 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [None req-7d6022c7-7bb2-4f6e-b2c5-ab2566c44349 tempest-VolumesSnapshotTestJSON-1146371521 tempest-VolumesSnapshotTestJSON-1146371521-project] 10.222.0.43 "DELETE /compute/v2.1/servers/d281b861-2925-41cc-a964-79e622dcbfdc/os-volume_attachments/3126fb48-05fd-4d8e-ad20-c3f0c77ce9ba" status: 202 len: 0 microversion: 2.1 time: 0.172804 Jun 22 10:25:03.870037 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 458/907] 10.222.0.43 () {58 vars in 1415 bytes} [Wed Jun 22 10:25:03 2022] DELETE /compute/v2.1/servers/d281b861-2925-41cc-a964-79e622dcbfdc/os-volume_attachments/3126fb48-05fd-4d8e-ad20-c3f0c77ce9ba => generated 0 bytes in 174 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 22 10:25:04.646171 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-f1f6bd04-1c3f-4547-ae41-4e749be49ee3 tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] Calling method '>' {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:25:04.646782 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.compute.api [None req-f1f6bd04-1c3f-4547-ae41-4e749be49ee3 tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] [instance: 8d4bd5f5-1caa-4165-a7d3-73f338df3073] Fetching instance by UUID {{(pid=117873) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:25:04.653980 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-f1f6bd04-1c3f-4547-ae41-4e749be49ee3 tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:25:04.654429 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-f1f6bd04-1c3f-4547-ae41-4e749be49ee3 tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:25:04.655191 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-f1f6bd04-1c3f-4547-ae41-4e749be49ee3 tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:25:04.655633 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-f1f6bd04-1c3f-4547-ae41-4e749be49ee3 tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:25:04.796158 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.policy [None req-f1f6bd04-1c3f-4547-ae41-4e749be49ee3 tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2d3aa18a0a146808f584127411a1cf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1af845e594466b12a11b7cab99a7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117873) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:25:04.803507 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [None req-f1f6bd04-1c3f-4547-ae41-4e749be49ee3 tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] 10.222.0.43 "GET /compute/v2.1/servers/8d4bd5f5-1caa-4165-a7d3-73f338df3073" status: 200 len: 1267 microversion: 2.1 time: 0.161911 Jun 22 10:25:04.804711 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 450/908] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:25:04 2022] GET /compute/v2.1/servers/8d4bd5f5-1caa-4165-a7d3-73f338df3073 => generated 1267 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:25:04.983508 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-5537402c-759c-47c1-8752-c478ef90a3d0 tempest-VolumesSnapshotTestJSON-1146371521 tempest-VolumesSnapshotTestJSON-1146371521-project] Calling method '>' {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:25:04.984080 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.compute.api [None req-5537402c-759c-47c1-8752-c478ef90a3d0 tempest-VolumesSnapshotTestJSON-1146371521 tempest-VolumesSnapshotTestJSON-1146371521-project] [instance: d281b861-2925-41cc-a964-79e622dcbfdc] Fetching instance by UUID {{(pid=117874) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:25:04.990344 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-5537402c-759c-47c1-8752-c478ef90a3d0 tempest-VolumesSnapshotTestJSON-1146371521 tempest-VolumesSnapshotTestJSON-1146371521-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:25:04.990786 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-5537402c-759c-47c1-8752-c478ef90a3d0 tempest-VolumesSnapshotTestJSON-1146371521 tempest-VolumesSnapshotTestJSON-1146371521-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:25:04.992746 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-5537402c-759c-47c1-8752-c478ef90a3d0 tempest-VolumesSnapshotTestJSON-1146371521 tempest-VolumesSnapshotTestJSON-1146371521-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:25:04.993166 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-5537402c-759c-47c1-8752-c478ef90a3d0 tempest-VolumesSnapshotTestJSON-1146371521 tempest-VolumesSnapshotTestJSON-1146371521-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:25:05.018256 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.compute.api [None req-5537402c-759c-47c1-8752-c478ef90a3d0 tempest-VolumesSnapshotTestJSON-1146371521 tempest-VolumesSnapshotTestJSON-1146371521-project] [instance: d281b861-2925-41cc-a964-79e622dcbfdc] Going to try to terminate instance {{(pid=117874) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 22 10:25:05.092288 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [None req-5537402c-759c-47c1-8752-c478ef90a3d0 tempest-VolumesSnapshotTestJSON-1146371521 tempest-VolumesSnapshotTestJSON-1146371521-project] 10.222.0.43 "DELETE /compute/v2.1/servers/d281b861-2925-41cc-a964-79e622dcbfdc" status: 204 len: 0 microversion: 2.1 time: 0.112869 Jun 22 10:25:05.092915 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 459/909] 10.222.0.43 () {58 vars in 1238 bytes} [Wed Jun 22 10:25:04 2022] DELETE /compute/v2.1/servers/d281b861-2925-41cc-a964-79e622dcbfdc => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 22 10:25:05.102136 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-b880140f-9009-4a40-8275-88554d2497b4 tempest-VolumesSnapshotTestJSON-1146371521 tempest-VolumesSnapshotTestJSON-1146371521-project] Calling method '>' {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:25:05.102735 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.compute.api [None req-b880140f-9009-4a40-8275-88554d2497b4 tempest-VolumesSnapshotTestJSON-1146371521 tempest-VolumesSnapshotTestJSON-1146371521-project] [instance: d281b861-2925-41cc-a964-79e622dcbfdc] Fetching instance by UUID {{(pid=117873) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:25:05.108799 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-b880140f-9009-4a40-8275-88554d2497b4 tempest-VolumesSnapshotTestJSON-1146371521 tempest-VolumesSnapshotTestJSON-1146371521-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:25:05.109237 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-b880140f-9009-4a40-8275-88554d2497b4 tempest-VolumesSnapshotTestJSON-1146371521 tempest-VolumesSnapshotTestJSON-1146371521-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:25:05.110018 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-b880140f-9009-4a40-8275-88554d2497b4 tempest-VolumesSnapshotTestJSON-1146371521 tempest-VolumesSnapshotTestJSON-1146371521-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:25:05.110443 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-b880140f-9009-4a40-8275-88554d2497b4 tempest-VolumesSnapshotTestJSON-1146371521 tempest-VolumesSnapshotTestJSON-1146371521-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:25:05.243429 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.policy [None req-b880140f-9009-4a40-8275-88554d2497b4 tempest-VolumesSnapshotTestJSON-1146371521 tempest-VolumesSnapshotTestJSON-1146371521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b402c2d3251a411a818b61b872dca060', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60103a2f42f244e3af1d92a8a378fece', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117873) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:25:05.250910 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [None req-b880140f-9009-4a40-8275-88554d2497b4 tempest-VolumesSnapshotTestJSON-1146371521 tempest-VolumesSnapshotTestJSON-1146371521-project] 10.222.0.43 "GET /compute/v2.1/servers/d281b861-2925-41cc-a964-79e622dcbfdc" status: 200 len: 1515 microversion: 2.1 time: 0.153563 Jun 22 10:25:05.251467 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 451/910] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:25:05 2022] GET /compute/v2.1/servers/d281b861-2925-41cc-a964-79e622dcbfdc => generated 1515 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 10:25:05.820871 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-6bfae982-7cba-4bf9-88b7-a942abd6481a tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] Calling method '>' {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:25:05.821553 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.compute.api [None req-6bfae982-7cba-4bf9-88b7-a942abd6481a tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] [instance: 8d4bd5f5-1caa-4165-a7d3-73f338df3073] Fetching instance by UUID {{(pid=117874) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:25:05.827556 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-6bfae982-7cba-4bf9-88b7-a942abd6481a tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:25:05.828017 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-6bfae982-7cba-4bf9-88b7-a942abd6481a tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:25:05.828744 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-6bfae982-7cba-4bf9-88b7-a942abd6481a tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:25:05.829171 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-6bfae982-7cba-4bf9-88b7-a942abd6481a tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:25:05.965683 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.policy [None req-6bfae982-7cba-4bf9-88b7-a942abd6481a tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2d3aa18a0a146808f584127411a1cf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1af845e594466b12a11b7cab99a7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117874) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:25:05.975512 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [None req-6bfae982-7cba-4bf9-88b7-a942abd6481a tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] 10.222.0.43 "GET /compute/v2.1/servers/8d4bd5f5-1caa-4165-a7d3-73f338df3073" status: 200 len: 1267 microversion: 2.1 time: 0.158623 Jun 22 10:25:05.976737 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 460/911] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:25:05 2022] GET /compute/v2.1/servers/8d4bd5f5-1caa-4165-a7d3-73f338df3073 => generated 1267 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:25:06.268093 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-702bda59-cf4d-4932-83aa-5e753d82159f tempest-VolumesSnapshotTestJSON-1146371521 tempest-VolumesSnapshotTestJSON-1146371521-project] Calling method '>' {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:25:06.268725 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.compute.api [None req-702bda59-cf4d-4932-83aa-5e753d82159f tempest-VolumesSnapshotTestJSON-1146371521 tempest-VolumesSnapshotTestJSON-1146371521-project] [instance: d281b861-2925-41cc-a964-79e622dcbfdc] Fetching instance by UUID {{(pid=117873) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:25:06.276400 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-702bda59-cf4d-4932-83aa-5e753d82159f tempest-VolumesSnapshotTestJSON-1146371521 tempest-VolumesSnapshotTestJSON-1146371521-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:25:06.276869 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-702bda59-cf4d-4932-83aa-5e753d82159f tempest-VolumesSnapshotTestJSON-1146371521 tempest-VolumesSnapshotTestJSON-1146371521-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:25:06.277653 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-702bda59-cf4d-4932-83aa-5e753d82159f tempest-VolumesSnapshotTestJSON-1146371521 tempest-VolumesSnapshotTestJSON-1146371521-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:25:06.278111 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-702bda59-cf4d-4932-83aa-5e753d82159f tempest-VolumesSnapshotTestJSON-1146371521 tempest-VolumesSnapshotTestJSON-1146371521-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:25:06.407470 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.policy [None req-702bda59-cf4d-4932-83aa-5e753d82159f tempest-VolumesSnapshotTestJSON-1146371521 tempest-VolumesSnapshotTestJSON-1146371521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b402c2d3251a411a818b61b872dca060', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60103a2f42f244e3af1d92a8a378fece', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117873) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:25:06.415049 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [None req-702bda59-cf4d-4932-83aa-5e753d82159f tempest-VolumesSnapshotTestJSON-1146371521 tempest-VolumesSnapshotTestJSON-1146371521-project] 10.222.0.43 "GET /compute/v2.1/servers/d281b861-2925-41cc-a964-79e622dcbfdc" status: 200 len: 1515 microversion: 2.1 time: 0.150846 Jun 22 10:25:06.415604 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 452/912] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:25:06 2022] GET /compute/v2.1/servers/d281b861-2925-41cc-a964-79e622dcbfdc => generated 1515 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:25:06.993558 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-401aa8ee-24b8-48a4-9bb3-03ce85b8ae7d tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] Calling method '>' {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:25:06.994265 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.compute.api [None req-401aa8ee-24b8-48a4-9bb3-03ce85b8ae7d tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] [instance: 8d4bd5f5-1caa-4165-a7d3-73f338df3073] Fetching instance by UUID {{(pid=117874) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:25:07.000784 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-401aa8ee-24b8-48a4-9bb3-03ce85b8ae7d tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:25:07.001229 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-401aa8ee-24b8-48a4-9bb3-03ce85b8ae7d tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:25:07.002011 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-401aa8ee-24b8-48a4-9bb3-03ce85b8ae7d tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:25:07.002446 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-401aa8ee-24b8-48a4-9bb3-03ce85b8ae7d tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:25:07.136818 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.policy [None req-401aa8ee-24b8-48a4-9bb3-03ce85b8ae7d tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2d3aa18a0a146808f584127411a1cf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1af845e594466b12a11b7cab99a7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117874) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:25:07.144341 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [None req-401aa8ee-24b8-48a4-9bb3-03ce85b8ae7d tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] 10.222.0.43 "GET /compute/v2.1/servers/8d4bd5f5-1caa-4165-a7d3-73f338df3073" status: 200 len: 1267 microversion: 2.1 time: 0.155874 Jun 22 10:25:07.144902 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 461/913] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:25:06 2022] GET /compute/v2.1/servers/8d4bd5f5-1caa-4165-a7d3-73f338df3073 => generated 1267 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:25:07.432648 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-cb343110-a543-472d-b5fc-ad2a81d572a7 tempest-VolumesSnapshotTestJSON-1146371521 tempest-VolumesSnapshotTestJSON-1146371521-project] Calling method '>' {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:25:07.433259 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.compute.api [None req-cb343110-a543-472d-b5fc-ad2a81d572a7 tempest-VolumesSnapshotTestJSON-1146371521 tempest-VolumesSnapshotTestJSON-1146371521-project] [instance: d281b861-2925-41cc-a964-79e622dcbfdc] Fetching instance by UUID {{(pid=117873) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:25:07.439706 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-cb343110-a543-472d-b5fc-ad2a81d572a7 tempest-VolumesSnapshotTestJSON-1146371521 tempest-VolumesSnapshotTestJSON-1146371521-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:25:07.440148 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-cb343110-a543-472d-b5fc-ad2a81d572a7 tempest-VolumesSnapshotTestJSON-1146371521 tempest-VolumesSnapshotTestJSON-1146371521-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:25:07.440961 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-cb343110-a543-472d-b5fc-ad2a81d572a7 tempest-VolumesSnapshotTestJSON-1146371521 tempest-VolumesSnapshotTestJSON-1146371521-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:25:07.441392 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-cb343110-a543-472d-b5fc-ad2a81d572a7 tempest-VolumesSnapshotTestJSON-1146371521 tempest-VolumesSnapshotTestJSON-1146371521-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:25:07.575710 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.policy [None req-cb343110-a543-472d-b5fc-ad2a81d572a7 tempest-VolumesSnapshotTestJSON-1146371521 tempest-VolumesSnapshotTestJSON-1146371521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b402c2d3251a411a818b61b872dca060', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60103a2f42f244e3af1d92a8a378fece', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117873) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:25:07.583371 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [None req-cb343110-a543-472d-b5fc-ad2a81d572a7 tempest-VolumesSnapshotTestJSON-1146371521 tempest-VolumesSnapshotTestJSON-1146371521-project] 10.222.0.43 "GET /compute/v2.1/servers/d281b861-2925-41cc-a964-79e622dcbfdc" status: 200 len: 1515 microversion: 2.1 time: 0.155254 Jun 22 10:25:07.583940 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 453/914] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:25:07 2022] GET /compute/v2.1/servers/d281b861-2925-41cc-a964-79e622dcbfdc => generated 1515 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:25:07.961834 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [req-0092c9d7-4011-4feb-a1d9-6dbbb9e3e303 req-dcf51302-dd5a-4153-99aa-c074f0896f7e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d281b861-2925-41cc-a964-79e622dcbfdc", "name": "network-vif-deleted", "tag": "1203a959-9e1d-4f8a-8cd2-be55ac1d8869"}]} {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:25:07.972894 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [req-0092c9d7-4011-4feb-a1d9-6dbbb9e3e303 req-dcf51302-dd5a-4153-99aa-c074f0896f7e service nova] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:25:07.973394 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [req-0092c9d7-4011-4feb-a1d9-6dbbb9e3e303 req-dcf51302-dd5a-4153-99aa-c074f0896f7e service nova] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:25:07.985918 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.compute.server_external_events [req-0092c9d7-4011-4feb-a1d9-6dbbb9e3e303 req-dcf51302-dd5a-4153-99aa-c074f0896f7e service nova] Creating event network-vif-deleted:1203a959-9e1d-4f8a-8cd2-be55ac1d8869 for instance d281b861-2925-41cc-a964-79e622dcbfdc on hv-cinder-84713 Jun 22 10:25:07.992525 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [req-0092c9d7-4011-4feb-a1d9-6dbbb9e3e303 req-dcf51302-dd5a-4153-99aa-c074f0896f7e service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035514 Jun 22 10:25:07.993134 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 462/915] 10.222.0.43 () {64 vars in 1317 bytes} [Wed Jun 22 10:25:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 10:25:08.160281 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-75ff072b-2835-4f63-ab58-a41305856e40 tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] Calling method '>' {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:25:08.160883 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.compute.api [None req-75ff072b-2835-4f63-ab58-a41305856e40 tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] [instance: 8d4bd5f5-1caa-4165-a7d3-73f338df3073] Fetching instance by UUID {{(pid=117873) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:25:08.167598 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-75ff072b-2835-4f63-ab58-a41305856e40 tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:25:08.168040 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-75ff072b-2835-4f63-ab58-a41305856e40 tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:25:08.168786 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-75ff072b-2835-4f63-ab58-a41305856e40 tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:25:08.169215 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-75ff072b-2835-4f63-ab58-a41305856e40 tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:25:08.299963 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.policy [None req-75ff072b-2835-4f63-ab58-a41305856e40 tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2d3aa18a0a146808f584127411a1cf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1af845e594466b12a11b7cab99a7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117873) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:25:08.308289 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [None req-75ff072b-2835-4f63-ab58-a41305856e40 tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] 10.222.0.43 "GET /compute/v2.1/servers/8d4bd5f5-1caa-4165-a7d3-73f338df3073" status: 200 len: 1267 microversion: 2.1 time: 0.151796 Jun 22 10:25:08.313902 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 454/916] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:25:08 2022] GET /compute/v2.1/servers/8d4bd5f5-1caa-4165-a7d3-73f338df3073 => generated 1267 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:25:08.602760 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-62075f06-b8e1-49d4-8213-544c715a7d1a tempest-VolumesSnapshotTestJSON-1146371521 tempest-VolumesSnapshotTestJSON-1146371521-project] Calling method '>' {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:25:08.603456 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.compute.api [None req-62075f06-b8e1-49d4-8213-544c715a7d1a tempest-VolumesSnapshotTestJSON-1146371521 tempest-VolumesSnapshotTestJSON-1146371521-project] [instance: d281b861-2925-41cc-a964-79e622dcbfdc] Fetching instance by UUID {{(pid=117874) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:25:08.610144 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-62075f06-b8e1-49d4-8213-544c715a7d1a tempest-VolumesSnapshotTestJSON-1146371521 tempest-VolumesSnapshotTestJSON-1146371521-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:25:08.610585 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-62075f06-b8e1-49d4-8213-544c715a7d1a tempest-VolumesSnapshotTestJSON-1146371521 tempest-VolumesSnapshotTestJSON-1146371521-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:25:08.611345 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-62075f06-b8e1-49d4-8213-544c715a7d1a tempest-VolumesSnapshotTestJSON-1146371521 tempest-VolumesSnapshotTestJSON-1146371521-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:25:08.611774 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-62075f06-b8e1-49d4-8213-544c715a7d1a tempest-VolumesSnapshotTestJSON-1146371521 tempest-VolumesSnapshotTestJSON-1146371521-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:25:08.625770 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.wsgi [None req-62075f06-b8e1-49d4-8213-544c715a7d1a tempest-VolumesSnapshotTestJSON-1146371521 tempest-VolumesSnapshotTestJSON-1146371521-project] HTTP exception thrown: Instance d281b861-2925-41cc-a964-79e622dcbfdc could not be found. Jun 22 10:25:08.627472 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-62075f06-b8e1-49d4-8213-544c715a7d1a tempest-VolumesSnapshotTestJSON-1146371521 tempest-VolumesSnapshotTestJSON-1146371521-project] Request method failure captured: Jun 22 10:25:08.627472 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: request: GET /compute/v2.1/servers/d281b861-2925-41cc-a964-79e622dcbfdc HTTP/1.1 Jun 22 10:25:08.627472 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: Accept: application/json Jun 22 10:25:08.627472 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: Accept-Encoding: identity Jun 22 10:25:08.627472 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: Connection: close Jun 22 10:25:08.627472 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: Content-Length: 0 Jun 22 10:25:08.627472 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: Content-Type: application/json Jun 22 10:25:08.627472 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: Host: 10.222.0.43 Jun 22 10:25:08.627472 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: Openstack-System-Scope: None Jun 22 10:25:08.627472 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: User-Agent: python-urllib3/1.26.9 Jun 22 10:25:08.627472 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-Auth-Token: gAAAAABisu3GA5qtg8ewhos7_Rk0xa-2hmsYtC_ntwJNaAPK6NnP9TwCUkLKx8Vsvc4965N0RQfEln8Y9pNpHKSbKJvP7BTqwzrsMPjNUkhbaXCooAUVwV3LyjM61Hf_-WCfmrpmaClAbPgo-n4-G68Kc1QG8GmreRYQUf_5Sq34tjGV-0iRMEM Jun 22 10:25:08.627472 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-Domain-Id: None Jun 22 10:25:08.627472 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-Domain-Name: None Jun 22 10:25:08.627472 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-Identity-Status: Confirmed Jun 22 10:25:08.627472 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-Is-Admin-Project: True Jun 22 10:25:08.627472 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-Project-Domain-Id: default Jun 22 10:25:08.627472 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-Project-Domain-Name: Default Jun 22 10:25:08.627472 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-Project-Id: 60103a2f42f244e3af1d92a8a378fece Jun 22 10:25:08.627472 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1146371521 Jun 22 10:25:08.627472 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-Role: reader,member Jun 22 10:25:08.627472 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-Roles: reader,member Jun 22 10:25:08.629052 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/60103a2f42f244e3af1d92a8a378fece"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/60103a2f42f244e3af1d92a8a378fece"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_60103a2f42f244e3af1d92a8a378fece", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/60103a2f42f244e3af1d92a8a378fece"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}] Jun 22 10:25:08.629052 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-Tenant: tempest-VolumesSnapshotTestJSON-1146371521 Jun 22 10:25:08.629052 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-Tenant-Id: 60103a2f42f244e3af1d92a8a378fece Jun 22 10:25:08.629052 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1146371521 Jun 22 10:25:08.629052 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-User: tempest-VolumesSnapshotTestJSON-1146371521-project Jun 22 10:25:08.629052 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-User-Domain-Id: default Jun 22 10:25:08.629052 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-User-Domain-Name: Default Jun 22 10:25:08.629052 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-User-Id: b402c2d3251a411a818b61b872dca060 Jun 22 10:25:08.629052 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-User-Name: tempest-VolumesSnapshotTestJSON-1146371521-project Jun 22 10:25:08.629052 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: method: > Jun 22 10:25:08.629052 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: exception: Instance d281b861-2925-41cc-a964-79e622dcbfdc could not be found. Jun 22 10:25:08.629052 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: action_args: {'id': 'd281b861-2925-41cc-a964-79e622dcbfdc'} Jun 22 10:25:08.629957 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 10:25:08.629957 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:25:08.629957 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 22 10:25:08.629957 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 22 10:25:08.629957 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 22 10:25:08.629957 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 22 10:25:08.629957 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 22 10:25:08.629957 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 22 10:25:08.629957 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 22 10:25:08.629957 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 22 10:25:08.629957 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d281b861-2925-41cc-a964-79e622dcbfdc could not be found. Jun 22 10:25:08.629957 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi Jun 22 10:25:08.629957 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 10:25:08.629957 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi Jun 22 10:25:08.629957 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:25:08.629957 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 10:25:08.629957 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 10:25:08.629957 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 10:25:08.629957 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 10:25:08.629957 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 10:25:08.631251 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 10:25:08.631251 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 22 10:25:08.631251 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 22 10:25:08.631251 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 22 10:25:08.631251 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 22 10:25:08.631251 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 22 10:25:08.631251 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 22 10:25:08.631251 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d281b861-2925-41cc-a964-79e622dcbfdc could not be found. Jun 22 10:25:08.631251 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi Jun 22 10:25:08.631251 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 10:25:08.631251 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi Jun 22 10:25:08.631251 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:25:08.631251 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 10:25:08.631251 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 10:25:08.631251 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 10:25:08.631251 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 10:25:08.631251 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d281b861-2925-41cc-a964-79e622dcbfdc could not be found. Jun 22 10:25:08.631251 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi Jun 22 10:25:08.632891 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-62075f06-b8e1-49d4-8213-544c715a7d1a tempest-VolumesSnapshotTestJSON-1146371521 tempest-VolumesSnapshotTestJSON-1146371521-project] Returning 404 to user: Instance d281b861-2925-41cc-a964-79e622dcbfdc could not be found. {{(pid=117874) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 10:25:08.632891 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [None req-62075f06-b8e1-49d4-8213-544c715a7d1a tempest-VolumesSnapshotTestJSON-1146371521 tempest-VolumesSnapshotTestJSON-1146371521-project] 10.222.0.43 "GET /compute/v2.1/servers/d281b861-2925-41cc-a964-79e622dcbfdc" status: 404 len: 111 microversion: 2.1 time: 0.031749 Jun 22 10:25:08.632891 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 463/917] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:25:08 2022] GET /compute/v2.1/servers/d281b861-2925-41cc-a964-79e622dcbfdc => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 22 10:25:09.325202 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-ce33a343-cf54-47fa-a6ac-aee4f2bf3548 tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] Calling method '>' {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:25:09.325853 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.compute.api [None req-ce33a343-cf54-47fa-a6ac-aee4f2bf3548 tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] [instance: 8d4bd5f5-1caa-4165-a7d3-73f338df3073] Fetching instance by UUID {{(pid=117873) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:25:09.332716 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-ce33a343-cf54-47fa-a6ac-aee4f2bf3548 tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:25:09.333173 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-ce33a343-cf54-47fa-a6ac-aee4f2bf3548 tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:25:09.333970 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-ce33a343-cf54-47fa-a6ac-aee4f2bf3548 tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:25:09.334406 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-ce33a343-cf54-47fa-a6ac-aee4f2bf3548 tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:25:09.465319 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.policy [None req-ce33a343-cf54-47fa-a6ac-aee4f2bf3548 tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2d3aa18a0a146808f584127411a1cf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1af845e594466b12a11b7cab99a7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117873) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:25:09.472705 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [None req-ce33a343-cf54-47fa-a6ac-aee4f2bf3548 tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] 10.222.0.43 "GET /compute/v2.1/servers/8d4bd5f5-1caa-4165-a7d3-73f338df3073" status: 200 len: 1267 microversion: 2.1 time: 0.151329 Jun 22 10:25:09.473277 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 455/918] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:25:09 2022] GET /compute/v2.1/servers/8d4bd5f5-1caa-4165-a7d3-73f338df3073 => generated 1267 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:25:10.490400 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-ccd3c9be-4aa6-4820-83f4-d79d5000014c tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] Calling method '>' {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:25:10.491002 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.compute.api [None req-ccd3c9be-4aa6-4820-83f4-d79d5000014c tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] [instance: 8d4bd5f5-1caa-4165-a7d3-73f338df3073] Fetching instance by UUID {{(pid=117874) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:25:10.498174 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-ccd3c9be-4aa6-4820-83f4-d79d5000014c tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:25:10.498614 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-ccd3c9be-4aa6-4820-83f4-d79d5000014c tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:25:10.499367 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-ccd3c9be-4aa6-4820-83f4-d79d5000014c tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:25:10.499796 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-ccd3c9be-4aa6-4820-83f4-d79d5000014c tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:25:10.633264 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.policy [None req-ccd3c9be-4aa6-4820-83f4-d79d5000014c tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2d3aa18a0a146808f584127411a1cf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1af845e594466b12a11b7cab99a7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117874) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:25:10.640655 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [None req-ccd3c9be-4aa6-4820-83f4-d79d5000014c tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] 10.222.0.43 "GET /compute/v2.1/servers/8d4bd5f5-1caa-4165-a7d3-73f338df3073" status: 200 len: 1267 microversion: 2.1 time: 0.154118 Jun 22 10:25:10.641206 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 464/919] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:25:10 2022] GET /compute/v2.1/servers/8d4bd5f5-1caa-4165-a7d3-73f338df3073 => generated 1267 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:25:11.657589 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-0ca60659-8dc0-4d86-8189-b5e37ca9fa97 tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] Calling method '>' {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:25:11.658838 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.compute.api [None req-0ca60659-8dc0-4d86-8189-b5e37ca9fa97 tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] [instance: 8d4bd5f5-1caa-4165-a7d3-73f338df3073] Fetching instance by UUID {{(pid=117873) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:25:11.666009 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-0ca60659-8dc0-4d86-8189-b5e37ca9fa97 tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:25:11.666454 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-0ca60659-8dc0-4d86-8189-b5e37ca9fa97 tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:25:11.667348 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-0ca60659-8dc0-4d86-8189-b5e37ca9fa97 tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:25:11.667788 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-0ca60659-8dc0-4d86-8189-b5e37ca9fa97 tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:25:11.802684 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.policy [None req-0ca60659-8dc0-4d86-8189-b5e37ca9fa97 tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2d3aa18a0a146808f584127411a1cf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1af845e594466b12a11b7cab99a7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117873) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:25:11.810866 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [None req-0ca60659-8dc0-4d86-8189-b5e37ca9fa97 tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] 10.222.0.43 "GET /compute/v2.1/servers/8d4bd5f5-1caa-4165-a7d3-73f338df3073" status: 200 len: 1267 microversion: 2.1 time: 0.157102 Jun 22 10:25:11.811745 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 456/920] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:25:11 2022] GET /compute/v2.1/servers/8d4bd5f5-1caa-4165-a7d3-73f338df3073 => generated 1267 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:25:12.094450 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [req-ff2d8724-6739-40b8-b828-e2f5318dcd32 req-1faa53f5-c863-4769-b6f1-0a1676b00d6c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8d4bd5f5-1caa-4165-a7d3-73f338df3073", "name": "network-vif-plugged", "status": "completed", "tag": "fe534632-1c33-4794-bbcb-a54d9a87fefd"}]} {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:25:12.106419 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [req-ff2d8724-6739-40b8-b828-e2f5318dcd32 req-1faa53f5-c863-4769-b6f1-0a1676b00d6c service nova] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:25:12.107084 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [req-ff2d8724-6739-40b8-b828-e2f5318dcd32 req-1faa53f5-c863-4769-b6f1-0a1676b00d6c service nova] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:25:12.118878 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.compute.server_external_events [req-ff2d8724-6739-40b8-b828-e2f5318dcd32 req-1faa53f5-c863-4769-b6f1-0a1676b00d6c service nova] Creating event network-vif-plugged:fe534632-1c33-4794-bbcb-a54d9a87fefd for instance 8d4bd5f5-1caa-4165-a7d3-73f338df3073 on hv-cinder-84713 Jun 22 10:25:12.123888 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [req-ff2d8724-6739-40b8-b828-e2f5318dcd32 req-1faa53f5-c863-4769-b6f1-0a1676b00d6c service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040377 Jun 22 10:25:12.124492 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 465/921] 10.222.0.43 () {64 vars in 1317 bytes} [Wed Jun 22 10:25:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 10:25:12.828427 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-121361ac-69b7-473d-a2b5-48a0cb585047 tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] Calling method '>' {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:25:12.829028 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.compute.api [None req-121361ac-69b7-473d-a2b5-48a0cb585047 tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] [instance: 8d4bd5f5-1caa-4165-a7d3-73f338df3073] Fetching instance by UUID {{(pid=117873) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:25:12.836178 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-121361ac-69b7-473d-a2b5-48a0cb585047 tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:25:12.836595 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-121361ac-69b7-473d-a2b5-48a0cb585047 tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:25:12.837346 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-121361ac-69b7-473d-a2b5-48a0cb585047 tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:25:12.837811 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-121361ac-69b7-473d-a2b5-48a0cb585047 tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:25:12.972736 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.policy [None req-121361ac-69b7-473d-a2b5-48a0cb585047 tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2d3aa18a0a146808f584127411a1cf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1af845e594466b12a11b7cab99a7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117873) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:25:12.985826 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [None req-121361ac-69b7-473d-a2b5-48a0cb585047 tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] 10.222.0.43 "GET /compute/v2.1/servers/8d4bd5f5-1caa-4165-a7d3-73f338df3073" status: 200 len: 1267 microversion: 2.1 time: 0.157052 Jun 22 10:25:12.985826 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 457/922] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:25:12 2022] GET /compute/v2.1/servers/8d4bd5f5-1caa-4165-a7d3-73f338df3073 => generated 1267 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:25:14.001046 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-b6355aaf-0823-4d50-bf85-38ec4a72cdfc tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] Calling method '>' {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:25:14.001835 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.compute.api [None req-b6355aaf-0823-4d50-bf85-38ec4a72cdfc tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] [instance: 8d4bd5f5-1caa-4165-a7d3-73f338df3073] Fetching instance by UUID {{(pid=117874) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:25:14.009577 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-b6355aaf-0823-4d50-bf85-38ec4a72cdfc tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:25:14.010082 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-b6355aaf-0823-4d50-bf85-38ec4a72cdfc tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:25:14.010853 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-b6355aaf-0823-4d50-bf85-38ec4a72cdfc tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:25:14.011293 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-b6355aaf-0823-4d50-bf85-38ec4a72cdfc tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:25:14.147365 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.policy [None req-b6355aaf-0823-4d50-bf85-38ec4a72cdfc tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2d3aa18a0a146808f584127411a1cf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1af845e594466b12a11b7cab99a7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117874) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:25:14.156388 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [None req-b6355aaf-0823-4d50-bf85-38ec4a72cdfc tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] 10.222.0.43 "GET /compute/v2.1/servers/8d4bd5f5-1caa-4165-a7d3-73f338df3073" status: 200 len: 1454 microversion: 2.1 time: 0.161270 Jun 22 10:25:14.157654 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 466/923] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:25:13 2022] GET /compute/v2.1/servers/8d4bd5f5-1caa-4165-a7d3-73f338df3073 => generated 1454 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 10:25:14.173655 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-041f44aa-023d-40d0-b62b-b07369ff489d tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] Calling method '>' {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:25:14.174361 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.compute.api [None req-041f44aa-023d-40d0-b62b-b07369ff489d tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] [instance: 8d4bd5f5-1caa-4165-a7d3-73f338df3073] Fetching instance by UUID {{(pid=117873) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:25:14.181540 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-041f44aa-023d-40d0-b62b-b07369ff489d tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:25:14.182018 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-041f44aa-023d-40d0-b62b-b07369ff489d tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:25:14.182775 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-041f44aa-023d-40d0-b62b-b07369ff489d tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:25:14.183209 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-041f44aa-023d-40d0-b62b-b07369ff489d tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:25:14.321623 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.policy [None req-041f44aa-023d-40d0-b62b-b07369ff489d tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2d3aa18a0a146808f584127411a1cf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1af845e594466b12a11b7cab99a7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117873) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:25:14.329379 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [None req-041f44aa-023d-40d0-b62b-b07369ff489d tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] 10.222.0.43 "GET /compute/v2.1/servers/8d4bd5f5-1caa-4165-a7d3-73f338df3073" status: 200 len: 1454 microversion: 2.1 time: 0.159462 Jun 22 10:25:14.330081 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 458/924] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:25:14 2022] GET /compute/v2.1/servers/8d4bd5f5-1caa-4165-a7d3-73f338df3073 => generated 1454 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:25:16.137119 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [req-61e54cfc-0c1b-443c-8a28-2a650ddf7f48 req-8928c435-3759-4cd5-b94e-c8a02e274133 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8d4bd5f5-1caa-4165-a7d3-73f338df3073", "tag": "fe534632-1c33-4794-bbcb-a54d9a87fefd"}]} {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:25:16.145452 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [req-61e54cfc-0c1b-443c-8a28-2a650ddf7f48 req-8928c435-3759-4cd5-b94e-c8a02e274133 service nova] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:25:16.145940 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [req-61e54cfc-0c1b-443c-8a28-2a650ddf7f48 req-8928c435-3759-4cd5-b94e-c8a02e274133 service nova] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:25:16.157891 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.compute.server_external_events [req-61e54cfc-0c1b-443c-8a28-2a650ddf7f48 req-8928c435-3759-4cd5-b94e-c8a02e274133 service nova] Creating event network-changed:fe534632-1c33-4794-bbcb-a54d9a87fefd for instance 8d4bd5f5-1caa-4165-a7d3-73f338df3073 on hv-cinder-84713 Jun 22 10:25:16.162871 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [req-61e54cfc-0c1b-443c-8a28-2a650ddf7f48 req-8928c435-3759-4cd5-b94e-c8a02e274133 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030638 Jun 22 10:25:16.164266 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 467/925] 10.222.0.43 () {64 vars in 1317 bytes} [Wed Jun 22 10:25:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 10:25:18.478140 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-b3d6e35b-5f67-4369-8772-2c23573b5504 tempest-VolumesSnapshotTestJSON-1146371521 tempest-VolumesSnapshotTestJSON-1146371521-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1104394267", "imageRef": "22d2c064-5bf7-438e-bbb7-47259e4bdab5", "flavorRef": "452", "networks": [{"uuid": "20f65aeb-74a5-4851-b116-5aa3287c3229"}]}} {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:25:18.527040 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.network.neutron [None req-b3d6e35b-5f67-4369-8772-2c23573b5504 tempest-VolumesSnapshotTestJSON-1146371521 tempest-VolumesSnapshotTestJSON-1146371521-project] validate_networks() for [('20f65aeb-74a5-4851-b116-5aa3287c3229', None, None, None, None, None)] {{(pid=117873) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 22 10:25:18.868004 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.virt.hardware [None req-b3d6e35b-5f67-4369-8772-2c23573b5504 tempest-VolumesSnapshotTestJSON-1146371521 tempest-VolumesSnapshotTestJSON-1146371521-project] Flavor limits 0:0:0 {{(pid=117873) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 22 10:25:18.868357 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.virt.hardware [None req-b3d6e35b-5f67-4369-8772-2c23573b5504 tempest-VolumesSnapshotTestJSON-1146371521 tempest-VolumesSnapshotTestJSON-1146371521-project] Image limits 0:0:0 {{(pid=117873) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 22 10:25:18.868823 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.virt.hardware [None req-b3d6e35b-5f67-4369-8772-2c23573b5504 tempest-VolumesSnapshotTestJSON-1146371521 tempest-VolumesSnapshotTestJSON-1146371521-project] Flavor pref 0:0:0 {{(pid=117873) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 22 10:25:18.869221 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.virt.hardware [None req-b3d6e35b-5f67-4369-8772-2c23573b5504 tempest-VolumesSnapshotTestJSON-1146371521 tempest-VolumesSnapshotTestJSON-1146371521-project] Image pref 0:0:0 {{(pid=117873) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 22 10:25:18.869622 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.virt.hardware [None req-b3d6e35b-5f67-4369-8772-2c23573b5504 tempest-VolumesSnapshotTestJSON-1146371521 tempest-VolumesSnapshotTestJSON-1146371521-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117873) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 22 10:25:18.878419 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-b3d6e35b-5f67-4369-8772-2c23573b5504 tempest-VolumesSnapshotTestJSON-1146371521 tempest-VolumesSnapshotTestJSON-1146371521-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:25:18.878858 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-b3d6e35b-5f67-4369-8772-2c23573b5504 tempest-VolumesSnapshotTestJSON-1146371521 tempest-VolumesSnapshotTestJSON-1146371521-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:25:18.879635 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-b3d6e35b-5f67-4369-8772-2c23573b5504 tempest-VolumesSnapshotTestJSON-1146371521 tempest-VolumesSnapshotTestJSON-1146371521-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:25:18.880062 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-b3d6e35b-5f67-4369-8772-2c23573b5504 tempest-VolumesSnapshotTestJSON-1146371521 tempest-VolumesSnapshotTestJSON-1146371521-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:25:18.897942 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.quota [None req-b3d6e35b-5f67-4369-8772-2c23573b5504 tempest-VolumesSnapshotTestJSON-1146371521 tempest-VolumesSnapshotTestJSON-1146371521-project] Getting quotas for project 60103a2f42f244e3af1d92a8a378fece. Resources: {'instances', 'cores', 'ram'} {{(pid=117873) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 22 10:25:18.902557 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.quota [None req-b3d6e35b-5f67-4369-8772-2c23573b5504 tempest-VolumesSnapshotTestJSON-1146371521 tempest-VolumesSnapshotTestJSON-1146371521-project] Getting quotas for user b402c2d3251a411a818b61b872dca060 and project 60103a2f42f244e3af1d92a8a378fece. Resources: {'instances', 'cores', 'ram'} {{(pid=117873) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 22 10:25:18.913546 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.compute.api [None req-b3d6e35b-5f67-4369-8772-2c23573b5504 tempest-VolumesSnapshotTestJSON-1146371521 tempest-VolumesSnapshotTestJSON-1146371521-project] Going to run 1 instances... {{(pid=117873) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 22 10:25:18.916053 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.compute.api [None req-b3d6e35b-5f67-4369-8772-2c23573b5504 tempest-VolumesSnapshotTestJSON-1146371521 tempest-VolumesSnapshotTestJSON-1146371521-project] [instance: e1a65e9e-ffe1-4b75-87f0-e3fece9f23dd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='22d2c064-5bf7-438e-bbb7-47259e4bdab5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117873) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 22 10:25:18.960209 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [None req-b3d6e35b-5f67-4369-8772-2c23573b5504 tempest-VolumesSnapshotTestJSON-1146371521 tempest-VolumesSnapshotTestJSON-1146371521-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.487019 Jun 22 10:25:18.960866 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 459/926] 10.222.0.43 () {60 vars in 1146 bytes} [Wed Jun 22 10:25:18 2022] POST /compute/v2.1/servers => generated 380 bytes in 488 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 22 10:25:18.972415 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-cba4fdc0-1942-4d8e-8478-1ed919544997 tempest-VolumesSnapshotTestJSON-1146371521 tempest-VolumesSnapshotTestJSON-1146371521-project] Calling method '>' {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:25:18.973110 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.compute.api [None req-cba4fdc0-1942-4d8e-8478-1ed919544997 tempest-VolumesSnapshotTestJSON-1146371521 tempest-VolumesSnapshotTestJSON-1146371521-project] [instance: e1a65e9e-ffe1-4b75-87f0-e3fece9f23dd] Fetching instance by UUID {{(pid=117874) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:25:19.030782 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.policy [None req-cba4fdc0-1942-4d8e-8478-1ed919544997 tempest-VolumesSnapshotTestJSON-1146371521 tempest-VolumesSnapshotTestJSON-1146371521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b402c2d3251a411a818b61b872dca060', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60103a2f42f244e3af1d92a8a378fece', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117874) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:25:19.037836 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [None req-cba4fdc0-1942-4d8e-8478-1ed919544997 tempest-VolumesSnapshotTestJSON-1146371521 tempest-VolumesSnapshotTestJSON-1146371521-project] 10.222.0.43 "GET /compute/v2.1/servers/e1a65e9e-ffe1-4b75-87f0-e3fece9f23dd" status: 200 len: 1219 microversion: 2.1 time: 0.069583 Jun 22 10:25:19.038416 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 468/927] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:25:18 2022] GET /compute/v2.1/servers/e1a65e9e-ffe1-4b75-87f0-e3fece9f23dd => generated 1219 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:25:20.055605 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-a6d553a9-5d86-4155-bde9-ea2be125b116 tempest-VolumesSnapshotTestJSON-1146371521 tempest-VolumesSnapshotTestJSON-1146371521-project] Calling method '>' {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:25:20.056351 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.compute.api [None req-a6d553a9-5d86-4155-bde9-ea2be125b116 tempest-VolumesSnapshotTestJSON-1146371521 tempest-VolumesSnapshotTestJSON-1146371521-project] [instance: e1a65e9e-ffe1-4b75-87f0-e3fece9f23dd] Fetching instance by UUID {{(pid=117873) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:25:20.062858 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-a6d553a9-5d86-4155-bde9-ea2be125b116 tempest-VolumesSnapshotTestJSON-1146371521 tempest-VolumesSnapshotTestJSON-1146371521-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:25:20.063392 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-a6d553a9-5d86-4155-bde9-ea2be125b116 tempest-VolumesSnapshotTestJSON-1146371521 tempest-VolumesSnapshotTestJSON-1146371521-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:25:20.064301 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-a6d553a9-5d86-4155-bde9-ea2be125b116 tempest-VolumesSnapshotTestJSON-1146371521 tempest-VolumesSnapshotTestJSON-1146371521-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:25:20.064786 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-a6d553a9-5d86-4155-bde9-ea2be125b116 tempest-VolumesSnapshotTestJSON-1146371521 tempest-VolumesSnapshotTestJSON-1146371521-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:25:20.127700 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.policy [None req-a6d553a9-5d86-4155-bde9-ea2be125b116 tempest-VolumesSnapshotTestJSON-1146371521 tempest-VolumesSnapshotTestJSON-1146371521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b402c2d3251a411a818b61b872dca060', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60103a2f42f244e3af1d92a8a378fece', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117873) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:25:20.135815 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [None req-a6d553a9-5d86-4155-bde9-ea2be125b116 tempest-VolumesSnapshotTestJSON-1146371521 tempest-VolumesSnapshotTestJSON-1146371521-project] 10.222.0.43 "GET /compute/v2.1/servers/e1a65e9e-ffe1-4b75-87f0-e3fece9f23dd" status: 200 len: 1277 microversion: 2.1 time: 0.084635 Jun 22 10:25:20.136394 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 460/928] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:25:20 2022] GET /compute/v2.1/servers/e1a65e9e-ffe1-4b75-87f0-e3fece9f23dd => generated 1277 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:25:21.152522 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [req-07d6d2de-53e5-45fb-a840-f9fd6da95a37 req-cf9bd25b-36ad-41d2-8f49-603b289bcfed service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e1a65e9e-ffe1-4b75-87f0-e3fece9f23dd", "tag": "b5bc380f-f1d8-4db9-a832-0a9591f643fe"}]} {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:25:21.153930 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-66454e9d-1dba-4cd3-88d4-11fde8f27d2b tempest-VolumesSnapshotTestJSON-1146371521 tempest-VolumesSnapshotTestJSON-1146371521-project] Calling method '>' {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:25:21.155285 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.compute.api [None req-66454e9d-1dba-4cd3-88d4-11fde8f27d2b tempest-VolumesSnapshotTestJSON-1146371521 tempest-VolumesSnapshotTestJSON-1146371521-project] [instance: e1a65e9e-ffe1-4b75-87f0-e3fece9f23dd] Fetching instance by UUID {{(pid=117873) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:25:21.162518 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-66454e9d-1dba-4cd3-88d4-11fde8f27d2b tempest-VolumesSnapshotTestJSON-1146371521 tempest-VolumesSnapshotTestJSON-1146371521-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:25:21.163259 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-66454e9d-1dba-4cd3-88d4-11fde8f27d2b tempest-VolumesSnapshotTestJSON-1146371521 tempest-VolumesSnapshotTestJSON-1146371521-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:25:21.164064 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [req-07d6d2de-53e5-45fb-a840-f9fd6da95a37 req-cf9bd25b-36ad-41d2-8f49-603b289bcfed service nova] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:25:21.165269 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [req-07d6d2de-53e5-45fb-a840-f9fd6da95a37 req-cf9bd25b-36ad-41d2-8f49-603b289bcfed service nova] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:25:21.165716 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-66454e9d-1dba-4cd3-88d4-11fde8f27d2b tempest-VolumesSnapshotTestJSON-1146371521 tempest-VolumesSnapshotTestJSON-1146371521-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:25:21.166269 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-66454e9d-1dba-4cd3-88d4-11fde8f27d2b tempest-VolumesSnapshotTestJSON-1146371521 tempest-VolumesSnapshotTestJSON-1146371521-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:25:21.184387 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.compute.server_external_events [req-07d6d2de-53e5-45fb-a840-f9fd6da95a37 req-cf9bd25b-36ad-41d2-8f49-603b289bcfed service nova] Creating event network-changed:b5bc380f-f1d8-4db9-a832-0a9591f643fe for instance e1a65e9e-ffe1-4b75-87f0-e3fece9f23dd on hv-cinder-84713 Jun 22 10:25:21.190481 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [req-07d6d2de-53e5-45fb-a840-f9fd6da95a37 req-cf9bd25b-36ad-41d2-8f49-603b289bcfed service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042451 Jun 22 10:25:21.191319 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 469/929] 10.222.0.43 () {64 vars in 1317 bytes} [Wed Jun 22 10:25:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 10:25:21.308401 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.policy [None req-66454e9d-1dba-4cd3-88d4-11fde8f27d2b tempest-VolumesSnapshotTestJSON-1146371521 tempest-VolumesSnapshotTestJSON-1146371521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b402c2d3251a411a818b61b872dca060', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60103a2f42f244e3af1d92a8a378fece', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117873) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:25:21.315946 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [None req-66454e9d-1dba-4cd3-88d4-11fde8f27d2b tempest-VolumesSnapshotTestJSON-1146371521 tempest-VolumesSnapshotTestJSON-1146371521-project] 10.222.0.43 "GET /compute/v2.1/servers/e1a65e9e-ffe1-4b75-87f0-e3fece9f23dd" status: 200 len: 1319 microversion: 2.1 time: 0.167295 Jun 22 10:25:21.316563 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 461/930] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:25:21 2022] GET /compute/v2.1/servers/e1a65e9e-ffe1-4b75-87f0-e3fece9f23dd => generated 1319 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 10:25:22.333951 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-64c627a0-94e8-4580-9c7b-18083e9ec4fa tempest-VolumesSnapshotTestJSON-1146371521 tempest-VolumesSnapshotTestJSON-1146371521-project] Calling method '>' {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:25:22.334651 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.compute.api [None req-64c627a0-94e8-4580-9c7b-18083e9ec4fa tempest-VolumesSnapshotTestJSON-1146371521 tempest-VolumesSnapshotTestJSON-1146371521-project] [instance: e1a65e9e-ffe1-4b75-87f0-e3fece9f23dd] Fetching instance by UUID {{(pid=117874) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:25:22.342071 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-64c627a0-94e8-4580-9c7b-18083e9ec4fa tempest-VolumesSnapshotTestJSON-1146371521 tempest-VolumesSnapshotTestJSON-1146371521-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:25:22.342524 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-64c627a0-94e8-4580-9c7b-18083e9ec4fa tempest-VolumesSnapshotTestJSON-1146371521 tempest-VolumesSnapshotTestJSON-1146371521-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:25:22.343290 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-64c627a0-94e8-4580-9c7b-18083e9ec4fa tempest-VolumesSnapshotTestJSON-1146371521 tempest-VolumesSnapshotTestJSON-1146371521-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:25:22.343726 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-64c627a0-94e8-4580-9c7b-18083e9ec4fa tempest-VolumesSnapshotTestJSON-1146371521 tempest-VolumesSnapshotTestJSON-1146371521-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:25:22.480429 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.policy [None req-64c627a0-94e8-4580-9c7b-18083e9ec4fa tempest-VolumesSnapshotTestJSON-1146371521 tempest-VolumesSnapshotTestJSON-1146371521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b402c2d3251a411a818b61b872dca060', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60103a2f42f244e3af1d92a8a378fece', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117874) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:25:22.487877 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [None req-64c627a0-94e8-4580-9c7b-18083e9ec4fa tempest-VolumesSnapshotTestJSON-1146371521 tempest-VolumesSnapshotTestJSON-1146371521-project] 10.222.0.43 "GET /compute/v2.1/servers/e1a65e9e-ffe1-4b75-87f0-e3fece9f23dd" status: 200 len: 1319 microversion: 2.1 time: 0.158724 Jun 22 10:25:22.488442 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 470/931] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:25:22 2022] GET /compute/v2.1/servers/e1a65e9e-ffe1-4b75-87f0-e3fece9f23dd => generated 1319 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:25:23.503921 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-1865efbe-0149-4278-9007-68814b58b975 tempest-VolumesSnapshotTestJSON-1146371521 tempest-VolumesSnapshotTestJSON-1146371521-project] Calling method '>' {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:25:23.504523 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.compute.api [None req-1865efbe-0149-4278-9007-68814b58b975 tempest-VolumesSnapshotTestJSON-1146371521 tempest-VolumesSnapshotTestJSON-1146371521-project] [instance: e1a65e9e-ffe1-4b75-87f0-e3fece9f23dd] Fetching instance by UUID {{(pid=117873) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:25:23.506872 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG dbcounter [-] [117873] Writing DB stats nova_api:SELECT=50,nova_api:INSERT=3 {{(pid=117873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:25:23.512649 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-1865efbe-0149-4278-9007-68814b58b975 tempest-VolumesSnapshotTestJSON-1146371521 tempest-VolumesSnapshotTestJSON-1146371521-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:25:23.513087 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-1865efbe-0149-4278-9007-68814b58b975 tempest-VolumesSnapshotTestJSON-1146371521 tempest-VolumesSnapshotTestJSON-1146371521-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:25:23.513877 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-1865efbe-0149-4278-9007-68814b58b975 tempest-VolumesSnapshotTestJSON-1146371521 tempest-VolumesSnapshotTestJSON-1146371521-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:25:23.514305 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-1865efbe-0149-4278-9007-68814b58b975 tempest-VolumesSnapshotTestJSON-1146371521 tempest-VolumesSnapshotTestJSON-1146371521-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:25:23.519087 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG dbcounter [-] [117873] Writing DB stats nova_cell1:SELECT=99 {{(pid=117873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:25:23.643005 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.policy [None req-1865efbe-0149-4278-9007-68814b58b975 tempest-VolumesSnapshotTestJSON-1146371521 tempest-VolumesSnapshotTestJSON-1146371521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b402c2d3251a411a818b61b872dca060', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60103a2f42f244e3af1d92a8a378fece', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117873) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:25:23.651083 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [None req-1865efbe-0149-4278-9007-68814b58b975 tempest-VolumesSnapshotTestJSON-1146371521 tempest-VolumesSnapshotTestJSON-1146371521-project] 10.222.0.43 "GET /compute/v2.1/servers/e1a65e9e-ffe1-4b75-87f0-e3fece9f23dd" status: 200 len: 1319 microversion: 2.1 time: 0.151036 Jun 22 10:25:23.651646 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 462/932] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:25:23 2022] GET /compute/v2.1/servers/e1a65e9e-ffe1-4b75-87f0-e3fece9f23dd => generated 1319 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:25:24.668281 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-34b72692-4c6a-4ec3-a2dd-22a9840172e9 tempest-VolumesSnapshotTestJSON-1146371521 tempest-VolumesSnapshotTestJSON-1146371521-project] Calling method '>' {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:25:24.668884 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.compute.api [None req-34b72692-4c6a-4ec3-a2dd-22a9840172e9 tempest-VolumesSnapshotTestJSON-1146371521 tempest-VolumesSnapshotTestJSON-1146371521-project] [instance: e1a65e9e-ffe1-4b75-87f0-e3fece9f23dd] Fetching instance by UUID {{(pid=117874) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:25:24.671376 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG dbcounter [-] [117874] Writing DB stats nova_api:SELECT=59,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=117874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:25:24.676595 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-34b72692-4c6a-4ec3-a2dd-22a9840172e9 tempest-VolumesSnapshotTestJSON-1146371521 tempest-VolumesSnapshotTestJSON-1146371521-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:25:24.677036 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-34b72692-4c6a-4ec3-a2dd-22a9840172e9 tempest-VolumesSnapshotTestJSON-1146371521 tempest-VolumesSnapshotTestJSON-1146371521-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:25:24.677822 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-34b72692-4c6a-4ec3-a2dd-22a9840172e9 tempest-VolumesSnapshotTestJSON-1146371521 tempest-VolumesSnapshotTestJSON-1146371521-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:25:24.678251 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-34b72692-4c6a-4ec3-a2dd-22a9840172e9 tempest-VolumesSnapshotTestJSON-1146371521 tempest-VolumesSnapshotTestJSON-1146371521-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:25:24.682015 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG dbcounter [-] [117874] Writing DB stats nova_cell1:SELECT=92,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=117874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:25:24.812853 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.policy [None req-34b72692-4c6a-4ec3-a2dd-22a9840172e9 tempest-VolumesSnapshotTestJSON-1146371521 tempest-VolumesSnapshotTestJSON-1146371521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b402c2d3251a411a818b61b872dca060', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60103a2f42f244e3af1d92a8a378fece', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117874) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:25:24.820200 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [None req-34b72692-4c6a-4ec3-a2dd-22a9840172e9 tempest-VolumesSnapshotTestJSON-1146371521 tempest-VolumesSnapshotTestJSON-1146371521-project] 10.222.0.43 "GET /compute/v2.1/servers/e1a65e9e-ffe1-4b75-87f0-e3fece9f23dd" status: 200 len: 1319 microversion: 2.1 time: 0.156361 Jun 22 10:25:24.820749 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 471/933] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:25:24 2022] GET /compute/v2.1/servers/e1a65e9e-ffe1-4b75-87f0-e3fece9f23dd => generated 1319 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:25:25.836783 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-5f5979cd-2a75-46d2-ae3c-21c903855768 tempest-VolumesSnapshotTestJSON-1146371521 tempest-VolumesSnapshotTestJSON-1146371521-project] Calling method '>' {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:25:25.837501 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.compute.api [None req-5f5979cd-2a75-46d2-ae3c-21c903855768 tempest-VolumesSnapshotTestJSON-1146371521 tempest-VolumesSnapshotTestJSON-1146371521-project] [instance: e1a65e9e-ffe1-4b75-87f0-e3fece9f23dd] Fetching instance by UUID {{(pid=117873) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:25:25.845477 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-5f5979cd-2a75-46d2-ae3c-21c903855768 tempest-VolumesSnapshotTestJSON-1146371521 tempest-VolumesSnapshotTestJSON-1146371521-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:25:25.846170 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-5f5979cd-2a75-46d2-ae3c-21c903855768 tempest-VolumesSnapshotTestJSON-1146371521 tempest-VolumesSnapshotTestJSON-1146371521-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:25:25.847325 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-5f5979cd-2a75-46d2-ae3c-21c903855768 tempest-VolumesSnapshotTestJSON-1146371521 tempest-VolumesSnapshotTestJSON-1146371521-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:25:25.848009 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-5f5979cd-2a75-46d2-ae3c-21c903855768 tempest-VolumesSnapshotTestJSON-1146371521 tempest-VolumesSnapshotTestJSON-1146371521-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:25:25.981491 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.policy [None req-5f5979cd-2a75-46d2-ae3c-21c903855768 tempest-VolumesSnapshotTestJSON-1146371521 tempest-VolumesSnapshotTestJSON-1146371521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b402c2d3251a411a818b61b872dca060', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60103a2f42f244e3af1d92a8a378fece', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117873) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:25:25.991173 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [None req-5f5979cd-2a75-46d2-ae3c-21c903855768 tempest-VolumesSnapshotTestJSON-1146371521 tempest-VolumesSnapshotTestJSON-1146371521-project] 10.222.0.43 "GET /compute/v2.1/servers/e1a65e9e-ffe1-4b75-87f0-e3fece9f23dd" status: 200 len: 1319 microversion: 2.1 time: 0.158453 Jun 22 10:25:25.991743 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 463/934] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:25:25 2022] GET /compute/v2.1/servers/e1a65e9e-ffe1-4b75-87f0-e3fece9f23dd => generated 1319 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:25:26.127642 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [req-3a4964df-8d75-414c-898e-f65548204d5c req-335abb87-ebd1-4cb8-ad29-38880556ca40 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e1a65e9e-ffe1-4b75-87f0-e3fece9f23dd", "name": "network-vif-plugged", "status": "completed", "tag": "b5bc380f-f1d8-4db9-a832-0a9591f643fe"}]} {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:25:26.138080 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [req-3a4964df-8d75-414c-898e-f65548204d5c req-335abb87-ebd1-4cb8-ad29-38880556ca40 service nova] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:25:26.138508 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [req-3a4964df-8d75-414c-898e-f65548204d5c req-335abb87-ebd1-4cb8-ad29-38880556ca40 service nova] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:25:26.150215 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.compute.server_external_events [req-3a4964df-8d75-414c-898e-f65548204d5c req-335abb87-ebd1-4cb8-ad29-38880556ca40 service nova] Creating event network-vif-plugged:b5bc380f-f1d8-4db9-a832-0a9591f643fe for instance e1a65e9e-ffe1-4b75-87f0-e3fece9f23dd on hv-cinder-84713 Jun 22 10:25:26.156521 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [req-3a4964df-8d75-414c-898e-f65548204d5c req-335abb87-ebd1-4cb8-ad29-38880556ca40 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032122 Jun 22 10:25:26.157558 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 472/935] 10.222.0.43 () {64 vars in 1317 bytes} [Wed Jun 22 10:25:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 10:25:27.009553 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-2295569b-a1e2-41d2-a00a-d7cf893a00fb tempest-VolumesSnapshotTestJSON-1146371521 tempest-VolumesSnapshotTestJSON-1146371521-project] Calling method '>' {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:25:27.010521 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.compute.api [None req-2295569b-a1e2-41d2-a00a-d7cf893a00fb tempest-VolumesSnapshotTestJSON-1146371521 tempest-VolumesSnapshotTestJSON-1146371521-project] [instance: e1a65e9e-ffe1-4b75-87f0-e3fece9f23dd] Fetching instance by UUID {{(pid=117873) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:25:27.016594 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-2295569b-a1e2-41d2-a00a-d7cf893a00fb tempest-VolumesSnapshotTestJSON-1146371521 tempest-VolumesSnapshotTestJSON-1146371521-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:25:27.017035 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-2295569b-a1e2-41d2-a00a-d7cf893a00fb tempest-VolumesSnapshotTestJSON-1146371521 tempest-VolumesSnapshotTestJSON-1146371521-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:25:27.017813 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-2295569b-a1e2-41d2-a00a-d7cf893a00fb tempest-VolumesSnapshotTestJSON-1146371521 tempest-VolumesSnapshotTestJSON-1146371521-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:25:27.018242 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-2295569b-a1e2-41d2-a00a-d7cf893a00fb tempest-VolumesSnapshotTestJSON-1146371521 tempest-VolumesSnapshotTestJSON-1146371521-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:25:27.156282 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.policy [None req-2295569b-a1e2-41d2-a00a-d7cf893a00fb tempest-VolumesSnapshotTestJSON-1146371521 tempest-VolumesSnapshotTestJSON-1146371521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b402c2d3251a411a818b61b872dca060', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60103a2f42f244e3af1d92a8a378fece', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117873) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:25:27.163714 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [None req-2295569b-a1e2-41d2-a00a-d7cf893a00fb tempest-VolumesSnapshotTestJSON-1146371521 tempest-VolumesSnapshotTestJSON-1146371521-project] 10.222.0.43 "GET /compute/v2.1/servers/e1a65e9e-ffe1-4b75-87f0-e3fece9f23dd" status: 200 len: 1319 microversion: 2.1 time: 0.158866 Jun 22 10:25:27.164276 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 464/936] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:25:27 2022] GET /compute/v2.1/servers/e1a65e9e-ffe1-4b75-87f0-e3fece9f23dd => generated 1319 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:25:28.182316 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-606d4fe7-36d0-4729-8e8d-afa4d4f1999b tempest-VolumesSnapshotTestJSON-1146371521 tempest-VolumesSnapshotTestJSON-1146371521-project] Calling method '>' {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:25:28.183073 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.compute.api [None req-606d4fe7-36d0-4729-8e8d-afa4d4f1999b tempest-VolumesSnapshotTestJSON-1146371521 tempest-VolumesSnapshotTestJSON-1146371521-project] [instance: e1a65e9e-ffe1-4b75-87f0-e3fece9f23dd] Fetching instance by UUID {{(pid=117874) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:25:28.189338 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-606d4fe7-36d0-4729-8e8d-afa4d4f1999b tempest-VolumesSnapshotTestJSON-1146371521 tempest-VolumesSnapshotTestJSON-1146371521-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:25:28.189810 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-606d4fe7-36d0-4729-8e8d-afa4d4f1999b tempest-VolumesSnapshotTestJSON-1146371521 tempest-VolumesSnapshotTestJSON-1146371521-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:25:28.190565 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-606d4fe7-36d0-4729-8e8d-afa4d4f1999b tempest-VolumesSnapshotTestJSON-1146371521 tempest-VolumesSnapshotTestJSON-1146371521-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:25:28.190997 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-606d4fe7-36d0-4729-8e8d-afa4d4f1999b tempest-VolumesSnapshotTestJSON-1146371521 tempest-VolumesSnapshotTestJSON-1146371521-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:25:28.321015 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.policy [None req-606d4fe7-36d0-4729-8e8d-afa4d4f1999b tempest-VolumesSnapshotTestJSON-1146371521 tempest-VolumesSnapshotTestJSON-1146371521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b402c2d3251a411a818b61b872dca060', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60103a2f42f244e3af1d92a8a378fece', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117874) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:25:28.329189 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [None req-606d4fe7-36d0-4729-8e8d-afa4d4f1999b tempest-VolumesSnapshotTestJSON-1146371521 tempest-VolumesSnapshotTestJSON-1146371521-project] 10.222.0.43 "GET /compute/v2.1/servers/e1a65e9e-ffe1-4b75-87f0-e3fece9f23dd" status: 200 len: 1509 microversion: 2.1 time: 0.152513 Jun 22 10:25:28.329769 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 473/937] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:25:28 2022] GET /compute/v2.1/servers/e1a65e9e-ffe1-4b75-87f0-e3fece9f23dd => generated 1509 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:25:28.345326 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-228d5a14-3cb3-49ea-8c51-2a8071b3e1ce tempest-VolumesSnapshotTestJSON-1146371521 tempest-VolumesSnapshotTestJSON-1146371521-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c51915b7-b539-4c34-b7b7-f3af8c1f95c5", "device": "/dev/sdb"}} {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:25:28.346500 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.compute.api [None req-228d5a14-3cb3-49ea-8c51-2a8071b3e1ce tempest-VolumesSnapshotTestJSON-1146371521 tempest-VolumesSnapshotTestJSON-1146371521-project] [instance: e1a65e9e-ffe1-4b75-87f0-e3fece9f23dd] Fetching instance by UUID {{(pid=117873) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:25:28.353085 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-228d5a14-3cb3-49ea-8c51-2a8071b3e1ce tempest-VolumesSnapshotTestJSON-1146371521 tempest-VolumesSnapshotTestJSON-1146371521-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:25:28.353525 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-228d5a14-3cb3-49ea-8c51-2a8071b3e1ce tempest-VolumesSnapshotTestJSON-1146371521 tempest-VolumesSnapshotTestJSON-1146371521-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:25:28.354300 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-228d5a14-3cb3-49ea-8c51-2a8071b3e1ce tempest-VolumesSnapshotTestJSON-1146371521 tempest-VolumesSnapshotTestJSON-1146371521-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:25:28.354725 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-228d5a14-3cb3-49ea-8c51-2a8071b3e1ce tempest-VolumesSnapshotTestJSON-1146371521 tempest-VolumesSnapshotTestJSON-1146371521-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:25:28.591495 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [None req-228d5a14-3cb3-49ea-8c51-2a8071b3e1ce tempest-VolumesSnapshotTestJSON-1146371521 tempest-VolumesSnapshotTestJSON-1146371521-project] 10.222.0.43 "POST /compute/v2.1/servers/e1a65e9e-ffe1-4b75-87f0-e3fece9f23dd/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.249645 Jun 22 10:25:28.592110 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 465/938] 10.222.0.43 () {60 vars in 1322 bytes} [Wed Jun 22 10:25:28 2022] POST /compute/v2.1/servers/e1a65e9e-ffe1-4b75-87f0-e3fece9f23dd/os-volume_attachments => generated 194 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 10:25:45.814114 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-f53e5cdb-1477-4196-aae9-3623ef2494e3 tempest-VolumesSnapshotTestJSON-1146371521 tempest-VolumesSnapshotTestJSON-1146371521-project] Calling method '>' {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:25:45.814670 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.compute.api [None req-f53e5cdb-1477-4196-aae9-3623ef2494e3 tempest-VolumesSnapshotTestJSON-1146371521 tempest-VolumesSnapshotTestJSON-1146371521-project] [instance: e1a65e9e-ffe1-4b75-87f0-e3fece9f23dd] Fetching instance by UUID {{(pid=117874) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:25:45.816573 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG dbcounter [-] [117874] Writing DB stats nova_cell0:SELECT=2 {{(pid=117874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:25:45.817322 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG dbcounter [-] [117874] Writing DB stats nova_api:SELECT=5 {{(pid=117874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:25:45.818083 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG dbcounter [-] [117874] Writing DB stats nova_cell1:SELECT=13 {{(pid=117874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:25:45.826665 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-f53e5cdb-1477-4196-aae9-3623ef2494e3 tempest-VolumesSnapshotTestJSON-1146371521 tempest-VolumesSnapshotTestJSON-1146371521-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:25:45.827128 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-f53e5cdb-1477-4196-aae9-3623ef2494e3 tempest-VolumesSnapshotTestJSON-1146371521 tempest-VolumesSnapshotTestJSON-1146371521-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:25:45.828421 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-f53e5cdb-1477-4196-aae9-3623ef2494e3 tempest-VolumesSnapshotTestJSON-1146371521 tempest-VolumesSnapshotTestJSON-1146371521-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:25:45.828421 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-f53e5cdb-1477-4196-aae9-3623ef2494e3 tempest-VolumesSnapshotTestJSON-1146371521 tempest-VolumesSnapshotTestJSON-1146371521-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:25:45.975302 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.objects.instance [None req-f53e5cdb-1477-4196-aae9-3623ef2494e3 tempest-VolumesSnapshotTestJSON-1146371521 tempest-VolumesSnapshotTestJSON-1146371521-project] Lazy-loading 'services' on Instance uuid e1a65e9e-ffe1-4b75-87f0-e3fece9f23dd {{(pid=117874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 22 10:25:46.053901 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [None req-f53e5cdb-1477-4196-aae9-3623ef2494e3 tempest-VolumesSnapshotTestJSON-1146371521 tempest-VolumesSnapshotTestJSON-1146371521-project] 10.222.0.43 "DELETE /compute/v2.1/servers/e1a65e9e-ffe1-4b75-87f0-e3fece9f23dd/os-volume_attachments/c51915b7-b539-4c34-b7b7-f3af8c1f95c5" status: 202 len: 0 microversion: 2.1 time: 0.243775 Jun 22 10:25:46.054424 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 474/939] 10.222.0.43 () {58 vars in 1415 bytes} [Wed Jun 22 10:25:45 2022] DELETE /compute/v2.1/servers/e1a65e9e-ffe1-4b75-87f0-e3fece9f23dd/os-volume_attachments/c51915b7-b539-4c34-b7b7-f3af8c1f95c5 => generated 0 bytes in 245 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 22 10:25:47.169956 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-423528b4-dd9f-4a31-bf31-306231b712f7 tempest-VolumesSnapshotTestJSON-1146371521 tempest-VolumesSnapshotTestJSON-1146371521-project] Calling method '>' {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:25:47.170544 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.compute.api [None req-423528b4-dd9f-4a31-bf31-306231b712f7 tempest-VolumesSnapshotTestJSON-1146371521 tempest-VolumesSnapshotTestJSON-1146371521-project] [instance: e1a65e9e-ffe1-4b75-87f0-e3fece9f23dd] Fetching instance by UUID {{(pid=117873) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:25:47.172909 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG dbcounter [-] [117873] Writing DB stats nova_cell0:SELECT=2 {{(pid=117873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:25:47.173774 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG dbcounter [-] [117873] Writing DB stats nova_cell0:SELECT=6 {{(pid=117873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:25:47.174585 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG dbcounter [-] [117873] Writing DB stats nova_api:SELECT=7 {{(pid=117873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:25:47.175497 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG dbcounter [-] [117873] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:25:47.183869 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-423528b4-dd9f-4a31-bf31-306231b712f7 tempest-VolumesSnapshotTestJSON-1146371521 tempest-VolumesSnapshotTestJSON-1146371521-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:25:47.184319 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-423528b4-dd9f-4a31-bf31-306231b712f7 tempest-VolumesSnapshotTestJSON-1146371521 tempest-VolumesSnapshotTestJSON-1146371521-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:25:47.185081 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-423528b4-dd9f-4a31-bf31-306231b712f7 tempest-VolumesSnapshotTestJSON-1146371521 tempest-VolumesSnapshotTestJSON-1146371521-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:25:47.185520 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-423528b4-dd9f-4a31-bf31-306231b712f7 tempest-VolumesSnapshotTestJSON-1146371521 tempest-VolumesSnapshotTestJSON-1146371521-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:25:47.212794 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.compute.api [None req-423528b4-dd9f-4a31-bf31-306231b712f7 tempest-VolumesSnapshotTestJSON-1146371521 tempest-VolumesSnapshotTestJSON-1146371521-project] [instance: e1a65e9e-ffe1-4b75-87f0-e3fece9f23dd] Going to try to terminate instance {{(pid=117873) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 22 10:25:47.287538 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [None req-423528b4-dd9f-4a31-bf31-306231b712f7 tempest-VolumesSnapshotTestJSON-1146371521 tempest-VolumesSnapshotTestJSON-1146371521-project] 10.222.0.43 "DELETE /compute/v2.1/servers/e1a65e9e-ffe1-4b75-87f0-e3fece9f23dd" status: 204 len: 0 microversion: 2.1 time: 0.121580 Jun 22 10:25:47.288340 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 466/940] 10.222.0.43 () {58 vars in 1238 bytes} [Wed Jun 22 10:25:47 2022] DELETE /compute/v2.1/servers/e1a65e9e-ffe1-4b75-87f0-e3fece9f23dd => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 22 10:25:47.297611 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-abaa19b8-56fe-4760-bc60-bb41ddce8ea2 tempest-VolumesSnapshotTestJSON-1146371521 tempest-VolumesSnapshotTestJSON-1146371521-project] Calling method '>' {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:25:47.298555 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.compute.api [None req-abaa19b8-56fe-4760-bc60-bb41ddce8ea2 tempest-VolumesSnapshotTestJSON-1146371521 tempest-VolumesSnapshotTestJSON-1146371521-project] [instance: e1a65e9e-ffe1-4b75-87f0-e3fece9f23dd] Fetching instance by UUID {{(pid=117874) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:25:47.304787 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-abaa19b8-56fe-4760-bc60-bb41ddce8ea2 tempest-VolumesSnapshotTestJSON-1146371521 tempest-VolumesSnapshotTestJSON-1146371521-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:25:47.305333 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-abaa19b8-56fe-4760-bc60-bb41ddce8ea2 tempest-VolumesSnapshotTestJSON-1146371521 tempest-VolumesSnapshotTestJSON-1146371521-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:25:47.306135 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-abaa19b8-56fe-4760-bc60-bb41ddce8ea2 tempest-VolumesSnapshotTestJSON-1146371521 tempest-VolumesSnapshotTestJSON-1146371521-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:25:47.306573 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-abaa19b8-56fe-4760-bc60-bb41ddce8ea2 tempest-VolumesSnapshotTestJSON-1146371521 tempest-VolumesSnapshotTestJSON-1146371521-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:25:47.439623 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.policy [None req-abaa19b8-56fe-4760-bc60-bb41ddce8ea2 tempest-VolumesSnapshotTestJSON-1146371521 tempest-VolumesSnapshotTestJSON-1146371521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b402c2d3251a411a818b61b872dca060', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60103a2f42f244e3af1d92a8a378fece', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117874) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:25:47.448168 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [None req-abaa19b8-56fe-4760-bc60-bb41ddce8ea2 tempest-VolumesSnapshotTestJSON-1146371521 tempest-VolumesSnapshotTestJSON-1146371521-project] 10.222.0.43 "GET /compute/v2.1/servers/e1a65e9e-ffe1-4b75-87f0-e3fece9f23dd" status: 200 len: 1515 microversion: 2.1 time: 0.155239 Jun 22 10:25:47.448739 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 475/941] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:25:47 2022] GET /compute/v2.1/servers/e1a65e9e-ffe1-4b75-87f0-e3fece9f23dd => generated 1515 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:25:48.466828 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-ade33cf1-d204-4d17-bc9b-2141055090be tempest-VolumesSnapshotTestJSON-1146371521 tempest-VolumesSnapshotTestJSON-1146371521-project] Calling method '>' {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:25:48.467513 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.compute.api [None req-ade33cf1-d204-4d17-bc9b-2141055090be tempest-VolumesSnapshotTestJSON-1146371521 tempest-VolumesSnapshotTestJSON-1146371521-project] [instance: e1a65e9e-ffe1-4b75-87f0-e3fece9f23dd] Fetching instance by UUID {{(pid=117873) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:25:48.473967 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-ade33cf1-d204-4d17-bc9b-2141055090be tempest-VolumesSnapshotTestJSON-1146371521 tempest-VolumesSnapshotTestJSON-1146371521-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:25:48.474408 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-ade33cf1-d204-4d17-bc9b-2141055090be tempest-VolumesSnapshotTestJSON-1146371521 tempest-VolumesSnapshotTestJSON-1146371521-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:25:48.475406 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-ade33cf1-d204-4d17-bc9b-2141055090be tempest-VolumesSnapshotTestJSON-1146371521 tempest-VolumesSnapshotTestJSON-1146371521-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:25:48.475830 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-ade33cf1-d204-4d17-bc9b-2141055090be tempest-VolumesSnapshotTestJSON-1146371521 tempest-VolumesSnapshotTestJSON-1146371521-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:25:48.657292 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.policy [None req-ade33cf1-d204-4d17-bc9b-2141055090be tempest-VolumesSnapshotTestJSON-1146371521 tempest-VolumesSnapshotTestJSON-1146371521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b402c2d3251a411a818b61b872dca060', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60103a2f42f244e3af1d92a8a378fece', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117873) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:25:48.665856 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [None req-ade33cf1-d204-4d17-bc9b-2141055090be tempest-VolumesSnapshotTestJSON-1146371521 tempest-VolumesSnapshotTestJSON-1146371521-project] 10.222.0.43 "GET /compute/v2.1/servers/e1a65e9e-ffe1-4b75-87f0-e3fece9f23dd" status: 200 len: 1515 microversion: 2.1 time: 0.203167 Jun 22 10:25:48.666432 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 467/942] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:25:48 2022] GET /compute/v2.1/servers/e1a65e9e-ffe1-4b75-87f0-e3fece9f23dd => generated 1515 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:25:49.392627 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [req-b9359348-8687-4be3-b8fc-15c06d43c559 req-06693b2e-6fcd-4fee-8481-ac44f7255940 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e1a65e9e-ffe1-4b75-87f0-e3fece9f23dd", "name": "network-vif-deleted", "tag": "b5bc380f-f1d8-4db9-a832-0a9591f643fe"}]} {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:25:49.401507 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [req-b9359348-8687-4be3-b8fc-15c06d43c559 req-06693b2e-6fcd-4fee-8481-ac44f7255940 service nova] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:25:49.401987 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [req-b9359348-8687-4be3-b8fc-15c06d43c559 req-06693b2e-6fcd-4fee-8481-ac44f7255940 service nova] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:25:49.413235 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.compute.server_external_events [req-b9359348-8687-4be3-b8fc-15c06d43c559 req-06693b2e-6fcd-4fee-8481-ac44f7255940 service nova] Creating event network-vif-deleted:b5bc380f-f1d8-4db9-a832-0a9591f643fe for instance e1a65e9e-ffe1-4b75-87f0-e3fece9f23dd on hv-cinder-84713 Jun 22 10:25:49.418693 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [req-b9359348-8687-4be3-b8fc-15c06d43c559 req-06693b2e-6fcd-4fee-8481-ac44f7255940 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029819 Jun 22 10:25:49.419326 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 476/943] 10.222.0.43 () {64 vars in 1317 bytes} [Wed Jun 22 10:25:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 10:25:49.684937 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-1cca98e2-566b-47d7-bcdd-27eac75ae987 tempest-VolumesSnapshotTestJSON-1146371521 tempest-VolumesSnapshotTestJSON-1146371521-project] Calling method '>' {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:25:49.685544 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.compute.api [None req-1cca98e2-566b-47d7-bcdd-27eac75ae987 tempest-VolumesSnapshotTestJSON-1146371521 tempest-VolumesSnapshotTestJSON-1146371521-project] [instance: e1a65e9e-ffe1-4b75-87f0-e3fece9f23dd] Fetching instance by UUID {{(pid=117873) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:25:49.692051 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-1cca98e2-566b-47d7-bcdd-27eac75ae987 tempest-VolumesSnapshotTestJSON-1146371521 tempest-VolumesSnapshotTestJSON-1146371521-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:25:49.692494 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-1cca98e2-566b-47d7-bcdd-27eac75ae987 tempest-VolumesSnapshotTestJSON-1146371521 tempest-VolumesSnapshotTestJSON-1146371521-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:25:49.693248 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-1cca98e2-566b-47d7-bcdd-27eac75ae987 tempest-VolumesSnapshotTestJSON-1146371521 tempest-VolumesSnapshotTestJSON-1146371521-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:25:49.693680 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-1cca98e2-566b-47d7-bcdd-27eac75ae987 tempest-VolumesSnapshotTestJSON-1146371521 tempest-VolumesSnapshotTestJSON-1146371521-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:25:49.725107 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-1cca98e2-566b-47d7-bcdd-27eac75ae987 tempest-VolumesSnapshotTestJSON-1146371521 tempest-VolumesSnapshotTestJSON-1146371521-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:25:49.725555 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-1cca98e2-566b-47d7-bcdd-27eac75ae987 tempest-VolumesSnapshotTestJSON-1146371521 tempest-VolumesSnapshotTestJSON-1146371521-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:25:49.726025 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.objects.instance [None req-1cca98e2-566b-47d7-bcdd-27eac75ae987 tempest-VolumesSnapshotTestJSON-1146371521 tempest-VolumesSnapshotTestJSON-1146371521-project] Lazy-loading 'fault' on Instance uuid e1a65e9e-ffe1-4b75-87f0-e3fece9f23dd {{(pid=117873) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 22 10:25:49.771029 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.policy [None req-1cca98e2-566b-47d7-bcdd-27eac75ae987 tempest-VolumesSnapshotTestJSON-1146371521 tempest-VolumesSnapshotTestJSON-1146371521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b402c2d3251a411a818b61b872dca060', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60103a2f42f244e3af1d92a8a378fece', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117873) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:25:49.779328 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [None req-1cca98e2-566b-47d7-bcdd-27eac75ae987 tempest-VolumesSnapshotTestJSON-1146371521 tempest-VolumesSnapshotTestJSON-1146371521-project] 10.222.0.43 "GET /compute/v2.1/servers/e1a65e9e-ffe1-4b75-87f0-e3fece9f23dd" status: 200 len: 1309 microversion: 2.1 time: 0.098194 Jun 22 10:25:49.780090 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 468/944] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:25:49 2022] GET /compute/v2.1/servers/e1a65e9e-ffe1-4b75-87f0-e3fece9f23dd => generated 1309 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:25:50.797179 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-47293382-2d50-4d8e-a56f-5c67807d159e tempest-VolumesSnapshotTestJSON-1146371521 tempest-VolumesSnapshotTestJSON-1146371521-project] Calling method '>' {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:25:50.797896 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.compute.api [None req-47293382-2d50-4d8e-a56f-5c67807d159e tempest-VolumesSnapshotTestJSON-1146371521 tempest-VolumesSnapshotTestJSON-1146371521-project] [instance: e1a65e9e-ffe1-4b75-87f0-e3fece9f23dd] Fetching instance by UUID {{(pid=117874) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:25:50.804124 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-47293382-2d50-4d8e-a56f-5c67807d159e tempest-VolumesSnapshotTestJSON-1146371521 tempest-VolumesSnapshotTestJSON-1146371521-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:25:50.804569 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-47293382-2d50-4d8e-a56f-5c67807d159e tempest-VolumesSnapshotTestJSON-1146371521 tempest-VolumesSnapshotTestJSON-1146371521-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:25:50.806236 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-47293382-2d50-4d8e-a56f-5c67807d159e tempest-VolumesSnapshotTestJSON-1146371521 tempest-VolumesSnapshotTestJSON-1146371521-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:25:50.806677 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-47293382-2d50-4d8e-a56f-5c67807d159e tempest-VolumesSnapshotTestJSON-1146371521 tempest-VolumesSnapshotTestJSON-1146371521-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:25:50.822589 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.wsgi [None req-47293382-2d50-4d8e-a56f-5c67807d159e tempest-VolumesSnapshotTestJSON-1146371521 tempest-VolumesSnapshotTestJSON-1146371521-project] HTTP exception thrown: Instance e1a65e9e-ffe1-4b75-87f0-e3fece9f23dd could not be found. Jun 22 10:25:50.824179 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-47293382-2d50-4d8e-a56f-5c67807d159e tempest-VolumesSnapshotTestJSON-1146371521 tempest-VolumesSnapshotTestJSON-1146371521-project] Request method failure captured: Jun 22 10:25:50.824179 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: request: GET /compute/v2.1/servers/e1a65e9e-ffe1-4b75-87f0-e3fece9f23dd HTTP/1.1 Jun 22 10:25:50.824179 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: Accept: application/json Jun 22 10:25:50.824179 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: Accept-Encoding: identity Jun 22 10:25:50.824179 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: Connection: close Jun 22 10:25:50.824179 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: Content-Length: 0 Jun 22 10:25:50.824179 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: Content-Type: application/json Jun 22 10:25:50.824179 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: Host: 10.222.0.43 Jun 22 10:25:50.824179 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: Openstack-System-Scope: None Jun 22 10:25:50.824179 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: User-Agent: python-urllib3/1.26.9 Jun 22 10:25:50.824179 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-Auth-Token: gAAAAABisu3GA5qtg8ewhos7_Rk0xa-2hmsYtC_ntwJNaAPK6NnP9TwCUkLKx8Vsvc4965N0RQfEln8Y9pNpHKSbKJvP7BTqwzrsMPjNUkhbaXCooAUVwV3LyjM61Hf_-WCfmrpmaClAbPgo-n4-G68Kc1QG8GmreRYQUf_5Sq34tjGV-0iRMEM Jun 22 10:25:50.824179 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-Domain-Id: None Jun 22 10:25:50.824179 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-Domain-Name: None Jun 22 10:25:50.824179 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-Identity-Status: Confirmed Jun 22 10:25:50.824179 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-Is-Admin-Project: True Jun 22 10:25:50.824179 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-Project-Domain-Id: default Jun 22 10:25:50.824179 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-Project-Domain-Name: Default Jun 22 10:25:50.824179 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-Project-Id: 60103a2f42f244e3af1d92a8a378fece Jun 22 10:25:50.824179 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1146371521 Jun 22 10:25:50.824179 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-Role: reader,member Jun 22 10:25:50.824179 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-Roles: reader,member Jun 22 10:25:50.825827 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/60103a2f42f244e3af1d92a8a378fece"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/60103a2f42f244e3af1d92a8a378fece"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_60103a2f42f244e3af1d92a8a378fece", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/60103a2f42f244e3af1d92a8a378fece"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}] Jun 22 10:25:50.825827 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-Tenant: tempest-VolumesSnapshotTestJSON-1146371521 Jun 22 10:25:50.825827 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-Tenant-Id: 60103a2f42f244e3af1d92a8a378fece Jun 22 10:25:50.825827 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1146371521 Jun 22 10:25:50.825827 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-User: tempest-VolumesSnapshotTestJSON-1146371521-project Jun 22 10:25:50.825827 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-User-Domain-Id: default Jun 22 10:25:50.825827 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-User-Domain-Name: Default Jun 22 10:25:50.825827 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-User-Id: b402c2d3251a411a818b61b872dca060 Jun 22 10:25:50.825827 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-User-Name: tempest-VolumesSnapshotTestJSON-1146371521-project Jun 22 10:25:50.825827 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: method: > Jun 22 10:25:50.825827 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: exception: Instance e1a65e9e-ffe1-4b75-87f0-e3fece9f23dd could not be found. Jun 22 10:25:50.825827 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: action_args: {'id': 'e1a65e9e-ffe1-4b75-87f0-e3fece9f23dd'} Jun 22 10:25:50.826871 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 10:25:50.826871 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:25:50.826871 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 22 10:25:50.826871 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 22 10:25:50.826871 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 22 10:25:50.826871 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 22 10:25:50.826871 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 22 10:25:50.826871 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 22 10:25:50.826871 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 22 10:25:50.826871 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 22 10:25:50.826871 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e1a65e9e-ffe1-4b75-87f0-e3fece9f23dd could not be found. Jun 22 10:25:50.826871 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi Jun 22 10:25:50.826871 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 10:25:50.826871 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi Jun 22 10:25:50.826871 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:25:50.826871 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 10:25:50.826871 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 10:25:50.826871 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 10:25:50.826871 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 10:25:50.826871 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 10:25:50.828485 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 10:25:50.828485 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 22 10:25:50.828485 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 22 10:25:50.828485 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 22 10:25:50.828485 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 22 10:25:50.828485 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 22 10:25:50.828485 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 22 10:25:50.828485 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e1a65e9e-ffe1-4b75-87f0-e3fece9f23dd could not be found. Jun 22 10:25:50.828485 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi Jun 22 10:25:50.828485 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 10:25:50.828485 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi Jun 22 10:25:50.828485 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:25:50.828485 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 10:25:50.828485 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 10:25:50.828485 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 10:25:50.828485 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 10:25:50.828485 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e1a65e9e-ffe1-4b75-87f0-e3fece9f23dd could not be found. Jun 22 10:25:50.828485 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi Jun 22 10:25:50.830025 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-47293382-2d50-4d8e-a56f-5c67807d159e tempest-VolumesSnapshotTestJSON-1146371521 tempest-VolumesSnapshotTestJSON-1146371521-project] Returning 404 to user: Instance e1a65e9e-ffe1-4b75-87f0-e3fece9f23dd could not be found. {{(pid=117874) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 10:25:50.830025 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [None req-47293382-2d50-4d8e-a56f-5c67807d159e tempest-VolumesSnapshotTestJSON-1146371521 tempest-VolumesSnapshotTestJSON-1146371521-project] 10.222.0.43 "GET /compute/v2.1/servers/e1a65e9e-ffe1-4b75-87f0-e3fece9f23dd" status: 404 len: 111 microversion: 2.1 time: 0.033031 Jun 22 10:25:50.830025 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 477/945] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:25:50 2022] GET /compute/v2.1/servers/e1a65e9e-ffe1-4b75-87f0-e3fece9f23dd => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 22 10:26:13.107717 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-80294892-cc5f-40f5-81ce-c4a1165677e3 tempest-TestShelveInstance-1869927250 tempest-TestShelveInstance-1869927250-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:26:13.108274 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.compute.api [None req-80294892-cc5f-40f5-81ce-c4a1165677e3 tempest-TestShelveInstance-1869927250 tempest-TestShelveInstance-1869927250-project] [instance: 46804c86-520a-407d-84a9-2f6d1ea1cff0] Fetching instance by UUID {{(pid=117873) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:26:13.110887 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG dbcounter [-] [117873] Writing DB stats nova_api:SELECT=13,nova_api:UPDATE=1 {{(pid=117873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:26:13.111543 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG dbcounter [-] [117873] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:26:13.117825 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-80294892-cc5f-40f5-81ce-c4a1165677e3 tempest-TestShelveInstance-1869927250 tempest-TestShelveInstance-1869927250-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:26:13.118279 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-80294892-cc5f-40f5-81ce-c4a1165677e3 tempest-TestShelveInstance-1869927250 tempest-TestShelveInstance-1869927250-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:26:13.119050 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-80294892-cc5f-40f5-81ce-c4a1165677e3 tempest-TestShelveInstance-1869927250 tempest-TestShelveInstance-1869927250-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:26:13.119793 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-80294892-cc5f-40f5-81ce-c4a1165677e3 tempest-TestShelveInstance-1869927250 tempest-TestShelveInstance-1869927250-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:26:13.144374 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.objects.instance [None req-80294892-cc5f-40f5-81ce-c4a1165677e3 tempest-TestShelveInstance-1869927250 tempest-TestShelveInstance-1869927250-project] Lazy-loading 'flavor' on Instance uuid 46804c86-520a-407d-84a9-2f6d1ea1cff0 {{(pid=117873) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 22 10:26:13.225308 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [None req-80294892-cc5f-40f5-81ce-c4a1165677e3 tempest-TestShelveInstance-1869927250 tempest-TestShelveInstance-1869927250-project] 10.222.0.43 "POST /compute/v2.1/servers/46804c86-520a-407d-84a9-2f6d1ea1cff0/action" status: 202 len: 0 microversion: 2.1 time: 0.121508 Jun 22 10:26:13.225866 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 469/946] 10.222.0.43 () {60 vars in 1277 bytes} [Wed Jun 22 10:26:13 2022] POST /compute/v2.1/servers/46804c86-520a-407d-84a9-2f6d1ea1cff0/action => generated 0 bytes in 124 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 22 10:26:13.236073 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-ab68bac8-2ff5-4391-8650-64618b1b7628 tempest-TestShelveInstance-1869927250 tempest-TestShelveInstance-1869927250-project] Calling method '>' {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:26:13.236707 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.compute.api [None req-ab68bac8-2ff5-4391-8650-64618b1b7628 tempest-TestShelveInstance-1869927250 tempest-TestShelveInstance-1869927250-project] [instance: 46804c86-520a-407d-84a9-2f6d1ea1cff0] Fetching instance by UUID {{(pid=117874) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:26:13.239298 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG dbcounter [-] [117874] Writing DB stats nova_api:SELECT=8 {{(pid=117874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:26:13.240058 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG dbcounter [-] [117874] Writing DB stats nova_cell1:SELECT=19,nova_cell1:INSERT=1 {{(pid=117874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:26:13.246782 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-ab68bac8-2ff5-4391-8650-64618b1b7628 tempest-TestShelveInstance-1869927250 tempest-TestShelveInstance-1869927250-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:26:13.247237 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-ab68bac8-2ff5-4391-8650-64618b1b7628 tempest-TestShelveInstance-1869927250 tempest-TestShelveInstance-1869927250-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:26:13.248014 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-ab68bac8-2ff5-4391-8650-64618b1b7628 tempest-TestShelveInstance-1869927250 tempest-TestShelveInstance-1869927250-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:26:13.248734 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-ab68bac8-2ff5-4391-8650-64618b1b7628 tempest-TestShelveInstance-1869927250 tempest-TestShelveInstance-1869927250-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:26:13.476105 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.policy [None req-ab68bac8-2ff5-4391-8650-64618b1b7628 tempest-TestShelveInstance-1869927250 tempest-TestShelveInstance-1869927250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6428e56cd9b46feb6a7b04e4d00c162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa9a1da5cb5a4279abb88ec7bdb1ef6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117874) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:26:13.483966 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [None req-ab68bac8-2ff5-4391-8650-64618b1b7628 tempest-TestShelveInstance-1869927250 tempest-TestShelveInstance-1869927250-project] 10.222.0.43 "GET /compute/v2.1/servers/46804c86-520a-407d-84a9-2f6d1ea1cff0" status: 200 len: 1568 microversion: 2.1 time: 0.253054 Jun 22 10:26:13.484540 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 478/947] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:26:13 2022] GET /compute/v2.1/servers/46804c86-520a-407d-84a9-2f6d1ea1cff0 => generated 1568 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:26:14.501286 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-a69225e5-959a-4410-aecf-72e632eef3b0 tempest-TestShelveInstance-1869927250 tempest-TestShelveInstance-1869927250-project] Calling method '>' {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:26:14.501956 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.compute.api [None req-a69225e5-959a-4410-aecf-72e632eef3b0 tempest-TestShelveInstance-1869927250 tempest-TestShelveInstance-1869927250-project] [instance: 46804c86-520a-407d-84a9-2f6d1ea1cff0] Fetching instance by UUID {{(pid=117873) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:26:14.508788 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-a69225e5-959a-4410-aecf-72e632eef3b0 tempest-TestShelveInstance-1869927250 tempest-TestShelveInstance-1869927250-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:26:14.509240 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-a69225e5-959a-4410-aecf-72e632eef3b0 tempest-TestShelveInstance-1869927250 tempest-TestShelveInstance-1869927250-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:26:14.510408 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-a69225e5-959a-4410-aecf-72e632eef3b0 tempest-TestShelveInstance-1869927250 tempest-TestShelveInstance-1869927250-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:26:14.510808 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-a69225e5-959a-4410-aecf-72e632eef3b0 tempest-TestShelveInstance-1869927250 tempest-TestShelveInstance-1869927250-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:26:14.649021 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.policy [None req-a69225e5-959a-4410-aecf-72e632eef3b0 tempest-TestShelveInstance-1869927250 tempest-TestShelveInstance-1869927250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6428e56cd9b46feb6a7b04e4d00c162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa9a1da5cb5a4279abb88ec7bdb1ef6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117873) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:26:14.657729 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [None req-a69225e5-959a-4410-aecf-72e632eef3b0 tempest-TestShelveInstance-1869927250 tempest-TestShelveInstance-1869927250-project] 10.222.0.43 "GET /compute/v2.1/servers/46804c86-520a-407d-84a9-2f6d1ea1cff0" status: 200 len: 1568 microversion: 2.1 time: 0.160653 Jun 22 10:26:14.658300 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 470/948] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:26:14 2022] GET /compute/v2.1/servers/46804c86-520a-407d-84a9-2f6d1ea1cff0 => generated 1568 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:26:15.675997 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-136d83b4-d9b0-42ce-9905-3dd039230012 tempest-TestShelveInstance-1869927250 tempest-TestShelveInstance-1869927250-project] Calling method '>' {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:26:15.676619 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.compute.api [None req-136d83b4-d9b0-42ce-9905-3dd039230012 tempest-TestShelveInstance-1869927250 tempest-TestShelveInstance-1869927250-project] [instance: 46804c86-520a-407d-84a9-2f6d1ea1cff0] Fetching instance by UUID {{(pid=117874) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:26:15.682848 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-136d83b4-d9b0-42ce-9905-3dd039230012 tempest-TestShelveInstance-1869927250 tempest-TestShelveInstance-1869927250-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:26:15.683292 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-136d83b4-d9b0-42ce-9905-3dd039230012 tempest-TestShelveInstance-1869927250 tempest-TestShelveInstance-1869927250-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:26:15.684056 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-136d83b4-d9b0-42ce-9905-3dd039230012 tempest-TestShelveInstance-1869927250 tempest-TestShelveInstance-1869927250-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:26:15.684672 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-136d83b4-d9b0-42ce-9905-3dd039230012 tempest-TestShelveInstance-1869927250 tempest-TestShelveInstance-1869927250-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:26:15.912438 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.policy [None req-136d83b4-d9b0-42ce-9905-3dd039230012 tempest-TestShelveInstance-1869927250 tempest-TestShelveInstance-1869927250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6428e56cd9b46feb6a7b04e4d00c162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa9a1da5cb5a4279abb88ec7bdb1ef6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117874) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:26:15.925304 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [None req-136d83b4-d9b0-42ce-9905-3dd039230012 tempest-TestShelveInstance-1869927250 tempest-TestShelveInstance-1869927250-project] 10.222.0.43 "GET /compute/v2.1/servers/46804c86-520a-407d-84a9-2f6d1ea1cff0" status: 200 len: 1568 microversion: 2.1 time: 0.253489 Jun 22 10:26:15.935981 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 479/949] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:26:15 2022] GET /compute/v2.1/servers/46804c86-520a-407d-84a9-2f6d1ea1cff0 => generated 1568 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:26:16.944571 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-df44c99e-ccce-47ca-9b9d-ccf67346a144 tempest-TestShelveInstance-1869927250 tempest-TestShelveInstance-1869927250-project] Calling method '>' {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:26:16.945942 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.compute.api [None req-df44c99e-ccce-47ca-9b9d-ccf67346a144 tempest-TestShelveInstance-1869927250 tempest-TestShelveInstance-1869927250-project] [instance: 46804c86-520a-407d-84a9-2f6d1ea1cff0] Fetching instance by UUID {{(pid=117873) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:26:16.952527 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-df44c99e-ccce-47ca-9b9d-ccf67346a144 tempest-TestShelveInstance-1869927250 tempest-TestShelveInstance-1869927250-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:26:16.953055 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-df44c99e-ccce-47ca-9b9d-ccf67346a144 tempest-TestShelveInstance-1869927250 tempest-TestShelveInstance-1869927250-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:26:16.954775 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-df44c99e-ccce-47ca-9b9d-ccf67346a144 tempest-TestShelveInstance-1869927250 tempest-TestShelveInstance-1869927250-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:26:16.955424 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-df44c99e-ccce-47ca-9b9d-ccf67346a144 tempest-TestShelveInstance-1869927250 tempest-TestShelveInstance-1869927250-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:26:17.159910 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.policy [None req-df44c99e-ccce-47ca-9b9d-ccf67346a144 tempest-TestShelveInstance-1869927250 tempest-TestShelveInstance-1869927250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6428e56cd9b46feb6a7b04e4d00c162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa9a1da5cb5a4279abb88ec7bdb1ef6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117873) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:26:17.176711 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [None req-df44c99e-ccce-47ca-9b9d-ccf67346a144 tempest-TestShelveInstance-1869927250 tempest-TestShelveInstance-1869927250-project] 10.222.0.43 "GET /compute/v2.1/servers/46804c86-520a-407d-84a9-2f6d1ea1cff0" status: 200 len: 1568 microversion: 2.1 time: 0.236095 Jun 22 10:26:17.186359 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 471/950] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:26:16 2022] GET /compute/v2.1/servers/46804c86-520a-407d-84a9-2f6d1ea1cff0 => generated 1568 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:26:18.203683 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-61d09c28-2d63-4f38-b3eb-2db17458df37 tempest-TestShelveInstance-1869927250 tempest-TestShelveInstance-1869927250-project] Calling method '>' {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:26:18.204316 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.compute.api [None req-61d09c28-2d63-4f38-b3eb-2db17458df37 tempest-TestShelveInstance-1869927250 tempest-TestShelveInstance-1869927250-project] [instance: 46804c86-520a-407d-84a9-2f6d1ea1cff0] Fetching instance by UUID {{(pid=117874) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:26:18.223726 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-61d09c28-2d63-4f38-b3eb-2db17458df37 tempest-TestShelveInstance-1869927250 tempest-TestShelveInstance-1869927250-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:26:18.224689 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-61d09c28-2d63-4f38-b3eb-2db17458df37 tempest-TestShelveInstance-1869927250 tempest-TestShelveInstance-1869927250-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:26:18.225479 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-61d09c28-2d63-4f38-b3eb-2db17458df37 tempest-TestShelveInstance-1869927250 tempest-TestShelveInstance-1869927250-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:26:18.225949 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-61d09c28-2d63-4f38-b3eb-2db17458df37 tempest-TestShelveInstance-1869927250 tempest-TestShelveInstance-1869927250-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:26:18.381542 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.policy [None req-61d09c28-2d63-4f38-b3eb-2db17458df37 tempest-TestShelveInstance-1869927250 tempest-TestShelveInstance-1869927250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6428e56cd9b46feb6a7b04e4d00c162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa9a1da5cb5a4279abb88ec7bdb1ef6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117874) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:26:18.389969 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [None req-61d09c28-2d63-4f38-b3eb-2db17458df37 tempest-TestShelveInstance-1869927250 tempest-TestShelveInstance-1869927250-project] 10.222.0.43 "GET /compute/v2.1/servers/46804c86-520a-407d-84a9-2f6d1ea1cff0" status: 200 len: 1568 microversion: 2.1 time: 0.190227 Jun 22 10:26:18.390540 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 480/951] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:26:18 2022] GET /compute/v2.1/servers/46804c86-520a-407d-84a9-2f6d1ea1cff0 => generated 1568 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 10:26:18.971778 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 22 10:26:18.972407 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: Wed Jun 22 10:26:18 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 22 10:26:19.407190 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-3211863e-59a6-4aa5-a31d-75bae2ce9583 tempest-TestShelveInstance-1869927250 tempest-TestShelveInstance-1869927250-project] Calling method '>' {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:26:19.407796 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.compute.api [None req-3211863e-59a6-4aa5-a31d-75bae2ce9583 tempest-TestShelveInstance-1869927250 tempest-TestShelveInstance-1869927250-project] [instance: 46804c86-520a-407d-84a9-2f6d1ea1cff0] Fetching instance by UUID {{(pid=117873) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:26:19.413787 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-3211863e-59a6-4aa5-a31d-75bae2ce9583 tempest-TestShelveInstance-1869927250 tempest-TestShelveInstance-1869927250-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:26:19.414238 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-3211863e-59a6-4aa5-a31d-75bae2ce9583 tempest-TestShelveInstance-1869927250 tempest-TestShelveInstance-1869927250-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:26:19.414996 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-3211863e-59a6-4aa5-a31d-75bae2ce9583 tempest-TestShelveInstance-1869927250 tempest-TestShelveInstance-1869927250-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:26:19.415430 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-3211863e-59a6-4aa5-a31d-75bae2ce9583 tempest-TestShelveInstance-1869927250 tempest-TestShelveInstance-1869927250-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:26:19.555089 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.policy [None req-3211863e-59a6-4aa5-a31d-75bae2ce9583 tempest-TestShelveInstance-1869927250 tempest-TestShelveInstance-1869927250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6428e56cd9b46feb6a7b04e4d00c162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa9a1da5cb5a4279abb88ec7bdb1ef6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117873) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:26:19.563713 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [None req-3211863e-59a6-4aa5-a31d-75bae2ce9583 tempest-TestShelveInstance-1869927250 tempest-TestShelveInstance-1869927250-project] 10.222.0.43 "GET /compute/v2.1/servers/46804c86-520a-407d-84a9-2f6d1ea1cff0" status: 200 len: 1568 microversion: 2.1 time: 0.160396 Jun 22 10:26:19.564245 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 472/952] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:26:19 2022] GET /compute/v2.1/servers/46804c86-520a-407d-84a9-2f6d1ea1cff0 => generated 1568 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:26:20.580344 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-1a5ba94b-7639-4546-bf85-90ca364e6cf8 tempest-TestShelveInstance-1869927250 tempest-TestShelveInstance-1869927250-project] Calling method '>' {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:26:20.580949 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.compute.api [None req-1a5ba94b-7639-4546-bf85-90ca364e6cf8 tempest-TestShelveInstance-1869927250 tempest-TestShelveInstance-1869927250-project] [instance: 46804c86-520a-407d-84a9-2f6d1ea1cff0] Fetching instance by UUID {{(pid=117874) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:26:20.587616 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-1a5ba94b-7639-4546-bf85-90ca364e6cf8 tempest-TestShelveInstance-1869927250 tempest-TestShelveInstance-1869927250-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:26:20.588274 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-1a5ba94b-7639-4546-bf85-90ca364e6cf8 tempest-TestShelveInstance-1869927250 tempest-TestShelveInstance-1869927250-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:26:20.589110 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-1a5ba94b-7639-4546-bf85-90ca364e6cf8 tempest-TestShelveInstance-1869927250 tempest-TestShelveInstance-1869927250-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:26:20.589738 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-1a5ba94b-7639-4546-bf85-90ca364e6cf8 tempest-TestShelveInstance-1869927250 tempest-TestShelveInstance-1869927250-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:26:20.790970 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.policy [None req-1a5ba94b-7639-4546-bf85-90ca364e6cf8 tempest-TestShelveInstance-1869927250 tempest-TestShelveInstance-1869927250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6428e56cd9b46feb6a7b04e4d00c162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa9a1da5cb5a4279abb88ec7bdb1ef6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117874) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:26:20.801573 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [None req-1a5ba94b-7639-4546-bf85-90ca364e6cf8 tempest-TestShelveInstance-1869927250 tempest-TestShelveInstance-1869927250-project] 10.222.0.43 "GET /compute/v2.1/servers/46804c86-520a-407d-84a9-2f6d1ea1cff0" status: 200 len: 1568 microversion: 2.1 time: 0.224435 Jun 22 10:26:20.812495 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 481/953] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:26:20 2022] GET /compute/v2.1/servers/46804c86-520a-407d-84a9-2f6d1ea1cff0 => generated 1568 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:26:21.819755 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-ab3a02d2-8c6f-4dfe-a51c-d15ccc4fbedd tempest-TestShelveInstance-1869927250 tempest-TestShelveInstance-1869927250-project] Calling method '>' {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:26:21.820965 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.compute.api [None req-ab3a02d2-8c6f-4dfe-a51c-d15ccc4fbedd tempest-TestShelveInstance-1869927250 tempest-TestShelveInstance-1869927250-project] [instance: 46804c86-520a-407d-84a9-2f6d1ea1cff0] Fetching instance by UUID {{(pid=117873) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:26:21.831523 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-ab3a02d2-8c6f-4dfe-a51c-d15ccc4fbedd tempest-TestShelveInstance-1869927250 tempest-TestShelveInstance-1869927250-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:26:21.834304 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-ab3a02d2-8c6f-4dfe-a51c-d15ccc4fbedd tempest-TestShelveInstance-1869927250 tempest-TestShelveInstance-1869927250-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:26:21.835117 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-ab3a02d2-8c6f-4dfe-a51c-d15ccc4fbedd tempest-TestShelveInstance-1869927250 tempest-TestShelveInstance-1869927250-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:26:21.835621 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-ab3a02d2-8c6f-4dfe-a51c-d15ccc4fbedd tempest-TestShelveInstance-1869927250 tempest-TestShelveInstance-1869927250-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:26:22.151643 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.policy [None req-ab3a02d2-8c6f-4dfe-a51c-d15ccc4fbedd tempest-TestShelveInstance-1869927250 tempest-TestShelveInstance-1869927250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6428e56cd9b46feb6a7b04e4d00c162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa9a1da5cb5a4279abb88ec7bdb1ef6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117873) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:26:22.165442 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [None req-ab3a02d2-8c6f-4dfe-a51c-d15ccc4fbedd tempest-TestShelveInstance-1869927250 tempest-TestShelveInstance-1869927250-project] 10.222.0.43 "GET /compute/v2.1/servers/46804c86-520a-407d-84a9-2f6d1ea1cff0" status: 200 len: 1568 microversion: 2.1 time: 0.349687 Jun 22 10:26:22.167173 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 473/954] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:26:21 2022] GET /compute/v2.1/servers/46804c86-520a-407d-84a9-2f6d1ea1cff0 => generated 1568 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:26:23.185559 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-23f47403-334c-40f1-b8f3-89523f6920e8 tempest-TestShelveInstance-1869927250 tempest-TestShelveInstance-1869927250-project] Calling method '>' {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:26:23.187098 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.compute.api [None req-23f47403-334c-40f1-b8f3-89523f6920e8 tempest-TestShelveInstance-1869927250 tempest-TestShelveInstance-1869927250-project] [instance: 46804c86-520a-407d-84a9-2f6d1ea1cff0] Fetching instance by UUID {{(pid=117874) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:26:23.203557 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-23f47403-334c-40f1-b8f3-89523f6920e8 tempest-TestShelveInstance-1869927250 tempest-TestShelveInstance-1869927250-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:26:23.204012 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-23f47403-334c-40f1-b8f3-89523f6920e8 tempest-TestShelveInstance-1869927250 tempest-TestShelveInstance-1869927250-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:26:23.209118 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-23f47403-334c-40f1-b8f3-89523f6920e8 tempest-TestShelveInstance-1869927250 tempest-TestShelveInstance-1869927250-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:26:23.209840 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-23f47403-334c-40f1-b8f3-89523f6920e8 tempest-TestShelveInstance-1869927250 tempest-TestShelveInstance-1869927250-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:26:23.651324 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.policy [None req-23f47403-334c-40f1-b8f3-89523f6920e8 tempest-TestShelveInstance-1869927250 tempest-TestShelveInstance-1869927250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6428e56cd9b46feb6a7b04e4d00c162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa9a1da5cb5a4279abb88ec7bdb1ef6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117874) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:26:23.661014 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [None req-23f47403-334c-40f1-b8f3-89523f6920e8 tempest-TestShelveInstance-1869927250 tempest-TestShelveInstance-1869927250-project] 10.222.0.43 "GET /compute/v2.1/servers/46804c86-520a-407d-84a9-2f6d1ea1cff0" status: 200 len: 1568 microversion: 2.1 time: 0.480845 Jun 22 10:26:23.665076 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 482/955] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:26:23 2022] GET /compute/v2.1/servers/46804c86-520a-407d-84a9-2f6d1ea1cff0 => generated 1568 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:26:24.680534 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-c9ee3891-1675-4787-b015-6be2f6be73c2 tempest-TestShelveInstance-1869927250 tempest-TestShelveInstance-1869927250-project] Calling method '>' {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:26:24.681176 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.compute.api [None req-c9ee3891-1675-4787-b015-6be2f6be73c2 tempest-TestShelveInstance-1869927250 tempest-TestShelveInstance-1869927250-project] [instance: 46804c86-520a-407d-84a9-2f6d1ea1cff0] Fetching instance by UUID {{(pid=117873) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:26:24.693093 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-c9ee3891-1675-4787-b015-6be2f6be73c2 tempest-TestShelveInstance-1869927250 tempest-TestShelveInstance-1869927250-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:26:24.693765 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-c9ee3891-1675-4787-b015-6be2f6be73c2 tempest-TestShelveInstance-1869927250 tempest-TestShelveInstance-1869927250-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:26:24.694849 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-c9ee3891-1675-4787-b015-6be2f6be73c2 tempest-TestShelveInstance-1869927250 tempest-TestShelveInstance-1869927250-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:26:24.695295 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-c9ee3891-1675-4787-b015-6be2f6be73c2 tempest-TestShelveInstance-1869927250 tempest-TestShelveInstance-1869927250-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:26:24.873405 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.policy [None req-c9ee3891-1675-4787-b015-6be2f6be73c2 tempest-TestShelveInstance-1869927250 tempest-TestShelveInstance-1869927250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6428e56cd9b46feb6a7b04e4d00c162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa9a1da5cb5a4279abb88ec7bdb1ef6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117873) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:26:24.883386 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [None req-c9ee3891-1675-4787-b015-6be2f6be73c2 tempest-TestShelveInstance-1869927250 tempest-TestShelveInstance-1869927250-project] 10.222.0.43 "GET /compute/v2.1/servers/46804c86-520a-407d-84a9-2f6d1ea1cff0" status: 200 len: 1568 microversion: 2.1 time: 0.206527 Jun 22 10:26:24.883868 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 474/956] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:26:24 2022] GET /compute/v2.1/servers/46804c86-520a-407d-84a9-2f6d1ea1cff0 => generated 1568 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:26:25.902449 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-4e270a46-8050-4242-bdeb-0c1785dec7e7 tempest-TestShelveInstance-1869927250 tempest-TestShelveInstance-1869927250-project] Calling method '>' {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:26:25.903377 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.compute.api [None req-4e270a46-8050-4242-bdeb-0c1785dec7e7 tempest-TestShelveInstance-1869927250 tempest-TestShelveInstance-1869927250-project] [instance: 46804c86-520a-407d-84a9-2f6d1ea1cff0] Fetching instance by UUID {{(pid=117874) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:26:25.925762 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-4e270a46-8050-4242-bdeb-0c1785dec7e7 tempest-TestShelveInstance-1869927250 tempest-TestShelveInstance-1869927250-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:26:25.926561 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-4e270a46-8050-4242-bdeb-0c1785dec7e7 tempest-TestShelveInstance-1869927250 tempest-TestShelveInstance-1869927250-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:26:25.928362 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-4e270a46-8050-4242-bdeb-0c1785dec7e7 tempest-TestShelveInstance-1869927250 tempest-TestShelveInstance-1869927250-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:26:25.933079 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-4e270a46-8050-4242-bdeb-0c1785dec7e7 tempest-TestShelveInstance-1869927250 tempest-TestShelveInstance-1869927250-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:26:26.156132 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.policy [None req-4e270a46-8050-4242-bdeb-0c1785dec7e7 tempest-TestShelveInstance-1869927250 tempest-TestShelveInstance-1869927250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6428e56cd9b46feb6a7b04e4d00c162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa9a1da5cb5a4279abb88ec7bdb1ef6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117874) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:26:26.164798 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [None req-4e270a46-8050-4242-bdeb-0c1785dec7e7 tempest-TestShelveInstance-1869927250 tempest-TestShelveInstance-1869927250-project] 10.222.0.43 "GET /compute/v2.1/servers/46804c86-520a-407d-84a9-2f6d1ea1cff0" status: 200 len: 1568 microversion: 2.1 time: 0.267587 Jun 22 10:26:26.168357 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 483/957] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:26:25 2022] GET /compute/v2.1/servers/46804c86-520a-407d-84a9-2f6d1ea1cff0 => generated 1568 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:26:27.184777 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-75475e0d-d1c0-4a7e-9fa4-604660f445c7 tempest-TestShelveInstance-1869927250 tempest-TestShelveInstance-1869927250-project] Calling method '>' {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:26:27.185496 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.compute.api [None req-75475e0d-d1c0-4a7e-9fa4-604660f445c7 tempest-TestShelveInstance-1869927250 tempest-TestShelveInstance-1869927250-project] [instance: 46804c86-520a-407d-84a9-2f6d1ea1cff0] Fetching instance by UUID {{(pid=117873) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:26:27.208897 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-75475e0d-d1c0-4a7e-9fa4-604660f445c7 tempest-TestShelveInstance-1869927250 tempest-TestShelveInstance-1869927250-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:26:27.209376 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-75475e0d-d1c0-4a7e-9fa4-604660f445c7 tempest-TestShelveInstance-1869927250 tempest-TestShelveInstance-1869927250-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:26:27.210260 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-75475e0d-d1c0-4a7e-9fa4-604660f445c7 tempest-TestShelveInstance-1869927250 tempest-TestShelveInstance-1869927250-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:26:27.210758 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-75475e0d-d1c0-4a7e-9fa4-604660f445c7 tempest-TestShelveInstance-1869927250 tempest-TestShelveInstance-1869927250-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:26:27.433831 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.policy [None req-75475e0d-d1c0-4a7e-9fa4-604660f445c7 tempest-TestShelveInstance-1869927250 tempest-TestShelveInstance-1869927250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6428e56cd9b46feb6a7b04e4d00c162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa9a1da5cb5a4279abb88ec7bdb1ef6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117873) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:26:27.455187 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [None req-75475e0d-d1c0-4a7e-9fa4-604660f445c7 tempest-TestShelveInstance-1869927250 tempest-TestShelveInstance-1869927250-project] 10.222.0.43 "GET /compute/v2.1/servers/46804c86-520a-407d-84a9-2f6d1ea1cff0" status: 200 len: 1509 microversion: 2.1 time: 0.275409 Jun 22 10:26:27.456120 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 475/958] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:26:27 2022] GET /compute/v2.1/servers/46804c86-520a-407d-84a9-2f6d1ea1cff0 => generated 1509 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 10:26:27.474155 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-605eea9f-9750-4f9d-8b3f-c76df66df009 tempest-TestShelveInstance-1869927250 tempest-TestShelveInstance-1869927250-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:26:27.475059 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.compute.api [None req-605eea9f-9750-4f9d-8b3f-c76df66df009 tempest-TestShelveInstance-1869927250 tempest-TestShelveInstance-1869927250-project] [instance: 46804c86-520a-407d-84a9-2f6d1ea1cff0] Fetching instance by UUID {{(pid=117874) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:26:27.488953 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-605eea9f-9750-4f9d-8b3f-c76df66df009 tempest-TestShelveInstance-1869927250 tempest-TestShelveInstance-1869927250-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:26:27.496628 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-605eea9f-9750-4f9d-8b3f-c76df66df009 tempest-TestShelveInstance-1869927250 tempest-TestShelveInstance-1869927250-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:26:27.497767 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-605eea9f-9750-4f9d-8b3f-c76df66df009 tempest-TestShelveInstance-1869927250 tempest-TestShelveInstance-1869927250-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:26:27.498449 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-605eea9f-9750-4f9d-8b3f-c76df66df009 tempest-TestShelveInstance-1869927250 tempest-TestShelveInstance-1869927250-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:26:27.624451 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [None req-605eea9f-9750-4f9d-8b3f-c76df66df009 tempest-TestShelveInstance-1869927250 tempest-TestShelveInstance-1869927250-project] 10.222.0.43 "POST /compute/v2.1/servers/46804c86-520a-407d-84a9-2f6d1ea1cff0/action" status: 202 len: 0 microversion: 2.1 time: 0.154407 Jun 22 10:26:27.626379 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 484/959] 10.222.0.43 () {60 vars in 1277 bytes} [Wed Jun 22 10:26:27 2022] POST /compute/v2.1/servers/46804c86-520a-407d-84a9-2f6d1ea1cff0/action => generated 0 bytes in 157 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 22 10:26:27.635537 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-ae655e16-2068-43fe-8d22-901ab5ec667a tempest-TestShelveInstance-1869927250 tempest-TestShelveInstance-1869927250-project] Calling method '>' {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:26:27.636568 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.compute.api [None req-ae655e16-2068-43fe-8d22-901ab5ec667a tempest-TestShelveInstance-1869927250 tempest-TestShelveInstance-1869927250-project] [instance: 46804c86-520a-407d-84a9-2f6d1ea1cff0] Fetching instance by UUID {{(pid=117873) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:26:27.645083 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-ae655e16-2068-43fe-8d22-901ab5ec667a tempest-TestShelveInstance-1869927250 tempest-TestShelveInstance-1869927250-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:26:27.645578 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-ae655e16-2068-43fe-8d22-901ab5ec667a tempest-TestShelveInstance-1869927250 tempest-TestShelveInstance-1869927250-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:26:27.646393 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-ae655e16-2068-43fe-8d22-901ab5ec667a tempest-TestShelveInstance-1869927250 tempest-TestShelveInstance-1869927250-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:26:27.646834 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-ae655e16-2068-43fe-8d22-901ab5ec667a tempest-TestShelveInstance-1869927250 tempest-TestShelveInstance-1869927250-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:26:27.905341 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.policy [None req-ae655e16-2068-43fe-8d22-901ab5ec667a tempest-TestShelveInstance-1869927250 tempest-TestShelveInstance-1869927250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6428e56cd9b46feb6a7b04e4d00c162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa9a1da5cb5a4279abb88ec7bdb1ef6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117873) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:26:27.923430 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [None req-ae655e16-2068-43fe-8d22-901ab5ec667a tempest-TestShelveInstance-1869927250 tempest-TestShelveInstance-1869927250-project] 10.222.0.43 "GET /compute/v2.1/servers/46804c86-520a-407d-84a9-2f6d1ea1cff0" status: 200 len: 1517 microversion: 2.1 time: 0.293040 Jun 22 10:26:27.930410 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 476/960] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:26:27 2022] GET /compute/v2.1/servers/46804c86-520a-407d-84a9-2f6d1ea1cff0 => generated 1517 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:26:28.419682 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [req-0264b6c1-5b2d-40f1-b9f2-53fc979cae95 req-4684edb0-7682-4674-a378-22e543b48ddc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "46804c86-520a-407d-84a9-2f6d1ea1cff0", "name": "network-vif-unplugged", "status": "completed", "tag": "377da38d-a656-43c8-babd-6b00935ec9f5"}]} {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:26:28.433207 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [req-0264b6c1-5b2d-40f1-b9f2-53fc979cae95 req-4684edb0-7682-4674-a378-22e543b48ddc service nova] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:26:28.434023 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [req-0264b6c1-5b2d-40f1-b9f2-53fc979cae95 req-4684edb0-7682-4674-a378-22e543b48ddc service nova] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:26:28.450317 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.compute.server_external_events [req-0264b6c1-5b2d-40f1-b9f2-53fc979cae95 req-4684edb0-7682-4674-a378-22e543b48ddc service nova] Unable to find a host for instance 46804c86-520a-407d-84a9-2f6d1ea1cff0. Dropping event network-vif-unplugged {{(pid=117874) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jun 22 10:26:28.451595 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [req-0264b6c1-5b2d-40f1-b9f2-53fc979cae95 req-4684edb0-7682-4674-a378-22e543b48ddc service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.038984 Jun 22 10:26:28.453251 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 485/961] 10.222.0.43 () {64 vars in 1317 bytes} [Wed Jun 22 10:26:28 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 41 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Jun 22 10:26:28.950203 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-9a6dd987-c283-4a51-970c-1982de8b1686 tempest-TestShelveInstance-1869927250 tempest-TestShelveInstance-1869927250-project] Calling method '>' {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:26:28.951516 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.compute.api [None req-9a6dd987-c283-4a51-970c-1982de8b1686 tempest-TestShelveInstance-1869927250 tempest-TestShelveInstance-1869927250-project] [instance: 46804c86-520a-407d-84a9-2f6d1ea1cff0] Fetching instance by UUID {{(pid=117873) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:26:28.958746 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-9a6dd987-c283-4a51-970c-1982de8b1686 tempest-TestShelveInstance-1869927250 tempest-TestShelveInstance-1869927250-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:26:28.959421 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-9a6dd987-c283-4a51-970c-1982de8b1686 tempest-TestShelveInstance-1869927250 tempest-TestShelveInstance-1869927250-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:26:28.960378 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-9a6dd987-c283-4a51-970c-1982de8b1686 tempest-TestShelveInstance-1869927250 tempest-TestShelveInstance-1869927250-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:26:28.960811 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-9a6dd987-c283-4a51-970c-1982de8b1686 tempest-TestShelveInstance-1869927250 tempest-TestShelveInstance-1869927250-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:26:29.134104 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.policy [None req-9a6dd987-c283-4a51-970c-1982de8b1686 tempest-TestShelveInstance-1869927250 tempest-TestShelveInstance-1869927250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6428e56cd9b46feb6a7b04e4d00c162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa9a1da5cb5a4279abb88ec7bdb1ef6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117873) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:26:29.143301 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [None req-9a6dd987-c283-4a51-970c-1982de8b1686 tempest-TestShelveInstance-1869927250 tempest-TestShelveInstance-1869927250-project] 10.222.0.43 "GET /compute/v2.1/servers/46804c86-520a-407d-84a9-2f6d1ea1cff0" status: 200 len: 1519 microversion: 2.1 time: 0.199569 Jun 22 10:26:29.143938 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 477/962] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:26:28 2022] GET /compute/v2.1/servers/46804c86-520a-407d-84a9-2f6d1ea1cff0 => generated 1519 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:26:30.164356 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-76cbb2a6-e142-41aa-a1f4-9753d9128346 tempest-TestShelveInstance-1869927250 tempest-TestShelveInstance-1869927250-project] Calling method '>' {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:26:30.165053 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.compute.api [None req-76cbb2a6-e142-41aa-a1f4-9753d9128346 tempest-TestShelveInstance-1869927250 tempest-TestShelveInstance-1869927250-project] [instance: 46804c86-520a-407d-84a9-2f6d1ea1cff0] Fetching instance by UUID {{(pid=117874) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:26:30.192669 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-76cbb2a6-e142-41aa-a1f4-9753d9128346 tempest-TestShelveInstance-1869927250 tempest-TestShelveInstance-1869927250-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:26:30.193994 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-76cbb2a6-e142-41aa-a1f4-9753d9128346 tempest-TestShelveInstance-1869927250 tempest-TestShelveInstance-1869927250-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:26:30.194887 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-76cbb2a6-e142-41aa-a1f4-9753d9128346 tempest-TestShelveInstance-1869927250 tempest-TestShelveInstance-1869927250-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:26:30.195403 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-76cbb2a6-e142-41aa-a1f4-9753d9128346 tempest-TestShelveInstance-1869927250 tempest-TestShelveInstance-1869927250-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:26:30.389028 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.policy [None req-76cbb2a6-e142-41aa-a1f4-9753d9128346 tempest-TestShelveInstance-1869927250 tempest-TestShelveInstance-1869927250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6428e56cd9b46feb6a7b04e4d00c162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa9a1da5cb5a4279abb88ec7bdb1ef6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117874) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:26:30.397757 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [None req-76cbb2a6-e142-41aa-a1f4-9753d9128346 tempest-TestShelveInstance-1869927250 tempest-TestShelveInstance-1869927250-project] 10.222.0.43 "GET /compute/v2.1/servers/46804c86-520a-407d-84a9-2f6d1ea1cff0" status: 200 len: 1575 microversion: 2.1 time: 0.240072 Jun 22 10:26:30.398694 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 486/963] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:26:30 2022] GET /compute/v2.1/servers/46804c86-520a-407d-84a9-2f6d1ea1cff0 => generated 1575 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:26:31.415875 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-88c206b5-c03c-4e66-9521-5b1ff8c48245 tempest-TestShelveInstance-1869927250 tempest-TestShelveInstance-1869927250-project] Calling method '>' {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:26:31.416568 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.compute.api [None req-88c206b5-c03c-4e66-9521-5b1ff8c48245 tempest-TestShelveInstance-1869927250 tempest-TestShelveInstance-1869927250-project] [instance: 46804c86-520a-407d-84a9-2f6d1ea1cff0] Fetching instance by UUID {{(pid=117873) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:26:31.424198 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-88c206b5-c03c-4e66-9521-5b1ff8c48245 tempest-TestShelveInstance-1869927250 tempest-TestShelveInstance-1869927250-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:26:31.424409 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-88c206b5-c03c-4e66-9521-5b1ff8c48245 tempest-TestShelveInstance-1869927250 tempest-TestShelveInstance-1869927250-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:26:31.425035 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-88c206b5-c03c-4e66-9521-5b1ff8c48245 tempest-TestShelveInstance-1869927250 tempest-TestShelveInstance-1869927250-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:26:31.425479 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-88c206b5-c03c-4e66-9521-5b1ff8c48245 tempest-TestShelveInstance-1869927250 tempest-TestShelveInstance-1869927250-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:26:31.576097 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.policy [None req-88c206b5-c03c-4e66-9521-5b1ff8c48245 tempest-TestShelveInstance-1869927250 tempest-TestShelveInstance-1869927250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6428e56cd9b46feb6a7b04e4d00c162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa9a1da5cb5a4279abb88ec7bdb1ef6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117873) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:26:31.583905 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [None req-88c206b5-c03c-4e66-9521-5b1ff8c48245 tempest-TestShelveInstance-1869927250 tempest-TestShelveInstance-1869927250-project] 10.222.0.43 "GET /compute/v2.1/servers/46804c86-520a-407d-84a9-2f6d1ea1cff0" status: 200 len: 1575 microversion: 2.1 time: 0.172566 Jun 22 10:26:31.584487 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 478/964] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:26:31 2022] GET /compute/v2.1/servers/46804c86-520a-407d-84a9-2f6d1ea1cff0 => generated 1575 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:26:32.601857 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-75930aee-8797-47a3-bc13-004dc8769ac9 tempest-TestShelveInstance-1869927250 tempest-TestShelveInstance-1869927250-project] Calling method '>' {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:26:32.603380 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.compute.api [None req-75930aee-8797-47a3-bc13-004dc8769ac9 tempest-TestShelveInstance-1869927250 tempest-TestShelveInstance-1869927250-project] [instance: 46804c86-520a-407d-84a9-2f6d1ea1cff0] Fetching instance by UUID {{(pid=117874) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:26:32.610335 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-75930aee-8797-47a3-bc13-004dc8769ac9 tempest-TestShelveInstance-1869927250 tempest-TestShelveInstance-1869927250-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:26:32.611038 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-75930aee-8797-47a3-bc13-004dc8769ac9 tempest-TestShelveInstance-1869927250 tempest-TestShelveInstance-1869927250-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:26:32.612024 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-75930aee-8797-47a3-bc13-004dc8769ac9 tempest-TestShelveInstance-1869927250 tempest-TestShelveInstance-1869927250-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:26:32.612555 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-75930aee-8797-47a3-bc13-004dc8769ac9 tempest-TestShelveInstance-1869927250 tempest-TestShelveInstance-1869927250-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:26:32.768089 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.policy [None req-75930aee-8797-47a3-bc13-004dc8769ac9 tempest-TestShelveInstance-1869927250 tempest-TestShelveInstance-1869927250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6428e56cd9b46feb6a7b04e4d00c162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa9a1da5cb5a4279abb88ec7bdb1ef6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117874) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:26:32.778426 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [None req-75930aee-8797-47a3-bc13-004dc8769ac9 tempest-TestShelveInstance-1869927250 tempest-TestShelveInstance-1869927250-project] 10.222.0.43 "GET /compute/v2.1/servers/46804c86-520a-407d-84a9-2f6d1ea1cff0" status: 200 len: 1575 microversion: 2.1 time: 0.180604 Jun 22 10:26:32.779301 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 487/965] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:26:32 2022] GET /compute/v2.1/servers/46804c86-520a-407d-84a9-2f6d1ea1cff0 => generated 1575 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:26:33.796559 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-b4d66b74-8450-4aed-9395-e6ca9ab717d0 tempest-TestShelveInstance-1869927250 tempest-TestShelveInstance-1869927250-project] Calling method '>' {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:26:33.797474 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.compute.api [None req-b4d66b74-8450-4aed-9395-e6ca9ab717d0 tempest-TestShelveInstance-1869927250 tempest-TestShelveInstance-1869927250-project] [instance: 46804c86-520a-407d-84a9-2f6d1ea1cff0] Fetching instance by UUID {{(pid=117873) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:26:33.804515 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-b4d66b74-8450-4aed-9395-e6ca9ab717d0 tempest-TestShelveInstance-1869927250 tempest-TestShelveInstance-1869927250-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:26:33.804965 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-b4d66b74-8450-4aed-9395-e6ca9ab717d0 tempest-TestShelveInstance-1869927250 tempest-TestShelveInstance-1869927250-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:26:33.805790 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-b4d66b74-8450-4aed-9395-e6ca9ab717d0 tempest-TestShelveInstance-1869927250 tempest-TestShelveInstance-1869927250-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:26:33.806292 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-b4d66b74-8450-4aed-9395-e6ca9ab717d0 tempest-TestShelveInstance-1869927250 tempest-TestShelveInstance-1869927250-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:26:34.000994 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.policy [None req-b4d66b74-8450-4aed-9395-e6ca9ab717d0 tempest-TestShelveInstance-1869927250 tempest-TestShelveInstance-1869927250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6428e56cd9b46feb6a7b04e4d00c162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa9a1da5cb5a4279abb88ec7bdb1ef6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117873) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:26:34.010659 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [None req-b4d66b74-8450-4aed-9395-e6ca9ab717d0 tempest-TestShelveInstance-1869927250 tempest-TestShelveInstance-1869927250-project] 10.222.0.43 "GET /compute/v2.1/servers/46804c86-520a-407d-84a9-2f6d1ea1cff0" status: 200 len: 1575 microversion: 2.1 time: 0.218049 Jun 22 10:26:34.011239 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 479/966] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:26:33 2022] GET /compute/v2.1/servers/46804c86-520a-407d-84a9-2f6d1ea1cff0 => generated 1575 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:26:34.459991 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-5d8f4908-84ae-4c21-af48-5249bfd0c036 tempest-TestMinimumBasicScenario-1602759881 tempest-TestMinimumBasicScenario-1602759881-project] Action: 'create', calling method: .version_select at 0x7f36bdd1bee0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1333361041", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM7jL47YwMSeKACqe1GuajsRBuN8KFVSYwONWHJS0Q6D6D7voI+zdaVFTrcU146FjKHGJogBjNqDJT6hWQBgKA7XpZ9kuWSTWxtcf82n0g2H/7b930KV46wcJTCmY6acug=="}} {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:26:34.475106 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.quota [None req-5d8f4908-84ae-4c21-af48-5249bfd0c036 tempest-TestMinimumBasicScenario-1602759881 tempest-TestMinimumBasicScenario-1602759881-project] Getting quotas for project f4d8e96d47af4667a2f478e6561353d4. Resources: {'key_pairs'} {{(pid=117874) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 22 10:26:34.479461 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.quota [None req-5d8f4908-84ae-4c21-af48-5249bfd0c036 tempest-TestMinimumBasicScenario-1602759881 tempest-TestMinimumBasicScenario-1602759881-project] Getting quotas for user 21a35a18c4d74109ac1dacc120bbe0fc and project f4d8e96d47af4667a2f478e6561353d4. Resources: {'key_pairs'} {{(pid=117874) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 22 10:26:34.502835 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [None req-5d8f4908-84ae-4c21-af48-5249bfd0c036 tempest-TestMinimumBasicScenario-1602759881 tempest-TestMinimumBasicScenario-1602759881-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.046808 Jun 22 10:26:34.503435 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 488/967] 10.222.0.43 () {60 vars in 1158 bytes} [Wed Jun 22 10:26:34 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 10:26:34.551180 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-e5a596fd-8a8a-4f76-8b85-7920d2b5174e tempest-TestMinimumBasicScenario-1602759881 tempest-TestMinimumBasicScenario-1602759881-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-2092082937", "imageRef": "eb74d678-3b52-4cac-8223-d83e4faa8a2f", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1333361041", "networks": [{"uuid": "bc9c4db9-b058-40e2-9895-f39f6e0b1815"}]}} {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:26:34.600690 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.network.neutron [None req-e5a596fd-8a8a-4f76-8b85-7920d2b5174e tempest-TestMinimumBasicScenario-1602759881 tempest-TestMinimumBasicScenario-1602759881-project] validate_networks() for [('bc9c4db9-b058-40e2-9895-f39f6e0b1815', None, None, None, None, None)] {{(pid=117873) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 22 10:26:35.022048 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.virt.hardware [None req-e5a596fd-8a8a-4f76-8b85-7920d2b5174e tempest-TestMinimumBasicScenario-1602759881 tempest-TestMinimumBasicScenario-1602759881-project] Flavor limits 0:0:0 {{(pid=117873) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 22 10:26:35.022679 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.virt.hardware [None req-e5a596fd-8a8a-4f76-8b85-7920d2b5174e tempest-TestMinimumBasicScenario-1602759881 tempest-TestMinimumBasicScenario-1602759881-project] Image limits 0:0:0 {{(pid=117873) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 22 10:26:35.022950 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.virt.hardware [None req-e5a596fd-8a8a-4f76-8b85-7920d2b5174e tempest-TestMinimumBasicScenario-1602759881 tempest-TestMinimumBasicScenario-1602759881-project] Flavor pref 0:0:0 {{(pid=117873) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 22 10:26:35.023353 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.virt.hardware [None req-e5a596fd-8a8a-4f76-8b85-7920d2b5174e tempest-TestMinimumBasicScenario-1602759881 tempest-TestMinimumBasicScenario-1602759881-project] Image pref 0:0:0 {{(pid=117873) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 22 10:26:35.023756 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.virt.hardware [None req-e5a596fd-8a8a-4f76-8b85-7920d2b5174e tempest-TestMinimumBasicScenario-1602759881 tempest-TestMinimumBasicScenario-1602759881-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117873) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 22 10:26:35.028002 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-e6916c72-e1cb-4ae9-ac55-8dbbea82264f tempest-TestShelveInstance-1869927250 tempest-TestShelveInstance-1869927250-project] Calling method '>' {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:26:35.028624 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.compute.api [None req-e6916c72-e1cb-4ae9-ac55-8dbbea82264f tempest-TestShelveInstance-1869927250 tempest-TestShelveInstance-1869927250-project] [instance: 46804c86-520a-407d-84a9-2f6d1ea1cff0] Fetching instance by UUID {{(pid=117874) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:26:35.033340 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-e5a596fd-8a8a-4f76-8b85-7920d2b5174e tempest-TestMinimumBasicScenario-1602759881 tempest-TestMinimumBasicScenario-1602759881-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:26:35.033883 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-e5a596fd-8a8a-4f76-8b85-7920d2b5174e tempest-TestMinimumBasicScenario-1602759881 tempest-TestMinimumBasicScenario-1602759881-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:26:35.034666 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-e5a596fd-8a8a-4f76-8b85-7920d2b5174e tempest-TestMinimumBasicScenario-1602759881 tempest-TestMinimumBasicScenario-1602759881-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:26:35.034795 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-e6916c72-e1cb-4ae9-ac55-8dbbea82264f tempest-TestShelveInstance-1869927250 tempest-TestShelveInstance-1869927250-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:26:35.035093 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-e5a596fd-8a8a-4f76-8b85-7920d2b5174e tempest-TestMinimumBasicScenario-1602759881 tempest-TestMinimumBasicScenario-1602759881-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:26:35.035232 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-e6916c72-e1cb-4ae9-ac55-8dbbea82264f tempest-TestShelveInstance-1869927250 tempest-TestShelveInstance-1869927250-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:26:35.035969 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-e6916c72-e1cb-4ae9-ac55-8dbbea82264f tempest-TestShelveInstance-1869927250 tempest-TestShelveInstance-1869927250-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:26:35.036411 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-e6916c72-e1cb-4ae9-ac55-8dbbea82264f tempest-TestShelveInstance-1869927250 tempest-TestShelveInstance-1869927250-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:26:35.052614 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.quota [None req-e5a596fd-8a8a-4f76-8b85-7920d2b5174e tempest-TestMinimumBasicScenario-1602759881 tempest-TestMinimumBasicScenario-1602759881-project] Getting quotas for project f4d8e96d47af4667a2f478e6561353d4. Resources: {'instances', 'cores', 'ram'} {{(pid=117873) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 22 10:26:35.057176 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.quota [None req-e5a596fd-8a8a-4f76-8b85-7920d2b5174e tempest-TestMinimumBasicScenario-1602759881 tempest-TestMinimumBasicScenario-1602759881-project] Getting quotas for user 21a35a18c4d74109ac1dacc120bbe0fc and project f4d8e96d47af4667a2f478e6561353d4. Resources: {'instances', 'cores', 'ram'} {{(pid=117873) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 22 10:26:35.067926 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.compute.api [None req-e5a596fd-8a8a-4f76-8b85-7920d2b5174e tempest-TestMinimumBasicScenario-1602759881 tempest-TestMinimumBasicScenario-1602759881-project] Going to run 1 instances... {{(pid=117873) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 22 10:26:35.070131 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.compute.api [None req-e5a596fd-8a8a-4f76-8b85-7920d2b5174e tempest-TestMinimumBasicScenario-1602759881 tempest-TestMinimumBasicScenario-1602759881-project] [instance: 3a9c029c-4daa-4ae2-b624-6d227fd03923] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='eb74d678-3b52-4cac-8223-d83e4faa8a2f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117873) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 22 10:26:35.121808 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [None req-e5a596fd-8a8a-4f76-8b85-7920d2b5174e tempest-TestMinimumBasicScenario-1602759881 tempest-TestMinimumBasicScenario-1602759881-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.574314 Jun 22 10:26:35.122435 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 480/968] 10.222.0.43 () {60 vars in 1146 bytes} [Wed Jun 22 10:26:34 2022] POST /compute/v2.1/servers => generated 380 bytes in 576 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 22 10:26:35.131984 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-1a3af8cc-6d58-4a2f-8c51-d21369a4e6b1 tempest-TestMinimumBasicScenario-1602759881 tempest-TestMinimumBasicScenario-1602759881-project] Calling method '>' {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:26:35.132584 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.compute.api [None req-1a3af8cc-6d58-4a2f-8c51-d21369a4e6b1 tempest-TestMinimumBasicScenario-1602759881 tempest-TestMinimumBasicScenario-1602759881-project] [instance: 3a9c029c-4daa-4ae2-b624-6d227fd03923] Fetching instance by UUID {{(pid=117873) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:26:35.203239 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.policy [None req-1a3af8cc-6d58-4a2f-8c51-d21369a4e6b1 tempest-TestMinimumBasicScenario-1602759881 tempest-TestMinimumBasicScenario-1602759881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21a35a18c4d74109ac1dacc120bbe0fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4d8e96d47af4667a2f478e6561353d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117873) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:26:35.207228 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.policy [None req-e6916c72-e1cb-4ae9-ac55-8dbbea82264f tempest-TestShelveInstance-1869927250 tempest-TestShelveInstance-1869927250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6428e56cd9b46feb6a7b04e4d00c162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa9a1da5cb5a4279abb88ec7bdb1ef6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117874) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:26:35.210162 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [None req-1a3af8cc-6d58-4a2f-8c51-d21369a4e6b1 tempest-TestMinimumBasicScenario-1602759881 tempest-TestMinimumBasicScenario-1602759881-project] 10.222.0.43 "GET /compute/v2.1/servers/3a9c029c-4daa-4ae2-b624-6d227fd03923" status: 200 len: 1259 microversion: 2.1 time: 0.081930 Jun 22 10:26:35.211050 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 481/969] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:26:35 2022] GET /compute/v2.1/servers/3a9c029c-4daa-4ae2-b624-6d227fd03923 => generated 1259 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 10:26:35.216630 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [None req-e6916c72-e1cb-4ae9-ac55-8dbbea82264f tempest-TestShelveInstance-1869927250 tempest-TestShelveInstance-1869927250-project] 10.222.0.43 "GET /compute/v2.1/servers/46804c86-520a-407d-84a9-2f6d1ea1cff0" status: 200 len: 1575 microversion: 2.1 time: 0.192532 Jun 22 10:26:35.217189 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 489/970] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:26:35 2022] GET /compute/v2.1/servers/46804c86-520a-407d-84a9-2f6d1ea1cff0 => generated 1575 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:26:36.234310 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-afe0ee9d-b986-4e73-8c91-268c24cac911 tempest-TestShelveInstance-1869927250 tempest-TestShelveInstance-1869927250-project] Calling method '>' {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:26:36.234920 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.compute.api [None req-afe0ee9d-b986-4e73-8c91-268c24cac911 tempest-TestShelveInstance-1869927250 tempest-TestShelveInstance-1869927250-project] [instance: 46804c86-520a-407d-84a9-2f6d1ea1cff0] Fetching instance by UUID {{(pid=117873) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:26:36.235190 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-e970bb65-ca89-441a-9852-cc2ab5664766 tempest-TestMinimumBasicScenario-1602759881 tempest-TestMinimumBasicScenario-1602759881-project] Calling method '>' {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:26:36.235893 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.compute.api [None req-e970bb65-ca89-441a-9852-cc2ab5664766 tempest-TestMinimumBasicScenario-1602759881 tempest-TestMinimumBasicScenario-1602759881-project] [instance: 3a9c029c-4daa-4ae2-b624-6d227fd03923] Fetching instance by UUID {{(pid=117874) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:26:36.242533 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-afe0ee9d-b986-4e73-8c91-268c24cac911 tempest-TestShelveInstance-1869927250 tempest-TestShelveInstance-1869927250-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:26:36.243024 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-afe0ee9d-b986-4e73-8c91-268c24cac911 tempest-TestShelveInstance-1869927250 tempest-TestShelveInstance-1869927250-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:26:36.243153 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-e970bb65-ca89-441a-9852-cc2ab5664766 tempest-TestMinimumBasicScenario-1602759881 tempest-TestMinimumBasicScenario-1602759881-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:26:36.244248 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-e970bb65-ca89-441a-9852-cc2ab5664766 tempest-TestMinimumBasicScenario-1602759881 tempest-TestMinimumBasicScenario-1602759881-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:26:36.245127 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-e970bb65-ca89-441a-9852-cc2ab5664766 tempest-TestMinimumBasicScenario-1602759881 tempest-TestMinimumBasicScenario-1602759881-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:26:36.245240 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-afe0ee9d-b986-4e73-8c91-268c24cac911 tempest-TestShelveInstance-1869927250 tempest-TestShelveInstance-1869927250-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:26:36.245587 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-afe0ee9d-b986-4e73-8c91-268c24cac911 tempest-TestShelveInstance-1869927250 tempest-TestShelveInstance-1869927250-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:26:36.245723 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-e970bb65-ca89-441a-9852-cc2ab5664766 tempest-TestMinimumBasicScenario-1602759881 tempest-TestMinimumBasicScenario-1602759881-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:26:36.334125 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.policy [None req-e970bb65-ca89-441a-9852-cc2ab5664766 tempest-TestMinimumBasicScenario-1602759881 tempest-TestMinimumBasicScenario-1602759881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21a35a18c4d74109ac1dacc120bbe0fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4d8e96d47af4667a2f478e6561353d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117874) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:26:36.341848 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [None req-e970bb65-ca89-441a-9852-cc2ab5664766 tempest-TestMinimumBasicScenario-1602759881 tempest-TestMinimumBasicScenario-1602759881-project] 10.222.0.43 "GET /compute/v2.1/servers/3a9c029c-4daa-4ae2-b624-6d227fd03923" status: 200 len: 1311 microversion: 2.1 time: 0.110563 Jun 22 10:26:36.342529 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 490/971] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:26:36 2022] GET /compute/v2.1/servers/3a9c029c-4daa-4ae2-b624-6d227fd03923 => generated 1311 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 10:26:36.406126 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.policy [None req-afe0ee9d-b986-4e73-8c91-268c24cac911 tempest-TestShelveInstance-1869927250 tempest-TestShelveInstance-1869927250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6428e56cd9b46feb6a7b04e4d00c162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa9a1da5cb5a4279abb88ec7bdb1ef6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117873) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:26:36.413565 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [None req-afe0ee9d-b986-4e73-8c91-268c24cac911 tempest-TestShelveInstance-1869927250 tempest-TestShelveInstance-1869927250-project] 10.222.0.43 "GET /compute/v2.1/servers/46804c86-520a-407d-84a9-2f6d1ea1cff0" status: 200 len: 1575 microversion: 2.1 time: 0.183194 Jun 22 10:26:36.414165 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 482/972] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:26:36 2022] GET /compute/v2.1/servers/46804c86-520a-407d-84a9-2f6d1ea1cff0 => generated 1575 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:26:37.363724 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-34f7e3c7-3a58-42f0-9bcf-f49b99fcf02a tempest-TestMinimumBasicScenario-1602759881 tempest-TestMinimumBasicScenario-1602759881-project] Calling method '>' {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:26:37.365059 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.compute.api [None req-34f7e3c7-3a58-42f0-9bcf-f49b99fcf02a tempest-TestMinimumBasicScenario-1602759881 tempest-TestMinimumBasicScenario-1602759881-project] [instance: 3a9c029c-4daa-4ae2-b624-6d227fd03923] Fetching instance by UUID {{(pid=117874) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:26:37.381729 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-34f7e3c7-3a58-42f0-9bcf-f49b99fcf02a tempest-TestMinimumBasicScenario-1602759881 tempest-TestMinimumBasicScenario-1602759881-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:26:37.386900 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-34f7e3c7-3a58-42f0-9bcf-f49b99fcf02a tempest-TestMinimumBasicScenario-1602759881 tempest-TestMinimumBasicScenario-1602759881-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:26:37.395195 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-34f7e3c7-3a58-42f0-9bcf-f49b99fcf02a tempest-TestMinimumBasicScenario-1602759881 tempest-TestMinimumBasicScenario-1602759881-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:26:37.395990 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-34f7e3c7-3a58-42f0-9bcf-f49b99fcf02a tempest-TestMinimumBasicScenario-1602759881 tempest-TestMinimumBasicScenario-1602759881-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:26:37.432480 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-5568f271-6e4c-49de-b2ba-3e43100f5147 tempest-TestShelveInstance-1869927250 tempest-TestShelveInstance-1869927250-project] Calling method '>' {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:26:37.434105 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.compute.api [None req-5568f271-6e4c-49de-b2ba-3e43100f5147 tempest-TestShelveInstance-1869927250 tempest-TestShelveInstance-1869927250-project] [instance: 46804c86-520a-407d-84a9-2f6d1ea1cff0] Fetching instance by UUID {{(pid=117873) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:26:37.441318 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-5568f271-6e4c-49de-b2ba-3e43100f5147 tempest-TestShelveInstance-1869927250 tempest-TestShelveInstance-1869927250-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:26:37.442415 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-5568f271-6e4c-49de-b2ba-3e43100f5147 tempest-TestShelveInstance-1869927250 tempest-TestShelveInstance-1869927250-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:26:37.443436 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-5568f271-6e4c-49de-b2ba-3e43100f5147 tempest-TestShelveInstance-1869927250 tempest-TestShelveInstance-1869927250-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:26:37.444082 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-5568f271-6e4c-49de-b2ba-3e43100f5147 tempest-TestShelveInstance-1869927250 tempest-TestShelveInstance-1869927250-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:26:37.704281 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.policy [None req-34f7e3c7-3a58-42f0-9bcf-f49b99fcf02a tempest-TestMinimumBasicScenario-1602759881 tempest-TestMinimumBasicScenario-1602759881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21a35a18c4d74109ac1dacc120bbe0fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4d8e96d47af4667a2f478e6561353d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117874) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:26:37.713929 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [None req-34f7e3c7-3a58-42f0-9bcf-f49b99fcf02a tempest-TestMinimumBasicScenario-1602759881 tempest-TestMinimumBasicScenario-1602759881-project] 10.222.0.43 "GET /compute/v2.1/servers/3a9c029c-4daa-4ae2-b624-6d227fd03923" status: 200 len: 1359 microversion: 2.1 time: 0.354912 Jun 22 10:26:37.724757 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 491/973] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:26:37 2022] GET /compute/v2.1/servers/3a9c029c-4daa-4ae2-b624-6d227fd03923 => generated 1359 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:26:37.733818 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.policy [None req-5568f271-6e4c-49de-b2ba-3e43100f5147 tempest-TestShelveInstance-1869927250 tempest-TestShelveInstance-1869927250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6428e56cd9b46feb6a7b04e4d00c162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa9a1da5cb5a4279abb88ec7bdb1ef6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117873) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:26:37.743630 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [None req-5568f271-6e4c-49de-b2ba-3e43100f5147 tempest-TestShelveInstance-1869927250 tempest-TestShelveInstance-1869927250-project] 10.222.0.43 "GET /compute/v2.1/servers/46804c86-520a-407d-84a9-2f6d1ea1cff0" status: 200 len: 1575 microversion: 2.1 time: 0.315352 Jun 22 10:26:37.745031 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 483/974] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:26:37 2022] GET /compute/v2.1/servers/46804c86-520a-407d-84a9-2f6d1ea1cff0 => generated 1575 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 10:26:38.733083 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-87dab641-d58a-4ccc-954a-50fdaa143928 tempest-TestMinimumBasicScenario-1602759881 tempest-TestMinimumBasicScenario-1602759881-project] Calling method '>' {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:26:38.734497 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.compute.api [None req-87dab641-d58a-4ccc-954a-50fdaa143928 tempest-TestMinimumBasicScenario-1602759881 tempest-TestMinimumBasicScenario-1602759881-project] [instance: 3a9c029c-4daa-4ae2-b624-6d227fd03923] Fetching instance by UUID {{(pid=117874) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:26:38.741482 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-87dab641-d58a-4ccc-954a-50fdaa143928 tempest-TestMinimumBasicScenario-1602759881 tempest-TestMinimumBasicScenario-1602759881-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:26:38.742309 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-87dab641-d58a-4ccc-954a-50fdaa143928 tempest-TestMinimumBasicScenario-1602759881 tempest-TestMinimumBasicScenario-1602759881-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:26:38.743380 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-87dab641-d58a-4ccc-954a-50fdaa143928 tempest-TestMinimumBasicScenario-1602759881 tempest-TestMinimumBasicScenario-1602759881-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:26:38.744508 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-87dab641-d58a-4ccc-954a-50fdaa143928 tempest-TestMinimumBasicScenario-1602759881 tempest-TestMinimumBasicScenario-1602759881-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:26:38.760189 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-f38a2516-3ab1-4283-928d-668c2636e094 tempest-TestShelveInstance-1869927250 tempest-TestShelveInstance-1869927250-project] Calling method '>' {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:26:38.760797 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.compute.api [None req-f38a2516-3ab1-4283-928d-668c2636e094 tempest-TestShelveInstance-1869927250 tempest-TestShelveInstance-1869927250-project] [instance: 46804c86-520a-407d-84a9-2f6d1ea1cff0] Fetching instance by UUID {{(pid=117873) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:26:38.767947 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-f38a2516-3ab1-4283-928d-668c2636e094 tempest-TestShelveInstance-1869927250 tempest-TestShelveInstance-1869927250-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:26:38.768500 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-f38a2516-3ab1-4283-928d-668c2636e094 tempest-TestShelveInstance-1869927250 tempest-TestShelveInstance-1869927250-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:26:38.769263 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-f38a2516-3ab1-4283-928d-668c2636e094 tempest-TestShelveInstance-1869927250 tempest-TestShelveInstance-1869927250-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:26:38.769868 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-f38a2516-3ab1-4283-928d-668c2636e094 tempest-TestShelveInstance-1869927250 tempest-TestShelveInstance-1869927250-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:26:39.001452 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.policy [None req-87dab641-d58a-4ccc-954a-50fdaa143928 tempest-TestMinimumBasicScenario-1602759881 tempest-TestMinimumBasicScenario-1602759881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21a35a18c4d74109ac1dacc120bbe0fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4d8e96d47af4667a2f478e6561353d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117874) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:26:39.006538 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.policy [None req-f38a2516-3ab1-4283-928d-668c2636e094 tempest-TestShelveInstance-1869927250 tempest-TestShelveInstance-1869927250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6428e56cd9b46feb6a7b04e4d00c162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa9a1da5cb5a4279abb88ec7bdb1ef6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117873) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:26:39.014073 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [None req-87dab641-d58a-4ccc-954a-50fdaa143928 tempest-TestMinimumBasicScenario-1602759881 tempest-TestMinimumBasicScenario-1602759881-project] 10.222.0.43 "GET /compute/v2.1/servers/3a9c029c-4daa-4ae2-b624-6d227fd03923" status: 200 len: 1359 microversion: 2.1 time: 0.285985 Jun 22 10:26:39.016222 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [None req-f38a2516-3ab1-4283-928d-668c2636e094 tempest-TestShelveInstance-1869927250 tempest-TestShelveInstance-1869927250-project] 10.222.0.43 "GET /compute/v2.1/servers/46804c86-520a-407d-84a9-2f6d1ea1cff0" status: 200 len: 1575 microversion: 2.1 time: 0.259768 Jun 22 10:26:39.017342 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 484/975] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:26:38 2022] GET /compute/v2.1/servers/46804c86-520a-407d-84a9-2f6d1ea1cff0 => generated 1575 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 10:26:39.022544 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 492/976] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:26:38 2022] GET /compute/v2.1/servers/3a9c029c-4daa-4ae2-b624-6d227fd03923 => generated 1359 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:26:40.034513 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-4fd3d6f2-02c0-4826-b283-0d5ebf9badc1 tempest-TestShelveInstance-1869927250 tempest-TestShelveInstance-1869927250-project] Calling method '>' {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:26:40.035763 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.compute.api [None req-4fd3d6f2-02c0-4826-b283-0d5ebf9badc1 tempest-TestShelveInstance-1869927250 tempest-TestShelveInstance-1869927250-project] [instance: 46804c86-520a-407d-84a9-2f6d1ea1cff0] Fetching instance by UUID {{(pid=117873) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:26:40.040586 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-178a9dc8-9cb5-4151-8e1d-7fb1c8553189 tempest-TestMinimumBasicScenario-1602759881 tempest-TestMinimumBasicScenario-1602759881-project] Calling method '>' {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:26:40.041331 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.compute.api [None req-178a9dc8-9cb5-4151-8e1d-7fb1c8553189 tempest-TestMinimumBasicScenario-1602759881 tempest-TestMinimumBasicScenario-1602759881-project] [instance: 3a9c029c-4daa-4ae2-b624-6d227fd03923] Fetching instance by UUID {{(pid=117874) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:26:40.042835 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-4fd3d6f2-02c0-4826-b283-0d5ebf9badc1 tempest-TestShelveInstance-1869927250 tempest-TestShelveInstance-1869927250-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:26:40.043611 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-4fd3d6f2-02c0-4826-b283-0d5ebf9badc1 tempest-TestShelveInstance-1869927250 tempest-TestShelveInstance-1869927250-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:26:40.044385 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-4fd3d6f2-02c0-4826-b283-0d5ebf9badc1 tempest-TestShelveInstance-1869927250 tempest-TestShelveInstance-1869927250-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:26:40.045188 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-4fd3d6f2-02c0-4826-b283-0d5ebf9badc1 tempest-TestShelveInstance-1869927250 tempest-TestShelveInstance-1869927250-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:26:40.048421 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-178a9dc8-9cb5-4151-8e1d-7fb1c8553189 tempest-TestMinimumBasicScenario-1602759881 tempest-TestMinimumBasicScenario-1602759881-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:26:40.048868 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-178a9dc8-9cb5-4151-8e1d-7fb1c8553189 tempest-TestMinimumBasicScenario-1602759881 tempest-TestMinimumBasicScenario-1602759881-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:26:40.049620 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG dbcounter [-] [117873] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:26:40.049769 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-178a9dc8-9cb5-4151-8e1d-7fb1c8553189 tempest-TestMinimumBasicScenario-1602759881 tempest-TestMinimumBasicScenario-1602759881-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:26:40.050106 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-178a9dc8-9cb5-4151-8e1d-7fb1c8553189 tempest-TestMinimumBasicScenario-1602759881 tempest-TestMinimumBasicScenario-1602759881-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:26:40.243284 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.policy [None req-4fd3d6f2-02c0-4826-b283-0d5ebf9badc1 tempest-TestShelveInstance-1869927250 tempest-TestShelveInstance-1869927250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6428e56cd9b46feb6a7b04e4d00c162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa9a1da5cb5a4279abb88ec7bdb1ef6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117873) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:26:40.253330 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [None req-4fd3d6f2-02c0-4826-b283-0d5ebf9badc1 tempest-TestShelveInstance-1869927250 tempest-TestShelveInstance-1869927250-project] 10.222.0.43 "GET /compute/v2.1/servers/46804c86-520a-407d-84a9-2f6d1ea1cff0" status: 200 len: 1575 microversion: 2.1 time: 0.222809 Jun 22 10:26:40.261745 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 485/977] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:26:40 2022] GET /compute/v2.1/servers/46804c86-520a-407d-84a9-2f6d1ea1cff0 => generated 1575 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:26:40.276052 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.policy [None req-178a9dc8-9cb5-4151-8e1d-7fb1c8553189 tempest-TestMinimumBasicScenario-1602759881 tempest-TestMinimumBasicScenario-1602759881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21a35a18c4d74109ac1dacc120bbe0fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4d8e96d47af4667a2f478e6561353d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117874) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:26:40.290678 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [None req-178a9dc8-9cb5-4151-8e1d-7fb1c8553189 tempest-TestMinimumBasicScenario-1602759881 tempest-TestMinimumBasicScenario-1602759881-project] 10.222.0.43 "GET /compute/v2.1/servers/3a9c029c-4daa-4ae2-b624-6d227fd03923" status: 200 len: 1359 microversion: 2.1 time: 0.253825 Jun 22 10:26:40.291520 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 493/978] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:26:40 2022] GET /compute/v2.1/servers/3a9c029c-4daa-4ae2-b624-6d227fd03923 => generated 1359 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:26:40.658291 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [req-0d0a8621-ee0f-4579-bc1f-551703ff6bed req-8c963b1b-c843-428d-b901-ddac1080f751 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "46804c86-520a-407d-84a9-2f6d1ea1cff0", "name": "network-vif-plugged", "status": "completed", "tag": "377da38d-a656-43c8-babd-6b00935ec9f5"}]} {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:26:40.679868 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [req-0d0a8621-ee0f-4579-bc1f-551703ff6bed req-8c963b1b-c843-428d-b901-ddac1080f751 service nova] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:26:40.680506 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [req-0d0a8621-ee0f-4579-bc1f-551703ff6bed req-8c963b1b-c843-428d-b901-ddac1080f751 service nova] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:26:40.693169 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.compute.server_external_events [req-0d0a8621-ee0f-4579-bc1f-551703ff6bed req-8c963b1b-c843-428d-b901-ddac1080f751 service nova] Creating event network-vif-plugged:377da38d-a656-43c8-babd-6b00935ec9f5 for instance 46804c86-520a-407d-84a9-2f6d1ea1cff0 on hv-cinder-84713 Jun 22 10:26:40.699279 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [req-0d0a8621-ee0f-4579-bc1f-551703ff6bed req-8c963b1b-c843-428d-b901-ddac1080f751 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.223531 Jun 22 10:26:40.699882 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 486/979] 10.222.0.43 () {64 vars in 1317 bytes} [Wed Jun 22 10:26:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 10:26:41.271001 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-170deba0-520e-4040-9367-2aedea6e7377 tempest-TestShelveInstance-1869927250 tempest-TestShelveInstance-1869927250-project] Calling method '>' {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:26:41.271714 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.compute.api [None req-170deba0-520e-4040-9367-2aedea6e7377 tempest-TestShelveInstance-1869927250 tempest-TestShelveInstance-1869927250-project] [instance: 46804c86-520a-407d-84a9-2f6d1ea1cff0] Fetching instance by UUID {{(pid=117874) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:26:41.279147 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-170deba0-520e-4040-9367-2aedea6e7377 tempest-TestShelveInstance-1869927250 tempest-TestShelveInstance-1869927250-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:26:41.279587 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-170deba0-520e-4040-9367-2aedea6e7377 tempest-TestShelveInstance-1869927250 tempest-TestShelveInstance-1869927250-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:26:41.280350 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-170deba0-520e-4040-9367-2aedea6e7377 tempest-TestShelveInstance-1869927250 tempest-TestShelveInstance-1869927250-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:26:41.280956 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-170deba0-520e-4040-9367-2aedea6e7377 tempest-TestShelveInstance-1869927250 tempest-TestShelveInstance-1869927250-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:26:41.308410 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-cacc3ab3-5575-45c4-9322-f76a92f215b5 tempest-TestMinimumBasicScenario-1602759881 tempest-TestMinimumBasicScenario-1602759881-project] Calling method '>' {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:26:41.309156 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.compute.api [None req-cacc3ab3-5575-45c4-9322-f76a92f215b5 tempest-TestMinimumBasicScenario-1602759881 tempest-TestMinimumBasicScenario-1602759881-project] [instance: 3a9c029c-4daa-4ae2-b624-6d227fd03923] Fetching instance by UUID {{(pid=117873) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:26:41.316231 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-cacc3ab3-5575-45c4-9322-f76a92f215b5 tempest-TestMinimumBasicScenario-1602759881 tempest-TestMinimumBasicScenario-1602759881-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:26:41.317021 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-cacc3ab3-5575-45c4-9322-f76a92f215b5 tempest-TestMinimumBasicScenario-1602759881 tempest-TestMinimumBasicScenario-1602759881-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:26:41.318047 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-cacc3ab3-5575-45c4-9322-f76a92f215b5 tempest-TestMinimumBasicScenario-1602759881 tempest-TestMinimumBasicScenario-1602759881-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:26:41.318540 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-cacc3ab3-5575-45c4-9322-f76a92f215b5 tempest-TestMinimumBasicScenario-1602759881 tempest-TestMinimumBasicScenario-1602759881-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:26:41.501550 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.policy [None req-170deba0-520e-4040-9367-2aedea6e7377 tempest-TestShelveInstance-1869927250 tempest-TestShelveInstance-1869927250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6428e56cd9b46feb6a7b04e4d00c162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa9a1da5cb5a4279abb88ec7bdb1ef6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117874) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:26:41.512829 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [None req-170deba0-520e-4040-9367-2aedea6e7377 tempest-TestShelveInstance-1869927250 tempest-TestShelveInstance-1869927250-project] 10.222.0.43 "GET /compute/v2.1/servers/46804c86-520a-407d-84a9-2f6d1ea1cff0" status: 200 len: 1575 microversion: 2.1 time: 0.245540 Jun 22 10:26:41.513407 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 494/980] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:26:41 2022] GET /compute/v2.1/servers/46804c86-520a-407d-84a9-2f6d1ea1cff0 => generated 1575 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:26:41.532455 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.policy [None req-cacc3ab3-5575-45c4-9322-f76a92f215b5 tempest-TestMinimumBasicScenario-1602759881 tempest-TestMinimumBasicScenario-1602759881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21a35a18c4d74109ac1dacc120bbe0fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4d8e96d47af4667a2f478e6561353d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117873) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:26:41.543679 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [None req-cacc3ab3-5575-45c4-9322-f76a92f215b5 tempest-TestMinimumBasicScenario-1602759881 tempest-TestMinimumBasicScenario-1602759881-project] 10.222.0.43 "GET /compute/v2.1/servers/3a9c029c-4daa-4ae2-b624-6d227fd03923" status: 200 len: 1359 microversion: 2.1 time: 0.239486 Jun 22 10:26:41.544366 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 487/981] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:26:41 2022] GET /compute/v2.1/servers/3a9c029c-4daa-4ae2-b624-6d227fd03923 => generated 1359 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 10:26:42.530071 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-391e5199-0b64-4844-b6a3-47c5fab0fe1b tempest-TestShelveInstance-1869927250 tempest-TestShelveInstance-1869927250-project] Calling method '>' {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:26:42.530673 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.compute.api [None req-391e5199-0b64-4844-b6a3-47c5fab0fe1b tempest-TestShelveInstance-1869927250 tempest-TestShelveInstance-1869927250-project] [instance: 46804c86-520a-407d-84a9-2f6d1ea1cff0] Fetching instance by UUID {{(pid=117874) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:26:42.537236 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-391e5199-0b64-4844-b6a3-47c5fab0fe1b tempest-TestShelveInstance-1869927250 tempest-TestShelveInstance-1869927250-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:26:42.537678 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-391e5199-0b64-4844-b6a3-47c5fab0fe1b tempest-TestShelveInstance-1869927250 tempest-TestShelveInstance-1869927250-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:26:42.538464 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-391e5199-0b64-4844-b6a3-47c5fab0fe1b tempest-TestShelveInstance-1869927250 tempest-TestShelveInstance-1869927250-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:26:42.539160 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-391e5199-0b64-4844-b6a3-47c5fab0fe1b tempest-TestShelveInstance-1869927250 tempest-TestShelveInstance-1869927250-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:26:42.543925 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG dbcounter [-] [117874] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:26:42.562632 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-96bd89ac-c639-40df-b52e-2482c8c28b0b tempest-TestMinimumBasicScenario-1602759881 tempest-TestMinimumBasicScenario-1602759881-project] Calling method '>' {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:26:42.563247 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.compute.api [None req-96bd89ac-c639-40df-b52e-2482c8c28b0b tempest-TestMinimumBasicScenario-1602759881 tempest-TestMinimumBasicScenario-1602759881-project] [instance: 3a9c029c-4daa-4ae2-b624-6d227fd03923] Fetching instance by UUID {{(pid=117873) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:26:42.570674 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-96bd89ac-c639-40df-b52e-2482c8c28b0b tempest-TestMinimumBasicScenario-1602759881 tempest-TestMinimumBasicScenario-1602759881-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:26:42.571298 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-96bd89ac-c639-40df-b52e-2482c8c28b0b tempest-TestMinimumBasicScenario-1602759881 tempest-TestMinimumBasicScenario-1602759881-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:26:42.572968 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-96bd89ac-c639-40df-b52e-2482c8c28b0b tempest-TestMinimumBasicScenario-1602759881 tempest-TestMinimumBasicScenario-1602759881-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:26:42.573492 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-96bd89ac-c639-40df-b52e-2482c8c28b0b tempest-TestMinimumBasicScenario-1602759881 tempest-TestMinimumBasicScenario-1602759881-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:26:42.735138 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.policy [None req-391e5199-0b64-4844-b6a3-47c5fab0fe1b tempest-TestShelveInstance-1869927250 tempest-TestShelveInstance-1869927250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6428e56cd9b46feb6a7b04e4d00c162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa9a1da5cb5a4279abb88ec7bdb1ef6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117874) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:26:42.743030 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [None req-391e5199-0b64-4844-b6a3-47c5fab0fe1b tempest-TestShelveInstance-1869927250 tempest-TestShelveInstance-1869927250-project] 10.222.0.43 "GET /compute/v2.1/servers/46804c86-520a-407d-84a9-2f6d1ea1cff0" status: 200 len: 1575 microversion: 2.1 time: 0.217011 Jun 22 10:26:42.744265 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 495/982] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:26:42 2022] GET /compute/v2.1/servers/46804c86-520a-407d-84a9-2f6d1ea1cff0 => generated 1575 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:26:42.785452 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.policy [None req-96bd89ac-c639-40df-b52e-2482c8c28b0b tempest-TestMinimumBasicScenario-1602759881 tempest-TestMinimumBasicScenario-1602759881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21a35a18c4d74109ac1dacc120bbe0fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4d8e96d47af4667a2f478e6561353d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117873) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:26:42.803520 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [None req-96bd89ac-c639-40df-b52e-2482c8c28b0b tempest-TestMinimumBasicScenario-1602759881 tempest-TestMinimumBasicScenario-1602759881-project] 10.222.0.43 "GET /compute/v2.1/servers/3a9c029c-4daa-4ae2-b624-6d227fd03923" status: 200 len: 1359 microversion: 2.1 time: 0.244979 Jun 22 10:26:42.804160 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 488/983] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:26:42 2022] GET /compute/v2.1/servers/3a9c029c-4daa-4ae2-b624-6d227fd03923 => generated 1359 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 10:26:43.761670 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-4caf3153-424d-4616-a5fd-02238adebdf5 tempest-TestShelveInstance-1869927250 tempest-TestShelveInstance-1869927250-project] Calling method '>' {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:26:43.762438 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.compute.api [None req-4caf3153-424d-4616-a5fd-02238adebdf5 tempest-TestShelveInstance-1869927250 tempest-TestShelveInstance-1869927250-project] [instance: 46804c86-520a-407d-84a9-2f6d1ea1cff0] Fetching instance by UUID {{(pid=117874) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:26:43.764864 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG dbcounter [-] [117874] Writing DB stats nova_api:SELECT=48,nova_api:INSERT=1 {{(pid=117874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:26:43.770536 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-4caf3153-424d-4616-a5fd-02238adebdf5 tempest-TestShelveInstance-1869927250 tempest-TestShelveInstance-1869927250-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:26:43.770985 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-4caf3153-424d-4616-a5fd-02238adebdf5 tempest-TestShelveInstance-1869927250 tempest-TestShelveInstance-1869927250-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:26:43.771759 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-4caf3153-424d-4616-a5fd-02238adebdf5 tempest-TestShelveInstance-1869927250 tempest-TestShelveInstance-1869927250-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:26:43.772282 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-4caf3153-424d-4616-a5fd-02238adebdf5 tempest-TestShelveInstance-1869927250 tempest-TestShelveInstance-1869927250-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:26:43.820360 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-b2d56f25-55fd-4608-9461-7b5a1cd76159 tempest-TestMinimumBasicScenario-1602759881 tempest-TestMinimumBasicScenario-1602759881-project] Calling method '>' {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:26:43.821127 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.compute.api [None req-b2d56f25-55fd-4608-9461-7b5a1cd76159 tempest-TestMinimumBasicScenario-1602759881 tempest-TestMinimumBasicScenario-1602759881-project] [instance: 3a9c029c-4daa-4ae2-b624-6d227fd03923] Fetching instance by UUID {{(pid=117873) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:26:43.824200 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG dbcounter [-] [117873] Writing DB stats nova_api:SELECT=56,nova_api:INSERT=3 {{(pid=117873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:26:43.830183 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-b2d56f25-55fd-4608-9461-7b5a1cd76159 tempest-TestMinimumBasicScenario-1602759881 tempest-TestMinimumBasicScenario-1602759881-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:26:43.830627 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-b2d56f25-55fd-4608-9461-7b5a1cd76159 tempest-TestMinimumBasicScenario-1602759881 tempest-TestMinimumBasicScenario-1602759881-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:26:43.831426 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-b2d56f25-55fd-4608-9461-7b5a1cd76159 tempest-TestMinimumBasicScenario-1602759881 tempest-TestMinimumBasicScenario-1602759881-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:26:43.831854 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-b2d56f25-55fd-4608-9461-7b5a1cd76159 tempest-TestMinimumBasicScenario-1602759881 tempest-TestMinimumBasicScenario-1602759881-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:26:43.997872 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.policy [None req-4caf3153-424d-4616-a5fd-02238adebdf5 tempest-TestShelveInstance-1869927250 tempest-TestShelveInstance-1869927250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6428e56cd9b46feb6a7b04e4d00c162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa9a1da5cb5a4279abb88ec7bdb1ef6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117874) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:26:44.006387 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [None req-4caf3153-424d-4616-a5fd-02238adebdf5 tempest-TestShelveInstance-1869927250 tempest-TestShelveInstance-1869927250-project] 10.222.0.43 "GET /compute/v2.1/servers/46804c86-520a-407d-84a9-2f6d1ea1cff0" status: 200 len: 1575 microversion: 2.1 time: 0.249475 Jun 22 10:26:44.009968 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 496/984] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:26:43 2022] GET /compute/v2.1/servers/46804c86-520a-407d-84a9-2f6d1ea1cff0 => generated 1575 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:26:44.029094 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.policy [None req-b2d56f25-55fd-4608-9461-7b5a1cd76159 tempest-TestMinimumBasicScenario-1602759881 tempest-TestMinimumBasicScenario-1602759881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21a35a18c4d74109ac1dacc120bbe0fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4d8e96d47af4667a2f478e6561353d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117873) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:26:44.036720 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [None req-b2d56f25-55fd-4608-9461-7b5a1cd76159 tempest-TestMinimumBasicScenario-1602759881 tempest-TestMinimumBasicScenario-1602759881-project] 10.222.0.43 "GET /compute/v2.1/servers/3a9c029c-4daa-4ae2-b624-6d227fd03923" status: 200 len: 1359 microversion: 2.1 time: 0.220268 Jun 22 10:26:44.037617 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 489/985] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:26:43 2022] GET /compute/v2.1/servers/3a9c029c-4daa-4ae2-b624-6d227fd03923 => generated 1359 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 10:26:45.023794 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-73c3ec01-84b0-44bb-8839-c6bea27f2ff0 tempest-TestShelveInstance-1869927250 tempest-TestShelveInstance-1869927250-project] Calling method '>' {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:26:45.024354 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.compute.api [None req-73c3ec01-84b0-44bb-8839-c6bea27f2ff0 tempest-TestShelveInstance-1869927250 tempest-TestShelveInstance-1869927250-project] [instance: 46804c86-520a-407d-84a9-2f6d1ea1cff0] Fetching instance by UUID {{(pid=117874) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:26:45.026570 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG dbcounter [-] [117874] Writing DB stats nova_cell0:SELECT=4 {{(pid=117874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:26:45.032295 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-73c3ec01-84b0-44bb-8839-c6bea27f2ff0 tempest-TestShelveInstance-1869927250 tempest-TestShelveInstance-1869927250-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:26:45.032744 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-73c3ec01-84b0-44bb-8839-c6bea27f2ff0 tempest-TestShelveInstance-1869927250 tempest-TestShelveInstance-1869927250-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:26:45.033501 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-73c3ec01-84b0-44bb-8839-c6bea27f2ff0 tempest-TestShelveInstance-1869927250 tempest-TestShelveInstance-1869927250-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:26:45.033961 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-73c3ec01-84b0-44bb-8839-c6bea27f2ff0 tempest-TestShelveInstance-1869927250 tempest-TestShelveInstance-1869927250-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:26:45.054356 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-4c7ee52a-c0ad-4af9-98d1-72855b638e72 tempest-TestMinimumBasicScenario-1602759881 tempest-TestMinimumBasicScenario-1602759881-project] Calling method '>' {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:26:45.055571 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.compute.api [None req-4c7ee52a-c0ad-4af9-98d1-72855b638e72 tempest-TestMinimumBasicScenario-1602759881 tempest-TestMinimumBasicScenario-1602759881-project] [instance: 3a9c029c-4daa-4ae2-b624-6d227fd03923] Fetching instance by UUID {{(pid=117873) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:26:45.058585 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG dbcounter [-] [117873] Writing DB stats nova_cell0:SELECT=2 {{(pid=117873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:26:45.064033 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-4c7ee52a-c0ad-4af9-98d1-72855b638e72 tempest-TestMinimumBasicScenario-1602759881 tempest-TestMinimumBasicScenario-1602759881-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:26:45.064472 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-4c7ee52a-c0ad-4af9-98d1-72855b638e72 tempest-TestMinimumBasicScenario-1602759881 tempest-TestMinimumBasicScenario-1602759881-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:26:45.065230 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-4c7ee52a-c0ad-4af9-98d1-72855b638e72 tempest-TestMinimumBasicScenario-1602759881 tempest-TestMinimumBasicScenario-1602759881-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:26:45.065655 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-4c7ee52a-c0ad-4af9-98d1-72855b638e72 tempest-TestMinimumBasicScenario-1602759881 tempest-TestMinimumBasicScenario-1602759881-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:26:45.207739 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG dbcounter [-] [117873] Writing DB stats nova_cell0:SELECT=8 {{(pid=117873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:26:45.222086 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.policy [None req-73c3ec01-84b0-44bb-8839-c6bea27f2ff0 tempest-TestShelveInstance-1869927250 tempest-TestShelveInstance-1869927250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6428e56cd9b46feb6a7b04e4d00c162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa9a1da5cb5a4279abb88ec7bdb1ef6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117874) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:26:45.229913 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [None req-73c3ec01-84b0-44bb-8839-c6bea27f2ff0 tempest-TestShelveInstance-1869927250 tempest-TestShelveInstance-1869927250-project] 10.222.0.43 "GET /compute/v2.1/servers/46804c86-520a-407d-84a9-2f6d1ea1cff0" status: 200 len: 1575 microversion: 2.1 time: 0.210078 Jun 22 10:26:45.230488 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 497/986] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:26:45 2022] GET /compute/v2.1/servers/46804c86-520a-407d-84a9-2f6d1ea1cff0 => generated 1575 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:26:45.243183 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.policy [None req-4c7ee52a-c0ad-4af9-98d1-72855b638e72 tempest-TestMinimumBasicScenario-1602759881 tempest-TestMinimumBasicScenario-1602759881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21a35a18c4d74109ac1dacc120bbe0fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4d8e96d47af4667a2f478e6561353d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117873) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:26:45.251303 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [None req-4c7ee52a-c0ad-4af9-98d1-72855b638e72 tempest-TestMinimumBasicScenario-1602759881 tempest-TestMinimumBasicScenario-1602759881-project] 10.222.0.43 "GET /compute/v2.1/servers/3a9c029c-4daa-4ae2-b624-6d227fd03923" status: 200 len: 1359 microversion: 2.1 time: 0.200737 Jun 22 10:26:45.251859 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 490/987] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:26:45 2022] GET /compute/v2.1/servers/3a9c029c-4daa-4ae2-b624-6d227fd03923 => generated 1359 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 10:26:46.247131 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-7fa5f717-2929-473c-8a43-03d16ec805c6 tempest-TestShelveInstance-1869927250 tempest-TestShelveInstance-1869927250-project] Calling method '>' {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:26:46.247854 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.compute.api [None req-7fa5f717-2929-473c-8a43-03d16ec805c6 tempest-TestShelveInstance-1869927250 tempest-TestShelveInstance-1869927250-project] [instance: 46804c86-520a-407d-84a9-2f6d1ea1cff0] Fetching instance by UUID {{(pid=117874) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:26:46.254979 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-7fa5f717-2929-473c-8a43-03d16ec805c6 tempest-TestShelveInstance-1869927250 tempest-TestShelveInstance-1869927250-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:26:46.255467 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-7fa5f717-2929-473c-8a43-03d16ec805c6 tempest-TestShelveInstance-1869927250 tempest-TestShelveInstance-1869927250-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:26:46.256305 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-7fa5f717-2929-473c-8a43-03d16ec805c6 tempest-TestShelveInstance-1869927250 tempest-TestShelveInstance-1869927250-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:26:46.256663 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-7fa5f717-2929-473c-8a43-03d16ec805c6 tempest-TestShelveInstance-1869927250 tempest-TestShelveInstance-1869927250-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:26:46.269810 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-e9bf09be-c0cc-4e3d-9530-28e88c5cc0ce tempest-TestMinimumBasicScenario-1602759881 tempest-TestMinimumBasicScenario-1602759881-project] Calling method '>' {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:26:46.271235 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.compute.api [None req-e9bf09be-c0cc-4e3d-9530-28e88c5cc0ce tempest-TestMinimumBasicScenario-1602759881 tempest-TestMinimumBasicScenario-1602759881-project] [instance: 3a9c029c-4daa-4ae2-b624-6d227fd03923] Fetching instance by UUID {{(pid=117873) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:26:46.279403 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-e9bf09be-c0cc-4e3d-9530-28e88c5cc0ce tempest-TestMinimumBasicScenario-1602759881 tempest-TestMinimumBasicScenario-1602759881-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:26:46.280388 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-e9bf09be-c0cc-4e3d-9530-28e88c5cc0ce tempest-TestMinimumBasicScenario-1602759881 tempest-TestMinimumBasicScenario-1602759881-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:26:46.281413 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-e9bf09be-c0cc-4e3d-9530-28e88c5cc0ce tempest-TestMinimumBasicScenario-1602759881 tempest-TestMinimumBasicScenario-1602759881-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:26:46.282087 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-e9bf09be-c0cc-4e3d-9530-28e88c5cc0ce tempest-TestMinimumBasicScenario-1602759881 tempest-TestMinimumBasicScenario-1602759881-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:26:46.466675 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.policy [None req-7fa5f717-2929-473c-8a43-03d16ec805c6 tempest-TestShelveInstance-1869927250 tempest-TestShelveInstance-1869927250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6428e56cd9b46feb6a7b04e4d00c162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa9a1da5cb5a4279abb88ec7bdb1ef6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117874) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:26:46.475147 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [None req-7fa5f717-2929-473c-8a43-03d16ec805c6 tempest-TestShelveInstance-1869927250 tempest-TestShelveInstance-1869927250-project] 10.222.0.43 "GET /compute/v2.1/servers/46804c86-520a-407d-84a9-2f6d1ea1cff0" status: 200 len: 1575 microversion: 2.1 time: 0.231826 Jun 22 10:26:46.482045 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 498/988] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:26:46 2022] GET /compute/v2.1/servers/46804c86-520a-407d-84a9-2f6d1ea1cff0 => generated 1575 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:26:46.506711 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.policy [None req-e9bf09be-c0cc-4e3d-9530-28e88c5cc0ce tempest-TestMinimumBasicScenario-1602759881 tempest-TestMinimumBasicScenario-1602759881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21a35a18c4d74109ac1dacc120bbe0fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4d8e96d47af4667a2f478e6561353d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117873) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:26:46.515233 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [None req-e9bf09be-c0cc-4e3d-9530-28e88c5cc0ce tempest-TestMinimumBasicScenario-1602759881 tempest-TestMinimumBasicScenario-1602759881-project] 10.222.0.43 "GET /compute/v2.1/servers/3a9c029c-4daa-4ae2-b624-6d227fd03923" status: 200 len: 1359 microversion: 2.1 time: 0.250748 Jun 22 10:26:46.515839 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 491/989] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:26:46 2022] GET /compute/v2.1/servers/3a9c029c-4daa-4ae2-b624-6d227fd03923 => generated 1359 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 10:26:46.841287 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [req-82dd6e5c-ec43-4b61-8d71-8a0141255cb5 req-d5122d91-3c2d-46e9-a0b8-bc317248da21 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3a9c029c-4daa-4ae2-b624-6d227fd03923", "tag": "36a8b53c-154d-40ba-acfc-8a025c723d78"}]} {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:26:46.850919 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [req-82dd6e5c-ec43-4b61-8d71-8a0141255cb5 req-d5122d91-3c2d-46e9-a0b8-bc317248da21 service nova] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:26:46.851293 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [req-82dd6e5c-ec43-4b61-8d71-8a0141255cb5 req-d5122d91-3c2d-46e9-a0b8-bc317248da21 service nova] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:26:46.863940 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.compute.server_external_events [req-82dd6e5c-ec43-4b61-8d71-8a0141255cb5 req-d5122d91-3c2d-46e9-a0b8-bc317248da21 service nova] Creating event network-changed:36a8b53c-154d-40ba-acfc-8a025c723d78 for instance 3a9c029c-4daa-4ae2-b624-6d227fd03923 on hv-cinder-84713 Jun 22 10:26:46.870864 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [req-82dd6e5c-ec43-4b61-8d71-8a0141255cb5 req-d5122d91-3c2d-46e9-a0b8-bc317248da21 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034482 Jun 22 10:26:46.871473 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 499/990] 10.222.0.43 () {64 vars in 1317 bytes} [Wed Jun 22 10:26:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 10:26:47.492301 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-26e56b1d-a985-4ad1-b6e3-892c270aa780 tempest-TestShelveInstance-1869927250 tempest-TestShelveInstance-1869927250-project] Calling method '>' {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:26:47.492843 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.compute.api [None req-26e56b1d-a985-4ad1-b6e3-892c270aa780 tempest-TestShelveInstance-1869927250 tempest-TestShelveInstance-1869927250-project] [instance: 46804c86-520a-407d-84a9-2f6d1ea1cff0] Fetching instance by UUID {{(pid=117873) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:26:47.500427 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-26e56b1d-a985-4ad1-b6e3-892c270aa780 tempest-TestShelveInstance-1869927250 tempest-TestShelveInstance-1869927250-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:26:47.500872 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-26e56b1d-a985-4ad1-b6e3-892c270aa780 tempest-TestShelveInstance-1869927250 tempest-TestShelveInstance-1869927250-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:26:47.501636 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-26e56b1d-a985-4ad1-b6e3-892c270aa780 tempest-TestShelveInstance-1869927250 tempest-TestShelveInstance-1869927250-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:26:47.502094 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-26e56b1d-a985-4ad1-b6e3-892c270aa780 tempest-TestShelveInstance-1869927250 tempest-TestShelveInstance-1869927250-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:26:47.533306 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-d038c14c-7563-45db-8404-9d9102b673b3 tempest-TestMinimumBasicScenario-1602759881 tempest-TestMinimumBasicScenario-1602759881-project] Calling method '>' {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:26:47.534025 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.compute.api [None req-d038c14c-7563-45db-8404-9d9102b673b3 tempest-TestMinimumBasicScenario-1602759881 tempest-TestMinimumBasicScenario-1602759881-project] [instance: 3a9c029c-4daa-4ae2-b624-6d227fd03923] Fetching instance by UUID {{(pid=117874) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:26:47.541001 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-d038c14c-7563-45db-8404-9d9102b673b3 tempest-TestMinimumBasicScenario-1602759881 tempest-TestMinimumBasicScenario-1602759881-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:26:47.541444 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-d038c14c-7563-45db-8404-9d9102b673b3 tempest-TestMinimumBasicScenario-1602759881 tempest-TestMinimumBasicScenario-1602759881-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:26:47.542239 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-d038c14c-7563-45db-8404-9d9102b673b3 tempest-TestMinimumBasicScenario-1602759881 tempest-TestMinimumBasicScenario-1602759881-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:26:47.542671 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-d038c14c-7563-45db-8404-9d9102b673b3 tempest-TestMinimumBasicScenario-1602759881 tempest-TestMinimumBasicScenario-1602759881-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:26:47.692464 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.policy [None req-26e56b1d-a985-4ad1-b6e3-892c270aa780 tempest-TestShelveInstance-1869927250 tempest-TestShelveInstance-1869927250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6428e56cd9b46feb6a7b04e4d00c162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa9a1da5cb5a4279abb88ec7bdb1ef6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117873) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:26:47.700305 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [None req-26e56b1d-a985-4ad1-b6e3-892c270aa780 tempest-TestShelveInstance-1869927250 tempest-TestShelveInstance-1869927250-project] 10.222.0.43 "GET /compute/v2.1/servers/46804c86-520a-407d-84a9-2f6d1ea1cff0" status: 200 len: 1562 microversion: 2.1 time: 0.211880 Jun 22 10:26:47.700980 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 492/991] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:26:47 2022] GET /compute/v2.1/servers/46804c86-520a-407d-84a9-2f6d1ea1cff0 => generated 1562 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:26:47.726242 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.policy [None req-d038c14c-7563-45db-8404-9d9102b673b3 tempest-TestMinimumBasicScenario-1602759881 tempest-TestMinimumBasicScenario-1602759881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21a35a18c4d74109ac1dacc120bbe0fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4d8e96d47af4667a2f478e6561353d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117874) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:26:47.735323 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [None req-d038c14c-7563-45db-8404-9d9102b673b3 tempest-TestMinimumBasicScenario-1602759881 tempest-TestMinimumBasicScenario-1602759881-project] 10.222.0.43 "GET /compute/v2.1/servers/3a9c029c-4daa-4ae2-b624-6d227fd03923" status: 200 len: 1359 microversion: 2.1 time: 0.206578 Jun 22 10:26:47.736071 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 500/992] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:26:47 2022] GET /compute/v2.1/servers/3a9c029c-4daa-4ae2-b624-6d227fd03923 => generated 1359 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 10:26:48.752209 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-9917ab1d-1430-497d-a086-27fb019a9245 tempest-TestMinimumBasicScenario-1602759881 tempest-TestMinimumBasicScenario-1602759881-project] Calling method '>' {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:26:48.752813 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.compute.api [None req-9917ab1d-1430-497d-a086-27fb019a9245 tempest-TestMinimumBasicScenario-1602759881 tempest-TestMinimumBasicScenario-1602759881-project] [instance: 3a9c029c-4daa-4ae2-b624-6d227fd03923] Fetching instance by UUID {{(pid=117873) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:26:48.759315 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-9917ab1d-1430-497d-a086-27fb019a9245 tempest-TestMinimumBasicScenario-1602759881 tempest-TestMinimumBasicScenario-1602759881-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:26:48.760260 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-9917ab1d-1430-497d-a086-27fb019a9245 tempest-TestMinimumBasicScenario-1602759881 tempest-TestMinimumBasicScenario-1602759881-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:26:48.761017 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-9917ab1d-1430-497d-a086-27fb019a9245 tempest-TestMinimumBasicScenario-1602759881 tempest-TestMinimumBasicScenario-1602759881-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:26:48.761451 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-9917ab1d-1430-497d-a086-27fb019a9245 tempest-TestMinimumBasicScenario-1602759881 tempest-TestMinimumBasicScenario-1602759881-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:26:48.887672 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.policy [None req-9917ab1d-1430-497d-a086-27fb019a9245 tempest-TestMinimumBasicScenario-1602759881 tempest-TestMinimumBasicScenario-1602759881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21a35a18c4d74109ac1dacc120bbe0fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4d8e96d47af4667a2f478e6561353d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117873) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:26:48.894986 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [None req-9917ab1d-1430-497d-a086-27fb019a9245 tempest-TestMinimumBasicScenario-1602759881 tempest-TestMinimumBasicScenario-1602759881-project] 10.222.0.43 "GET /compute/v2.1/servers/3a9c029c-4daa-4ae2-b624-6d227fd03923" status: 200 len: 1359 microversion: 2.1 time: 0.146768 Jun 22 10:26:48.895569 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 493/993] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:26:48 2022] GET /compute/v2.1/servers/3a9c029c-4daa-4ae2-b624-6d227fd03923 => generated 1359 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:26:49.912268 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-e083ac7e-4051-44e0-ab1d-f2ef2a7afb8e tempest-TestMinimumBasicScenario-1602759881 tempest-TestMinimumBasicScenario-1602759881-project] Calling method '>' {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:26:49.912878 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.compute.api [None req-e083ac7e-4051-44e0-ab1d-f2ef2a7afb8e tempest-TestMinimumBasicScenario-1602759881 tempest-TestMinimumBasicScenario-1602759881-project] [instance: 3a9c029c-4daa-4ae2-b624-6d227fd03923] Fetching instance by UUID {{(pid=117874) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:26:49.921131 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-e083ac7e-4051-44e0-ab1d-f2ef2a7afb8e tempest-TestMinimumBasicScenario-1602759881 tempest-TestMinimumBasicScenario-1602759881-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:26:49.921587 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-e083ac7e-4051-44e0-ab1d-f2ef2a7afb8e tempest-TestMinimumBasicScenario-1602759881 tempest-TestMinimumBasicScenario-1602759881-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:26:49.922386 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-e083ac7e-4051-44e0-ab1d-f2ef2a7afb8e tempest-TestMinimumBasicScenario-1602759881 tempest-TestMinimumBasicScenario-1602759881-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:26:49.922822 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-e083ac7e-4051-44e0-ab1d-f2ef2a7afb8e tempest-TestMinimumBasicScenario-1602759881 tempest-TestMinimumBasicScenario-1602759881-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:26:50.053595 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.policy [None req-e083ac7e-4051-44e0-ab1d-f2ef2a7afb8e tempest-TestMinimumBasicScenario-1602759881 tempest-TestMinimumBasicScenario-1602759881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21a35a18c4d74109ac1dacc120bbe0fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4d8e96d47af4667a2f478e6561353d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117874) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:26:50.061143 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [None req-e083ac7e-4051-44e0-ab1d-f2ef2a7afb8e tempest-TestMinimumBasicScenario-1602759881 tempest-TestMinimumBasicScenario-1602759881-project] 10.222.0.43 "GET /compute/v2.1/servers/3a9c029c-4daa-4ae2-b624-6d227fd03923" status: 200 len: 1359 microversion: 2.1 time: 0.152734 Jun 22 10:26:50.061711 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 501/994] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:26:49 2022] GET /compute/v2.1/servers/3a9c029c-4daa-4ae2-b624-6d227fd03923 => generated 1359 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:26:51.078327 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-1fce1e70-9cf8-4d7e-8793-2862afce684d tempest-TestMinimumBasicScenario-1602759881 tempest-TestMinimumBasicScenario-1602759881-project] Calling method '>' {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:26:51.078936 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.compute.api [None req-1fce1e70-9cf8-4d7e-8793-2862afce684d tempest-TestMinimumBasicScenario-1602759881 tempest-TestMinimumBasicScenario-1602759881-project] [instance: 3a9c029c-4daa-4ae2-b624-6d227fd03923] Fetching instance by UUID {{(pid=117873) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:26:51.085486 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-1fce1e70-9cf8-4d7e-8793-2862afce684d tempest-TestMinimumBasicScenario-1602759881 tempest-TestMinimumBasicScenario-1602759881-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:26:51.085961 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-1fce1e70-9cf8-4d7e-8793-2862afce684d tempest-TestMinimumBasicScenario-1602759881 tempest-TestMinimumBasicScenario-1602759881-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:26:51.086722 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-1fce1e70-9cf8-4d7e-8793-2862afce684d tempest-TestMinimumBasicScenario-1602759881 tempest-TestMinimumBasicScenario-1602759881-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:26:51.087237 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-1fce1e70-9cf8-4d7e-8793-2862afce684d tempest-TestMinimumBasicScenario-1602759881 tempest-TestMinimumBasicScenario-1602759881-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:26:51.217876 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.policy [None req-1fce1e70-9cf8-4d7e-8793-2862afce684d tempest-TestMinimumBasicScenario-1602759881 tempest-TestMinimumBasicScenario-1602759881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21a35a18c4d74109ac1dacc120bbe0fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4d8e96d47af4667a2f478e6561353d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117873) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:26:51.225435 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [None req-1fce1e70-9cf8-4d7e-8793-2862afce684d tempest-TestMinimumBasicScenario-1602759881 tempest-TestMinimumBasicScenario-1602759881-project] 10.222.0.43 "GET /compute/v2.1/servers/3a9c029c-4daa-4ae2-b624-6d227fd03923" status: 200 len: 1359 microversion: 2.1 time: 0.150969 Jun 22 10:26:51.226018 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 494/995] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:26:51 2022] GET /compute/v2.1/servers/3a9c029c-4daa-4ae2-b624-6d227fd03923 => generated 1359 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:26:52.243053 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-66ad6118-7815-4144-88a6-b975d4811b5b tempest-TestMinimumBasicScenario-1602759881 tempest-TestMinimumBasicScenario-1602759881-project] Calling method '>' {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:26:52.244156 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.compute.api [None req-66ad6118-7815-4144-88a6-b975d4811b5b tempest-TestMinimumBasicScenario-1602759881 tempest-TestMinimumBasicScenario-1602759881-project] [instance: 3a9c029c-4daa-4ae2-b624-6d227fd03923] Fetching instance by UUID {{(pid=117874) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:26:52.250429 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-66ad6118-7815-4144-88a6-b975d4811b5b tempest-TestMinimumBasicScenario-1602759881 tempest-TestMinimumBasicScenario-1602759881-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:26:52.250870 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-66ad6118-7815-4144-88a6-b975d4811b5b tempest-TestMinimumBasicScenario-1602759881 tempest-TestMinimumBasicScenario-1602759881-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:26:52.251613 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-66ad6118-7815-4144-88a6-b975d4811b5b tempest-TestMinimumBasicScenario-1602759881 tempest-TestMinimumBasicScenario-1602759881-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:26:52.252041 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-66ad6118-7815-4144-88a6-b975d4811b5b tempest-TestMinimumBasicScenario-1602759881 tempest-TestMinimumBasicScenario-1602759881-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:26:52.381131 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.policy [None req-66ad6118-7815-4144-88a6-b975d4811b5b tempest-TestMinimumBasicScenario-1602759881 tempest-TestMinimumBasicScenario-1602759881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21a35a18c4d74109ac1dacc120bbe0fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4d8e96d47af4667a2f478e6561353d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117874) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:26:52.389343 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [None req-66ad6118-7815-4144-88a6-b975d4811b5b tempest-TestMinimumBasicScenario-1602759881 tempest-TestMinimumBasicScenario-1602759881-project] 10.222.0.43 "GET /compute/v2.1/servers/3a9c029c-4daa-4ae2-b624-6d227fd03923" status: 200 len: 1359 microversion: 2.1 time: 0.150320 Jun 22 10:26:52.389998 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 502/996] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:26:52 2022] GET /compute/v2.1/servers/3a9c029c-4daa-4ae2-b624-6d227fd03923 => generated 1359 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:26:53.406472 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-b853352b-7fd9-4484-a7f4-c043a2b6629c tempest-TestMinimumBasicScenario-1602759881 tempest-TestMinimumBasicScenario-1602759881-project] Calling method '>' {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:26:53.407020 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.compute.api [None req-b853352b-7fd9-4484-a7f4-c043a2b6629c tempest-TestMinimumBasicScenario-1602759881 tempest-TestMinimumBasicScenario-1602759881-project] [instance: 3a9c029c-4daa-4ae2-b624-6d227fd03923] Fetching instance by UUID {{(pid=117873) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:26:53.413437 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-b853352b-7fd9-4484-a7f4-c043a2b6629c tempest-TestMinimumBasicScenario-1602759881 tempest-TestMinimumBasicScenario-1602759881-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:26:53.413913 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-b853352b-7fd9-4484-a7f4-c043a2b6629c tempest-TestMinimumBasicScenario-1602759881 tempest-TestMinimumBasicScenario-1602759881-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:26:53.414669 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-b853352b-7fd9-4484-a7f4-c043a2b6629c tempest-TestMinimumBasicScenario-1602759881 tempest-TestMinimumBasicScenario-1602759881-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:26:53.416096 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-b853352b-7fd9-4484-a7f4-c043a2b6629c tempest-TestMinimumBasicScenario-1602759881 tempest-TestMinimumBasicScenario-1602759881-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:26:53.544032 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.policy [None req-b853352b-7fd9-4484-a7f4-c043a2b6629c tempest-TestMinimumBasicScenario-1602759881 tempest-TestMinimumBasicScenario-1602759881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21a35a18c4d74109ac1dacc120bbe0fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4d8e96d47af4667a2f478e6561353d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117873) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:26:53.551483 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [None req-b853352b-7fd9-4484-a7f4-c043a2b6629c tempest-TestMinimumBasicScenario-1602759881 tempest-TestMinimumBasicScenario-1602759881-project] 10.222.0.43 "GET /compute/v2.1/servers/3a9c029c-4daa-4ae2-b624-6d227fd03923" status: 200 len: 1359 microversion: 2.1 time: 0.148977 Jun 22 10:26:53.552059 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 495/997] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:26:53 2022] GET /compute/v2.1/servers/3a9c029c-4daa-4ae2-b624-6d227fd03923 => generated 1359 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:26:54.491758 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [req-16400ad9-8cbe-4bf1-bd20-8f71ed6dd7e2 req-e57a3325-b4c7-4c24-b522-8fb8e6238749 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3a9c029c-4daa-4ae2-b624-6d227fd03923", "name": "network-vif-plugged", "status": "completed", "tag": "36a8b53c-154d-40ba-acfc-8a025c723d78"}]} {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:26:54.501109 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [req-16400ad9-8cbe-4bf1-bd20-8f71ed6dd7e2 req-e57a3325-b4c7-4c24-b522-8fb8e6238749 service nova] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:26:54.501531 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [req-16400ad9-8cbe-4bf1-bd20-8f71ed6dd7e2 req-e57a3325-b4c7-4c24-b522-8fb8e6238749 service nova] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:26:54.513376 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.compute.server_external_events [req-16400ad9-8cbe-4bf1-bd20-8f71ed6dd7e2 req-e57a3325-b4c7-4c24-b522-8fb8e6238749 service nova] Creating event network-vif-plugged:36a8b53c-154d-40ba-acfc-8a025c723d78 for instance 3a9c029c-4daa-4ae2-b624-6d227fd03923 on hv-cinder-84713 Jun 22 10:26:54.518380 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [req-16400ad9-8cbe-4bf1-bd20-8f71ed6dd7e2 req-e57a3325-b4c7-4c24-b522-8fb8e6238749 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030373 Jun 22 10:26:54.518971 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 503/998] 10.222.0.43 () {64 vars in 1317 bytes} [Wed Jun 22 10:26:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 10:26:54.569483 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-ba63dc05-b425-4135-93ec-81a00f77197c tempest-TestMinimumBasicScenario-1602759881 tempest-TestMinimumBasicScenario-1602759881-project] Calling method '>' {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:26:54.570320 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.compute.api [None req-ba63dc05-b425-4135-93ec-81a00f77197c tempest-TestMinimumBasicScenario-1602759881 tempest-TestMinimumBasicScenario-1602759881-project] [instance: 3a9c029c-4daa-4ae2-b624-6d227fd03923] Fetching instance by UUID {{(pid=117873) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:26:54.580365 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-ba63dc05-b425-4135-93ec-81a00f77197c tempest-TestMinimumBasicScenario-1602759881 tempest-TestMinimumBasicScenario-1602759881-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:26:54.581037 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-ba63dc05-b425-4135-93ec-81a00f77197c tempest-TestMinimumBasicScenario-1602759881 tempest-TestMinimumBasicScenario-1602759881-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:26:54.582237 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-ba63dc05-b425-4135-93ec-81a00f77197c tempest-TestMinimumBasicScenario-1602759881 tempest-TestMinimumBasicScenario-1602759881-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:26:54.582926 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-ba63dc05-b425-4135-93ec-81a00f77197c tempest-TestMinimumBasicScenario-1602759881 tempest-TestMinimumBasicScenario-1602759881-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:26:54.732161 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.policy [None req-ba63dc05-b425-4135-93ec-81a00f77197c tempest-TestMinimumBasicScenario-1602759881 tempest-TestMinimumBasicScenario-1602759881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21a35a18c4d74109ac1dacc120bbe0fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4d8e96d47af4667a2f478e6561353d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117873) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:26:54.739547 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [None req-ba63dc05-b425-4135-93ec-81a00f77197c tempest-TestMinimumBasicScenario-1602759881 tempest-TestMinimumBasicScenario-1602759881-project] 10.222.0.43 "GET /compute/v2.1/servers/3a9c029c-4daa-4ae2-b624-6d227fd03923" status: 200 len: 1359 microversion: 2.1 time: 0.175110 Jun 22 10:26:54.740112 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 496/999] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:26:54 2022] GET /compute/v2.1/servers/3a9c029c-4daa-4ae2-b624-6d227fd03923 => generated 1359 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 10:26:55.756668 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-eaef39cc-cfdb-4682-822d-d64cffbbb079 tempest-TestMinimumBasicScenario-1602759881 tempest-TestMinimumBasicScenario-1602759881-project] Calling method '>' {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:26:55.757362 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.compute.api [None req-eaef39cc-cfdb-4682-822d-d64cffbbb079 tempest-TestMinimumBasicScenario-1602759881 tempest-TestMinimumBasicScenario-1602759881-project] [instance: 3a9c029c-4daa-4ae2-b624-6d227fd03923] Fetching instance by UUID {{(pid=117874) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:26:55.765350 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-eaef39cc-cfdb-4682-822d-d64cffbbb079 tempest-TestMinimumBasicScenario-1602759881 tempest-TestMinimumBasicScenario-1602759881-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:26:55.765823 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-eaef39cc-cfdb-4682-822d-d64cffbbb079 tempest-TestMinimumBasicScenario-1602759881 tempest-TestMinimumBasicScenario-1602759881-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:26:55.766588 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-eaef39cc-cfdb-4682-822d-d64cffbbb079 tempest-TestMinimumBasicScenario-1602759881 tempest-TestMinimumBasicScenario-1602759881-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:26:55.767022 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-eaef39cc-cfdb-4682-822d-d64cffbbb079 tempest-TestMinimumBasicScenario-1602759881 tempest-TestMinimumBasicScenario-1602759881-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:26:56.079420 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.policy [None req-eaef39cc-cfdb-4682-822d-d64cffbbb079 tempest-TestMinimumBasicScenario-1602759881 tempest-TestMinimumBasicScenario-1602759881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21a35a18c4d74109ac1dacc120bbe0fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4d8e96d47af4667a2f478e6561353d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117874) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:26:56.086899 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [None req-eaef39cc-cfdb-4682-822d-d64cffbbb079 tempest-TestMinimumBasicScenario-1602759881 tempest-TestMinimumBasicScenario-1602759881-project] 10.222.0.43 "GET /compute/v2.1/servers/3a9c029c-4daa-4ae2-b624-6d227fd03923" status: 200 len: 1359 microversion: 2.1 time: 0.334471 Jun 22 10:26:56.088202 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 504/1000] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:26:55 2022] GET /compute/v2.1/servers/3a9c029c-4daa-4ae2-b624-6d227fd03923 => generated 1359 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:26:56.290546 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-e16bccc4-c35a-431a-89b9-d49e9b848e33 tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] Calling method '>' {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:26:56.291064 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.compute.api [None req-e16bccc4-c35a-431a-89b9-d49e9b848e33 tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] [instance: 8d4bd5f5-1caa-4165-a7d3-73f338df3073] Fetching instance by UUID {{(pid=117873) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:26:56.298110 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-e16bccc4-c35a-431a-89b9-d49e9b848e33 tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:26:56.298835 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-e16bccc4-c35a-431a-89b9-d49e9b848e33 tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:26:56.299141 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [req-e8cf9878-bebf-4d38-bac1-333e0a4184f4 req-f4dbe129-ff62-4550-b25f-7ff25bd81993 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8d4bd5f5-1caa-4165-a7d3-73f338df3073", "tag": "fe534632-1c33-4794-bbcb-a54d9a87fefd"}]} {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:26:56.299744 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-e16bccc4-c35a-431a-89b9-d49e9b848e33 tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:26:56.300210 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-e16bccc4-c35a-431a-89b9-d49e9b848e33 tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:26:56.307110 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [req-e8cf9878-bebf-4d38-bac1-333e0a4184f4 req-f4dbe129-ff62-4550-b25f-7ff25bd81993 service nova] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:26:56.307551 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [req-e8cf9878-bebf-4d38-bac1-333e0a4184f4 req-f4dbe129-ff62-4550-b25f-7ff25bd81993 service nova] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:26:56.318557 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.compute.server_external_events [req-e8cf9878-bebf-4d38-bac1-333e0a4184f4 req-f4dbe129-ff62-4550-b25f-7ff25bd81993 service nova] Creating event network-changed:fe534632-1c33-4794-bbcb-a54d9a87fefd for instance 8d4bd5f5-1caa-4165-a7d3-73f338df3073 on hv-cinder-84713 Jun 22 10:26:56.324241 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [req-e8cf9878-bebf-4d38-bac1-333e0a4184f4 req-f4dbe129-ff62-4550-b25f-7ff25bd81993 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028624 Jun 22 10:26:56.324846 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 505/1001] 10.222.0.43 () {64 vars in 1317 bytes} [Wed Jun 22 10:26:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 10:26:56.329342 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.compute.api [None req-e16bccc4-c35a-431a-89b9-d49e9b848e33 tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] [instance: 8d4bd5f5-1caa-4165-a7d3-73f338df3073] Going to try to terminate instance {{(pid=117873) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 22 10:26:56.416302 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [None req-e16bccc4-c35a-431a-89b9-d49e9b848e33 tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] 10.222.0.43 "DELETE /compute/v2.1/servers/8d4bd5f5-1caa-4165-a7d3-73f338df3073" status: 204 len: 0 microversion: 2.1 time: 0.128934 Jun 22 10:26:56.417018 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 497/1002] 10.222.0.43 () {58 vars in 1238 bytes} [Wed Jun 22 10:26:56 2022] DELETE /compute/v2.1/servers/8d4bd5f5-1caa-4165-a7d3-73f338df3073 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 22 10:26:56.426453 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-1c53aa1b-33c8-4b63-a7d5-87385cc89419 tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] Calling method '>' {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:26:56.427351 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.compute.api [None req-1c53aa1b-33c8-4b63-a7d5-87385cc89419 tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] [instance: 8d4bd5f5-1caa-4165-a7d3-73f338df3073] Fetching instance by UUID {{(pid=117874) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:26:56.446161 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-1c53aa1b-33c8-4b63-a7d5-87385cc89419 tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:26:56.446161 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-1c53aa1b-33c8-4b63-a7d5-87385cc89419 tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:26:56.446938 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-1c53aa1b-33c8-4b63-a7d5-87385cc89419 tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:26:56.447469 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-1c53aa1b-33c8-4b63-a7d5-87385cc89419 tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:26:56.603539 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.policy [None req-1c53aa1b-33c8-4b63-a7d5-87385cc89419 tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2d3aa18a0a146808f584127411a1cf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1af845e594466b12a11b7cab99a7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117874) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:26:56.611855 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [None req-1c53aa1b-33c8-4b63-a7d5-87385cc89419 tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] 10.222.0.43 "GET /compute/v2.1/servers/8d4bd5f5-1caa-4165-a7d3-73f338df3073" status: 200 len: 1578 microversion: 2.1 time: 0.190137 Jun 22 10:26:56.612436 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 506/1003] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:26:56 2022] GET /compute/v2.1/servers/8d4bd5f5-1caa-4165-a7d3-73f338df3073 => generated 1578 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:26:57.106666 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-7a30c654-da66-4cb1-9483-1eaba771cdd4 tempest-TestMinimumBasicScenario-1602759881 tempest-TestMinimumBasicScenario-1602759881-project] Calling method '>' {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:26:57.106900 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.compute.api [None req-7a30c654-da66-4cb1-9483-1eaba771cdd4 tempest-TestMinimumBasicScenario-1602759881 tempest-TestMinimumBasicScenario-1602759881-project] [instance: 3a9c029c-4daa-4ae2-b624-6d227fd03923] Fetching instance by UUID {{(pid=117873) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:26:57.113225 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-7a30c654-da66-4cb1-9483-1eaba771cdd4 tempest-TestMinimumBasicScenario-1602759881 tempest-TestMinimumBasicScenario-1602759881-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:26:57.113720 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-7a30c654-da66-4cb1-9483-1eaba771cdd4 tempest-TestMinimumBasicScenario-1602759881 tempest-TestMinimumBasicScenario-1602759881-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:26:57.114488 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-7a30c654-da66-4cb1-9483-1eaba771cdd4 tempest-TestMinimumBasicScenario-1602759881 tempest-TestMinimumBasicScenario-1602759881-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:26:57.114918 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-7a30c654-da66-4cb1-9483-1eaba771cdd4 tempest-TestMinimumBasicScenario-1602759881 tempest-TestMinimumBasicScenario-1602759881-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:26:57.261493 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.policy [None req-7a30c654-da66-4cb1-9483-1eaba771cdd4 tempest-TestMinimumBasicScenario-1602759881 tempest-TestMinimumBasicScenario-1602759881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21a35a18c4d74109ac1dacc120bbe0fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4d8e96d47af4667a2f478e6561353d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117873) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:26:57.269381 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [None req-7a30c654-da66-4cb1-9483-1eaba771cdd4 tempest-TestMinimumBasicScenario-1602759881 tempest-TestMinimumBasicScenario-1602759881-project] 10.222.0.43 "GET /compute/v2.1/servers/3a9c029c-4daa-4ae2-b624-6d227fd03923" status: 200 len: 1550 microversion: 2.1 time: 0.168451 Jun 22 10:26:57.269990 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 498/1004] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:26:57 2022] GET /compute/v2.1/servers/3a9c029c-4daa-4ae2-b624-6d227fd03923 => generated 1550 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:26:57.286545 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-102ff60e-3556-4e78-aeca-48e7205dbde3 tempest-TestMinimumBasicScenario-1602759881 tempest-TestMinimumBasicScenario-1602759881-project] Calling method '>' {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:26:57.287063 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.compute.api [None req-102ff60e-3556-4e78-aeca-48e7205dbde3 tempest-TestMinimumBasicScenario-1602759881 tempest-TestMinimumBasicScenario-1602759881-project] [instance: 3a9c029c-4daa-4ae2-b624-6d227fd03923] Fetching instance by UUID {{(pid=117874) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:26:57.294301 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-102ff60e-3556-4e78-aeca-48e7205dbde3 tempest-TestMinimumBasicScenario-1602759881 tempest-TestMinimumBasicScenario-1602759881-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:26:57.294748 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-102ff60e-3556-4e78-aeca-48e7205dbde3 tempest-TestMinimumBasicScenario-1602759881 tempest-TestMinimumBasicScenario-1602759881-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:26:57.295504 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-102ff60e-3556-4e78-aeca-48e7205dbde3 tempest-TestMinimumBasicScenario-1602759881 tempest-TestMinimumBasicScenario-1602759881-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:26:57.295938 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-102ff60e-3556-4e78-aeca-48e7205dbde3 tempest-TestMinimumBasicScenario-1602759881 tempest-TestMinimumBasicScenario-1602759881-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:26:57.426759 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.policy [None req-102ff60e-3556-4e78-aeca-48e7205dbde3 tempest-TestMinimumBasicScenario-1602759881 tempest-TestMinimumBasicScenario-1602759881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21a35a18c4d74109ac1dacc120bbe0fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4d8e96d47af4667a2f478e6561353d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117874) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:26:57.435302 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [None req-102ff60e-3556-4e78-aeca-48e7205dbde3 tempest-TestMinimumBasicScenario-1602759881 tempest-TestMinimumBasicScenario-1602759881-project] 10.222.0.43 "GET /compute/v2.1/servers/3a9c029c-4daa-4ae2-b624-6d227fd03923" status: 200 len: 1550 microversion: 2.1 time: 0.152618 Jun 22 10:26:57.435895 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 507/1005] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:26:57 2022] GET /compute/v2.1/servers/3a9c029c-4daa-4ae2-b624-6d227fd03923 => generated 1550 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:26:57.451699 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-693d045d-956c-46db-9dad-1070d85347ac tempest-TestMinimumBasicScenario-1602759881 tempest-TestMinimumBasicScenario-1602759881-project] Calling method '>' {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:26:57.455185 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.policy [None req-693d045d-956c-46db-9dad-1070d85347ac tempest-TestMinimumBasicScenario-1602759881 tempest-TestMinimumBasicScenario-1602759881-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '21a35a18c4d74109ac1dacc120bbe0fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4d8e96d47af4667a2f478e6561353d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117873) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:26:57.455961 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.compute.api [None req-693d045d-956c-46db-9dad-1070d85347ac tempest-TestMinimumBasicScenario-1602759881 tempest-TestMinimumBasicScenario-1602759881-project] Searching by: {'deleted': False, 'project_id': 'f4d8e96d47af4667a2f478e6561353d4'} {{(pid=117873) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jun 22 10:26:57.463515 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-693d045d-956c-46db-9dad-1070d85347ac tempest-TestMinimumBasicScenario-1602759881 tempest-TestMinimumBasicScenario-1602759881-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:26:57.463962 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-693d045d-956c-46db-9dad-1070d85347ac tempest-TestMinimumBasicScenario-1602759881 tempest-TestMinimumBasicScenario-1602759881-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:26:57.464758 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-693d045d-956c-46db-9dad-1070d85347ac tempest-TestMinimumBasicScenario-1602759881 tempest-TestMinimumBasicScenario-1602759881-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:26:57.465193 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-693d045d-956c-46db-9dad-1070d85347ac tempest-TestMinimumBasicScenario-1602759881 tempest-TestMinimumBasicScenario-1602759881-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:26:57.558482 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.compute.multi_cell_list [None req-693d045d-956c-46db-9dad-1070d85347ac tempest-TestMinimumBasicScenario-1602759881 tempest-TestMinimumBasicScenario-1602759881-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=117873) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jun 22 10:26:57.629558 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-94d03b67-1c02-4867-b5c9-b2b06df00fa6 tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] Calling method '>' {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:26:57.630217 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.compute.api [None req-94d03b67-1c02-4867-b5c9-b2b06df00fa6 tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] [instance: 8d4bd5f5-1caa-4165-a7d3-73f338df3073] Fetching instance by UUID {{(pid=117874) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:26:57.636454 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-94d03b67-1c02-4867-b5c9-b2b06df00fa6 tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:26:57.636903 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-94d03b67-1c02-4867-b5c9-b2b06df00fa6 tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:26:57.637672 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-94d03b67-1c02-4867-b5c9-b2b06df00fa6 tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:26:57.638136 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-94d03b67-1c02-4867-b5c9-b2b06df00fa6 tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:26:57.654018 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [None req-693d045d-956c-46db-9dad-1070d85347ac tempest-TestMinimumBasicScenario-1602759881 tempest-TestMinimumBasicScenario-1602759881-project] 10.222.0.43 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.206409 Jun 22 10:26:57.654855 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 499/1006] 10.222.0.43 () {58 vars in 1124 bytes} [Wed Jun 22 10:26:57 2022] GET /compute/v2.1/servers => generated 343 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 22 10:26:57.664757 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-78d8c310-ada3-4e5d-b4c3-ab570f904230 tempest-TestMinimumBasicScenario-1602759881 tempest-TestMinimumBasicScenario-1602759881-project] Calling method '>' {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:26:57.666031 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.compute.api [None req-78d8c310-ada3-4e5d-b4c3-ab570f904230 tempest-TestMinimumBasicScenario-1602759881 tempest-TestMinimumBasicScenario-1602759881-project] [instance: 3a9c029c-4daa-4ae2-b624-6d227fd03923] Fetching instance by UUID {{(pid=117873) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:26:57.671978 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-78d8c310-ada3-4e5d-b4c3-ab570f904230 tempest-TestMinimumBasicScenario-1602759881 tempest-TestMinimumBasicScenario-1602759881-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:26:57.672427 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-78d8c310-ada3-4e5d-b4c3-ab570f904230 tempest-TestMinimumBasicScenario-1602759881 tempest-TestMinimumBasicScenario-1602759881-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:26:57.673224 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-78d8c310-ada3-4e5d-b4c3-ab570f904230 tempest-TestMinimumBasicScenario-1602759881 tempest-TestMinimumBasicScenario-1602759881-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:26:57.673662 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-78d8c310-ada3-4e5d-b4c3-ab570f904230 tempest-TestMinimumBasicScenario-1602759881 tempest-TestMinimumBasicScenario-1602759881-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:26:57.697553 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG dbcounter [-] [117873] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:26:57.830517 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.policy [None req-94d03b67-1c02-4867-b5c9-b2b06df00fa6 tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2d3aa18a0a146808f584127411a1cf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1af845e594466b12a11b7cab99a7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117874) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:26:57.838489 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [None req-94d03b67-1c02-4867-b5c9-b2b06df00fa6 tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] 10.222.0.43 "GET /compute/v2.1/servers/8d4bd5f5-1caa-4165-a7d3-73f338df3073" status: 200 len: 1578 microversion: 2.1 time: 0.212703 Jun 22 10:26:57.840265 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 508/1007] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:26:57 2022] GET /compute/v2.1/servers/8d4bd5f5-1caa-4165-a7d3-73f338df3073 => generated 1578 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:26:57.861307 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.policy [None req-78d8c310-ada3-4e5d-b4c3-ab570f904230 tempest-TestMinimumBasicScenario-1602759881 tempest-TestMinimumBasicScenario-1602759881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21a35a18c4d74109ac1dacc120bbe0fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4d8e96d47af4667a2f478e6561353d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117873) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:26:57.869407 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [None req-78d8c310-ada3-4e5d-b4c3-ab570f904230 tempest-TestMinimumBasicScenario-1602759881 tempest-TestMinimumBasicScenario-1602759881-project] 10.222.0.43 "GET /compute/v2.1/servers/3a9c029c-4daa-4ae2-b624-6d227fd03923" status: 200 len: 1550 microversion: 2.1 time: 0.208454 Jun 22 10:26:57.870077 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 500/1008] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:26:57 2022] GET /compute/v2.1/servers/3a9c029c-4daa-4ae2-b624-6d227fd03923 => generated 1550 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 10:26:58.730870 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [req-b35748bc-521f-432f-b1d9-c4744bee6cc8 req-053d88b6-0c2b-4678-a869-13ab921f903a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8d4bd5f5-1caa-4165-a7d3-73f338df3073", "name": "network-vif-deleted", "tag": "fe534632-1c33-4794-bbcb-a54d9a87fefd"}]} {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:26:58.739382 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [req-b35748bc-521f-432f-b1d9-c4744bee6cc8 req-053d88b6-0c2b-4678-a869-13ab921f903a service nova] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:26:58.739764 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [req-b35748bc-521f-432f-b1d9-c4744bee6cc8 req-053d88b6-0c2b-4678-a869-13ab921f903a service nova] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:26:58.752732 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.compute.server_external_events [req-b35748bc-521f-432f-b1d9-c4744bee6cc8 req-053d88b6-0c2b-4678-a869-13ab921f903a service nova] Creating event network-vif-deleted:fe534632-1c33-4794-bbcb-a54d9a87fefd for instance 8d4bd5f5-1caa-4165-a7d3-73f338df3073 on hv-cinder-84713 Jun 22 10:26:58.757734 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [req-b35748bc-521f-432f-b1d9-c4744bee6cc8 req-053d88b6-0c2b-4678-a869-13ab921f903a service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031010 Jun 22 10:26:58.758328 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 509/1009] 10.222.0.43 () {64 vars in 1317 bytes} [Wed Jun 22 10:26:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 10:26:58.855505 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-8216355c-d719-4bec-8940-fd176d0062c0 tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] Calling method '>' {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:26:58.856111 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.compute.api [None req-8216355c-d719-4bec-8940-fd176d0062c0 tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] [instance: 8d4bd5f5-1caa-4165-a7d3-73f338df3073] Fetching instance by UUID {{(pid=117873) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:26:58.862622 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-8216355c-d719-4bec-8940-fd176d0062c0 tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:26:58.863062 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-8216355c-d719-4bec-8940-fd176d0062c0 tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:26:58.863813 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-8216355c-d719-4bec-8940-fd176d0062c0 tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:26:58.864244 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-8216355c-d719-4bec-8940-fd176d0062c0 tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:26:58.929599 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.policy [None req-8216355c-d719-4bec-8940-fd176d0062c0 tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2d3aa18a0a146808f584127411a1cf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1af845e594466b12a11b7cab99a7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117873) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:26:58.938825 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [None req-8216355c-d719-4bec-8940-fd176d0062c0 tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] 10.222.0.43 "GET /compute/v2.1/servers/8d4bd5f5-1caa-4165-a7d3-73f338df3073" status: 200 len: 1226 microversion: 2.1 time: 0.087050 Jun 22 10:26:58.939442 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 501/1010] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:26:58 2022] GET /compute/v2.1/servers/8d4bd5f5-1caa-4165-a7d3-73f338df3073 => generated 1226 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:26:59.399664 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-748e33cb-61c9-45d1-a34a-7be6dfd47818 tempest-TestMinimumBasicScenario-1602759881 tempest-TestMinimumBasicScenario-1602759881-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c40d0a6f-d5f0-4df4-ba05-72ca161a71cc"}} {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:26:59.400919 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.compute.api [None req-748e33cb-61c9-45d1-a34a-7be6dfd47818 tempest-TestMinimumBasicScenario-1602759881 tempest-TestMinimumBasicScenario-1602759881-project] [instance: 3a9c029c-4daa-4ae2-b624-6d227fd03923] Fetching instance by UUID {{(pid=117874) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:26:59.407293 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-748e33cb-61c9-45d1-a34a-7be6dfd47818 tempest-TestMinimumBasicScenario-1602759881 tempest-TestMinimumBasicScenario-1602759881-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:26:59.407744 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-748e33cb-61c9-45d1-a34a-7be6dfd47818 tempest-TestMinimumBasicScenario-1602759881 tempest-TestMinimumBasicScenario-1602759881-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:26:59.408500 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-748e33cb-61c9-45d1-a34a-7be6dfd47818 tempest-TestMinimumBasicScenario-1602759881 tempest-TestMinimumBasicScenario-1602759881-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:26:59.408936 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-748e33cb-61c9-45d1-a34a-7be6dfd47818 tempest-TestMinimumBasicScenario-1602759881 tempest-TestMinimumBasicScenario-1602759881-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:26:59.670470 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [None req-748e33cb-61c9-45d1-a34a-7be6dfd47818 tempest-TestMinimumBasicScenario-1602759881 tempest-TestMinimumBasicScenario-1602759881-project] 10.222.0.43 "POST /compute/v2.1/servers/3a9c029c-4daa-4ae2-b624-6d227fd03923/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.275017 Jun 22 10:26:59.671091 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 510/1011] 10.222.0.43 () {60 vars in 1322 bytes} [Wed Jun 22 10:26:59 2022] POST /compute/v2.1/servers/3a9c029c-4daa-4ae2-b624-6d227fd03923/os-volume_attachments => generated 194 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 22 10:26:59.957667 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-351d2d37-2a01-4d43-b4bf-582e9d3e4421 tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] Calling method '>' {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:26:59.958291 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.compute.api [None req-351d2d37-2a01-4d43-b4bf-582e9d3e4421 tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] [instance: 8d4bd5f5-1caa-4165-a7d3-73f338df3073] Fetching instance by UUID {{(pid=117873) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:26:59.964808 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-351d2d37-2a01-4d43-b4bf-582e9d3e4421 tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:26:59.965246 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-351d2d37-2a01-4d43-b4bf-582e9d3e4421 tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:26:59.966013 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-351d2d37-2a01-4d43-b4bf-582e9d3e4421 tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:26:59.966439 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-351d2d37-2a01-4d43-b4bf-582e9d3e4421 tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:26:59.980518 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.wsgi [None req-351d2d37-2a01-4d43-b4bf-582e9d3e4421 tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] HTTP exception thrown: Instance 8d4bd5f5-1caa-4165-a7d3-73f338df3073 could not be found. Jun 22 10:26:59.982339 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-351d2d37-2a01-4d43-b4bf-582e9d3e4421 tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] Request method failure captured: Jun 22 10:26:59.982339 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: request: GET /compute/v2.1/servers/8d4bd5f5-1caa-4165-a7d3-73f338df3073 HTTP/1.1 Jun 22 10:26:59.982339 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: Accept: application/json Jun 22 10:26:59.982339 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: Accept-Encoding: identity Jun 22 10:26:59.982339 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: Connection: close Jun 22 10:26:59.982339 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: Content-Length: 0 Jun 22 10:26:59.982339 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: Content-Type: application/json Jun 22 10:26:59.982339 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: Host: 10.222.0.43 Jun 22 10:26:59.982339 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: Openstack-System-Scope: None Jun 22 10:26:59.982339 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: User-Agent: python-urllib3/1.26.9 Jun 22 10:26:59.982339 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-Auth-Token: gAAAAABisuy7PrqqyQesr95LVxly_fatV6so_rFauU71Lw0pOw-ec0qUNAiC-EM1bAwBV1rPBZdA7E7mV9Oe2uLSl52XJ9WLluPcBa8oGMYSVSd49ZrBqsF265LVYBKWbjX1LZSIWucQhbL7aKyV-q-u7AWOD1AY5xCUr3aEOBnlMEnzTVCOqVA Jun 22 10:26:59.982339 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-Domain-Id: None Jun 22 10:26:59.982339 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-Domain-Name: None Jun 22 10:26:59.982339 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-Identity-Status: Confirmed Jun 22 10:26:59.982339 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-Is-Admin-Project: True Jun 22 10:26:59.982339 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-Project-Domain-Id: default Jun 22 10:26:59.982339 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-Project-Domain-Name: Default Jun 22 10:26:59.982339 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-Project-Id: 1cb1af845e594466b12a11b7cab99a7c Jun 22 10:26:59.982339 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-Project-Name: tempest-TestVolumeBootPattern-1609151323 Jun 22 10:26:59.982339 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-Role: reader,member Jun 22 10:26:59.982339 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-Roles: reader,member Jun 22 10:26:59.985062 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/1cb1af845e594466b12a11b7cab99a7c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/1cb1af845e594466b12a11b7cab99a7c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_1cb1af845e594466b12a11b7cab99a7c", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/1cb1af845e594466b12a11b7cab99a7c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}] Jun 22 10:26:59.985062 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-Tenant: tempest-TestVolumeBootPattern-1609151323 Jun 22 10:26:59.985062 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-Tenant-Id: 1cb1af845e594466b12a11b7cab99a7c Jun 22 10:26:59.985062 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-Tenant-Name: tempest-TestVolumeBootPattern-1609151323 Jun 22 10:26:59.985062 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-User: tempest-TestVolumeBootPattern-1609151323-project Jun 22 10:26:59.985062 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-User-Domain-Id: default Jun 22 10:26:59.985062 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-User-Domain-Name: Default Jun 22 10:26:59.985062 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-User-Id: b2d3aa18a0a146808f584127411a1cf5 Jun 22 10:26:59.985062 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-User-Name: tempest-TestVolumeBootPattern-1609151323-project Jun 22 10:26:59.985062 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: method: > Jun 22 10:26:59.985062 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: exception: Instance 8d4bd5f5-1caa-4165-a7d3-73f338df3073 could not be found. Jun 22 10:26:59.985062 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: action_args: {'id': '8d4bd5f5-1caa-4165-a7d3-73f338df3073'} Jun 22 10:26:59.986938 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 10:26:59.986938 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:26:59.986938 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 22 10:26:59.986938 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 22 10:26:59.986938 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 22 10:26:59.986938 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 22 10:26:59.986938 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 22 10:26:59.986938 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 22 10:26:59.986938 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 22 10:26:59.986938 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 22 10:26:59.986938 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8d4bd5f5-1caa-4165-a7d3-73f338df3073 could not be found. Jun 22 10:26:59.986938 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi Jun 22 10:26:59.986938 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 10:26:59.986938 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi Jun 22 10:26:59.986938 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:26:59.986938 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 10:26:59.986938 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 10:26:59.986938 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 10:26:59.986938 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 10:26:59.986938 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 10:26:59.989808 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 10:26:59.989808 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 22 10:26:59.989808 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 22 10:26:59.989808 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 22 10:26:59.989808 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 22 10:26:59.989808 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 22 10:26:59.989808 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 22 10:26:59.989808 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8d4bd5f5-1caa-4165-a7d3-73f338df3073 could not be found. Jun 22 10:26:59.989808 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi Jun 22 10:26:59.989808 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 10:26:59.989808 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi Jun 22 10:26:59.989808 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:26:59.989808 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 10:26:59.989808 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 10:26:59.989808 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 10:26:59.989808 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 10:26:59.989808 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8d4bd5f5-1caa-4165-a7d3-73f338df3073 could not be found. Jun 22 10:26:59.989808 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi Jun 22 10:26:59.992340 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-351d2d37-2a01-4d43-b4bf-582e9d3e4421 tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] Returning 404 to user: Instance 8d4bd5f5-1caa-4165-a7d3-73f338df3073 could not be found. {{(pid=117873) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 10:26:59.992340 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [None req-351d2d37-2a01-4d43-b4bf-582e9d3e4421 tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] 10.222.0.43 "GET /compute/v2.1/servers/8d4bd5f5-1caa-4165-a7d3-73f338df3073" status: 404 len: 111 microversion: 2.1 time: 0.029868 Jun 22 10:26:59.992340 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 502/1012] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:26:59 2022] GET /compute/v2.1/servers/8d4bd5f5-1caa-4165-a7d3-73f338df3073 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 22 10:27:03.032511 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-ca8d7f54-4995-4256-93f0-24bf0f9e99e5 tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] Calling method '>' {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:27:03.033187 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.compute.api [None req-ca8d7f54-4995-4256-93f0-24bf0f9e99e5 tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] [instance: 7d67cb6e-5968-4e4d-961f-5fb5e33c186f] Fetching instance by UUID {{(pid=117874) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:27:03.034127 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [req-e4b5e988-eaf6-46ae-b6cb-096e61acf199 req-367fc5ff-43a1-4c77-80b6-f61229234114 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7d67cb6e-5968-4e4d-961f-5fb5e33c186f", "tag": "7c7fc779-1672-4d69-b57b-9dfc6fd1bf05"}]} {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:27:03.041885 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-ca8d7f54-4995-4256-93f0-24bf0f9e99e5 tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:27:03.042436 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-ca8d7f54-4995-4256-93f0-24bf0f9e99e5 tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:27:03.043293 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-ca8d7f54-4995-4256-93f0-24bf0f9e99e5 tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:27:03.043647 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [req-e4b5e988-eaf6-46ae-b6cb-096e61acf199 req-367fc5ff-43a1-4c77-80b6-f61229234114 service nova] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:27:03.044016 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-ca8d7f54-4995-4256-93f0-24bf0f9e99e5 tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:27:03.044209 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [req-e4b5e988-eaf6-46ae-b6cb-096e61acf199 req-367fc5ff-43a1-4c77-80b6-f61229234114 service nova] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:27:03.056529 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.compute.server_external_events [req-e4b5e988-eaf6-46ae-b6cb-096e61acf199 req-367fc5ff-43a1-4c77-80b6-f61229234114 service nova] Creating event network-changed:7c7fc779-1672-4d69-b57b-9dfc6fd1bf05 for instance 7d67cb6e-5968-4e4d-961f-5fb5e33c186f on hv-cinder-84713 Jun 22 10:27:03.061849 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [req-e4b5e988-eaf6-46ae-b6cb-096e61acf199 req-367fc5ff-43a1-4c77-80b6-f61229234114 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031426 Jun 22 10:27:03.062622 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 503/1013] 10.222.0.43 () {64 vars in 1317 bytes} [Wed Jun 22 10:27:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 10:27:03.074099 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.compute.api [None req-ca8d7f54-4995-4256-93f0-24bf0f9e99e5 tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] [instance: 7d67cb6e-5968-4e4d-961f-5fb5e33c186f] Going to try to terminate instance {{(pid=117874) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 22 10:27:03.127156 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG dbcounter [-] [117874] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=117874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:27:03.170259 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [None req-ca8d7f54-4995-4256-93f0-24bf0f9e99e5 tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] 10.222.0.43 "DELETE /compute/v2.1/servers/7d67cb6e-5968-4e4d-961f-5fb5e33c186f" status: 204 len: 0 microversion: 2.1 time: 0.141695 Jun 22 10:27:03.170969 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 511/1014] 10.222.0.43 () {58 vars in 1238 bytes} [Wed Jun 22 10:27:03 2022] DELETE /compute/v2.1/servers/7d67cb6e-5968-4e4d-961f-5fb5e33c186f => generated 0 bytes in 144 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 22 10:27:03.179660 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-abcafaa1-137a-4528-9a0d-cb77afadfb6d tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] Calling method '>' {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:27:03.180985 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.compute.api [None req-abcafaa1-137a-4528-9a0d-cb77afadfb6d tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] [instance: 7d67cb6e-5968-4e4d-961f-5fb5e33c186f] Fetching instance by UUID {{(pid=117873) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:27:03.187423 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-abcafaa1-137a-4528-9a0d-cb77afadfb6d tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:27:03.188096 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-abcafaa1-137a-4528-9a0d-cb77afadfb6d tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:27:03.189029 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-abcafaa1-137a-4528-9a0d-cb77afadfb6d tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:27:03.189626 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-abcafaa1-137a-4528-9a0d-cb77afadfb6d tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:27:03.329571 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.policy [None req-abcafaa1-137a-4528-9a0d-cb77afadfb6d tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2d3aa18a0a146808f584127411a1cf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1af845e594466b12a11b7cab99a7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117873) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:27:03.337726 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [None req-abcafaa1-137a-4528-9a0d-cb77afadfb6d tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] 10.222.0.43 "GET /compute/v2.1/servers/7d67cb6e-5968-4e4d-961f-5fb5e33c186f" status: 200 len: 1579 microversion: 2.1 time: 0.162232 Jun 22 10:27:03.338278 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 504/1015] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:27:03 2022] GET /compute/v2.1/servers/7d67cb6e-5968-4e4d-961f-5fb5e33c186f => generated 1579 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 10:27:04.356628 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-cb6e1092-4150-420c-9e60-d2debd05dec3 tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] Calling method '>' {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:27:04.357251 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.compute.api [None req-cb6e1092-4150-420c-9e60-d2debd05dec3 tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] [instance: 7d67cb6e-5968-4e4d-961f-5fb5e33c186f] Fetching instance by UUID {{(pid=117874) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:27:04.363620 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-cb6e1092-4150-420c-9e60-d2debd05dec3 tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:27:04.364058 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-cb6e1092-4150-420c-9e60-d2debd05dec3 tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:27:04.365005 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-cb6e1092-4150-420c-9e60-d2debd05dec3 tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:27:04.365434 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-cb6e1092-4150-420c-9e60-d2debd05dec3 tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:27:04.505396 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.policy [None req-cb6e1092-4150-420c-9e60-d2debd05dec3 tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2d3aa18a0a146808f584127411a1cf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1af845e594466b12a11b7cab99a7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117874) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:27:04.513799 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [None req-cb6e1092-4150-420c-9e60-d2debd05dec3 tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] 10.222.0.43 "GET /compute/v2.1/servers/7d67cb6e-5968-4e4d-961f-5fb5e33c186f" status: 200 len: 1579 microversion: 2.1 time: 0.162135 Jun 22 10:27:04.514361 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 512/1016] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:27:04 2022] GET /compute/v2.1/servers/7d67cb6e-5968-4e4d-961f-5fb5e33c186f => generated 1579 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:27:05.514298 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [req-d4fffa2c-3ecd-4d61-b08b-2bcbf145f6ef req-b701ce9d-29a4-4619-8343-c7ba824c26ed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7d67cb6e-5968-4e4d-961f-5fb5e33c186f", "name": "network-vif-deleted", "tag": "7c7fc779-1672-4d69-b57b-9dfc6fd1bf05"}]} {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:27:05.522540 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [req-d4fffa2c-3ecd-4d61-b08b-2bcbf145f6ef req-b701ce9d-29a4-4619-8343-c7ba824c26ed service nova] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:27:05.522985 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [req-d4fffa2c-3ecd-4d61-b08b-2bcbf145f6ef req-b701ce9d-29a4-4619-8343-c7ba824c26ed service nova] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:27:05.533462 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-c4e60de6-43a0-4d50-beb9-b0b1166c297d tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] Calling method '>' {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:27:05.535261 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.compute.api [None req-c4e60de6-43a0-4d50-beb9-b0b1166c297d tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] [instance: 7d67cb6e-5968-4e4d-961f-5fb5e33c186f] Fetching instance by UUID {{(pid=117874) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:27:05.536281 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.compute.server_external_events [req-d4fffa2c-3ecd-4d61-b08b-2bcbf145f6ef req-b701ce9d-29a4-4619-8343-c7ba824c26ed service nova] Creating event network-vif-deleted:7c7fc779-1672-4d69-b57b-9dfc6fd1bf05 for instance 7d67cb6e-5968-4e4d-961f-5fb5e33c186f on hv-cinder-84713 Jun 22 10:27:05.543537 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [req-d4fffa2c-3ecd-4d61-b08b-2bcbf145f6ef req-b701ce9d-29a4-4619-8343-c7ba824c26ed service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087363 Jun 22 10:27:05.544368 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-c4e60de6-43a0-4d50-beb9-b0b1166c297d tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:27:05.544703 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 505/1017] 10.222.0.43 () {64 vars in 1317 bytes} [Wed Jun 22 10:27:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 10:27:05.544836 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-c4e60de6-43a0-4d50-beb9-b0b1166c297d tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:27:05.545758 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-c4e60de6-43a0-4d50-beb9-b0b1166c297d tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:27:05.546277 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-c4e60de6-43a0-4d50-beb9-b0b1166c297d tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:27:05.616630 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.policy [None req-c4e60de6-43a0-4d50-beb9-b0b1166c297d tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2d3aa18a0a146808f584127411a1cf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cb1af845e594466b12a11b7cab99a7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117874) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:27:05.626085 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [None req-c4e60de6-43a0-4d50-beb9-b0b1166c297d tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] 10.222.0.43 "GET /compute/v2.1/servers/7d67cb6e-5968-4e4d-961f-5fb5e33c186f" status: 200 len: 1226 microversion: 2.1 time: 0.098765 Jun 22 10:27:05.626956 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 513/1018] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:27:05 2022] GET /compute/v2.1/servers/7d67cb6e-5968-4e4d-961f-5fb5e33c186f => generated 1226 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:27:06.160699 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-56e1dee3-ff9e-4c82-8547-0715b8f0736d tempest-TestMinimumBasicScenario-1602759881 tempest-TestMinimumBasicScenario-1602759881-project] Calling method '>' {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:27:06.161401 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.compute.api [None req-56e1dee3-ff9e-4c82-8547-0715b8f0736d tempest-TestMinimumBasicScenario-1602759881 tempest-TestMinimumBasicScenario-1602759881-project] [instance: 3a9c029c-4daa-4ae2-b624-6d227fd03923] Fetching instance by UUID {{(pid=117873) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:27:06.169024 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-56e1dee3-ff9e-4c82-8547-0715b8f0736d tempest-TestMinimumBasicScenario-1602759881 tempest-TestMinimumBasicScenario-1602759881-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:27:06.169463 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-56e1dee3-ff9e-4c82-8547-0715b8f0736d tempest-TestMinimumBasicScenario-1602759881 tempest-TestMinimumBasicScenario-1602759881-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:27:06.170250 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-56e1dee3-ff9e-4c82-8547-0715b8f0736d tempest-TestMinimumBasicScenario-1602759881 tempest-TestMinimumBasicScenario-1602759881-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:27:06.170672 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-56e1dee3-ff9e-4c82-8547-0715b8f0736d tempest-TestMinimumBasicScenario-1602759881 tempest-TestMinimumBasicScenario-1602759881-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:27:06.318844 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.policy [None req-56e1dee3-ff9e-4c82-8547-0715b8f0736d tempest-TestMinimumBasicScenario-1602759881 tempest-TestMinimumBasicScenario-1602759881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21a35a18c4d74109ac1dacc120bbe0fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4d8e96d47af4667a2f478e6561353d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117873) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:27:06.328711 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [None req-56e1dee3-ff9e-4c82-8547-0715b8f0736d tempest-TestMinimumBasicScenario-1602759881 tempest-TestMinimumBasicScenario-1602759881-project] 10.222.0.43 "GET /compute/v2.1/servers/3a9c029c-4daa-4ae2-b624-6d227fd03923" status: 200 len: 1596 microversion: 2.1 time: 0.172103 Jun 22 10:27:06.329276 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 506/1019] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:27:06 2022] GET /compute/v2.1/servers/3a9c029c-4daa-4ae2-b624-6d227fd03923 => generated 1596 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:27:06.644040 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-31435561-29d2-4acb-8aab-b35882168e2c tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] Calling method '>' {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:27:06.644678 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.compute.api [None req-31435561-29d2-4acb-8aab-b35882168e2c tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] [instance: 7d67cb6e-5968-4e4d-961f-5fb5e33c186f] Fetching instance by UUID {{(pid=117874) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:27:06.653134 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-31435561-29d2-4acb-8aab-b35882168e2c tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:27:06.653579 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-31435561-29d2-4acb-8aab-b35882168e2c tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:27:06.654367 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-31435561-29d2-4acb-8aab-b35882168e2c tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:27:06.654796 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-31435561-29d2-4acb-8aab-b35882168e2c tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:27:06.668660 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.wsgi [None req-31435561-29d2-4acb-8aab-b35882168e2c tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] HTTP exception thrown: Instance 7d67cb6e-5968-4e4d-961f-5fb5e33c186f could not be found. Jun 22 10:27:06.670333 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-31435561-29d2-4acb-8aab-b35882168e2c tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] Request method failure captured: Jun 22 10:27:06.670333 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: request: GET /compute/v2.1/servers/7d67cb6e-5968-4e4d-961f-5fb5e33c186f HTTP/1.1 Jun 22 10:27:06.670333 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: Accept: application/json Jun 22 10:27:06.670333 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: Accept-Encoding: identity Jun 22 10:27:06.670333 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: Connection: close Jun 22 10:27:06.670333 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: Content-Length: 0 Jun 22 10:27:06.670333 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: Content-Type: application/json Jun 22 10:27:06.670333 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: Host: 10.222.0.43 Jun 22 10:27:06.670333 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: Openstack-System-Scope: None Jun 22 10:27:06.670333 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: User-Agent: python-urllib3/1.26.9 Jun 22 10:27:06.670333 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-Auth-Token: gAAAAABisuy7PrqqyQesr95LVxly_fatV6so_rFauU71Lw0pOw-ec0qUNAiC-EM1bAwBV1rPBZdA7E7mV9Oe2uLSl52XJ9WLluPcBa8oGMYSVSd49ZrBqsF265LVYBKWbjX1LZSIWucQhbL7aKyV-q-u7AWOD1AY5xCUr3aEOBnlMEnzTVCOqVA Jun 22 10:27:06.670333 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-Domain-Id: None Jun 22 10:27:06.670333 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-Domain-Name: None Jun 22 10:27:06.670333 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-Identity-Status: Confirmed Jun 22 10:27:06.670333 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-Is-Admin-Project: True Jun 22 10:27:06.670333 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-Project-Domain-Id: default Jun 22 10:27:06.670333 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-Project-Domain-Name: Default Jun 22 10:27:06.670333 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-Project-Id: 1cb1af845e594466b12a11b7cab99a7c Jun 22 10:27:06.670333 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-Project-Name: tempest-TestVolumeBootPattern-1609151323 Jun 22 10:27:06.670333 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-Role: reader,member Jun 22 10:27:06.670333 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-Roles: reader,member Jun 22 10:27:06.671699 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/1cb1af845e594466b12a11b7cab99a7c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/1cb1af845e594466b12a11b7cab99a7c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_1cb1af845e594466b12a11b7cab99a7c", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/1cb1af845e594466b12a11b7cab99a7c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}] Jun 22 10:27:06.671699 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-Tenant: tempest-TestVolumeBootPattern-1609151323 Jun 22 10:27:06.671699 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-Tenant-Id: 1cb1af845e594466b12a11b7cab99a7c Jun 22 10:27:06.671699 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-Tenant-Name: tempest-TestVolumeBootPattern-1609151323 Jun 22 10:27:06.671699 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-User: tempest-TestVolumeBootPattern-1609151323-project Jun 22 10:27:06.671699 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-User-Domain-Id: default Jun 22 10:27:06.671699 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-User-Domain-Name: Default Jun 22 10:27:06.671699 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-User-Id: b2d3aa18a0a146808f584127411a1cf5 Jun 22 10:27:06.671699 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-User-Name: tempest-TestVolumeBootPattern-1609151323-project Jun 22 10:27:06.671699 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: method: > Jun 22 10:27:06.671699 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: exception: Instance 7d67cb6e-5968-4e4d-961f-5fb5e33c186f could not be found. Jun 22 10:27:06.671699 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: action_args: {'id': '7d67cb6e-5968-4e4d-961f-5fb5e33c186f'} Jun 22 10:27:06.672436 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 10:27:06.672436 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:27:06.672436 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 22 10:27:06.672436 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 22 10:27:06.672436 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 22 10:27:06.672436 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 22 10:27:06.672436 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 22 10:27:06.672436 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 22 10:27:06.672436 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 22 10:27:06.672436 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 22 10:27:06.672436 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7d67cb6e-5968-4e4d-961f-5fb5e33c186f could not be found. Jun 22 10:27:06.672436 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi Jun 22 10:27:06.672436 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 10:27:06.672436 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi Jun 22 10:27:06.672436 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:27:06.672436 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 10:27:06.672436 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 10:27:06.672436 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 10:27:06.672436 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 10:27:06.672436 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 10:27:06.673647 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 10:27:06.673647 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 22 10:27:06.673647 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 22 10:27:06.673647 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 22 10:27:06.673647 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 22 10:27:06.673647 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 22 10:27:06.673647 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 22 10:27:06.673647 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7d67cb6e-5968-4e4d-961f-5fb5e33c186f could not be found. Jun 22 10:27:06.673647 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi Jun 22 10:27:06.673647 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 10:27:06.673647 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi Jun 22 10:27:06.673647 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:27:06.673647 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 10:27:06.673647 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 10:27:06.673647 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 10:27:06.673647 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 10:27:06.673647 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7d67cb6e-5968-4e4d-961f-5fb5e33c186f could not be found. Jun 22 10:27:06.673647 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi Jun 22 10:27:06.674798 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-31435561-29d2-4acb-8aab-b35882168e2c tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] Returning 404 to user: Instance 7d67cb6e-5968-4e4d-961f-5fb5e33c186f could not be found. {{(pid=117874) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 10:27:06.674798 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [None req-31435561-29d2-4acb-8aab-b35882168e2c tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] 10.222.0.43 "GET /compute/v2.1/servers/7d67cb6e-5968-4e4d-961f-5fb5e33c186f" status: 404 len: 111 microversion: 2.1 time: 0.031575 Jun 22 10:27:06.674798 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 514/1020] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:27:06 2022] GET /compute/v2.1/servers/7d67cb6e-5968-4e4d-961f-5fb5e33c186f => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 22 10:27:07.130914 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-48c4fa8e-3c9b-41a4-bd15-7335741e69c3 tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] Calling method '>' {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:27:07.131521 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.compute.api [None req-48c4fa8e-3c9b-41a4-bd15-7335741e69c3 tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] [instance: 28c617f3-3db0-484a-9d66-15fef4010ec4] Fetching instance by UUID {{(pid=117873) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:27:07.137976 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-48c4fa8e-3c9b-41a4-bd15-7335741e69c3 tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:27:07.138417 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-48c4fa8e-3c9b-41a4-bd15-7335741e69c3 tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:27:07.139166 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-48c4fa8e-3c9b-41a4-bd15-7335741e69c3 tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:27:07.139591 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-48c4fa8e-3c9b-41a4-bd15-7335741e69c3 tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:27:07.153255 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.wsgi [None req-48c4fa8e-3c9b-41a4-bd15-7335741e69c3 tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] HTTP exception thrown: Instance 28c617f3-3db0-484a-9d66-15fef4010ec4 could not be found. Jun 22 10:27:07.154920 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-48c4fa8e-3c9b-41a4-bd15-7335741e69c3 tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] Request method failure captured: Jun 22 10:27:07.154920 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: request: DELETE /compute/v2.1/servers/28c617f3-3db0-484a-9d66-15fef4010ec4 HTTP/1.1 Jun 22 10:27:07.154920 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: Accept: application/json Jun 22 10:27:07.154920 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: Accept-Encoding: identity Jun 22 10:27:07.154920 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: Connection: close Jun 22 10:27:07.154920 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: Content-Length: 0 Jun 22 10:27:07.154920 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: Content-Type: application/json Jun 22 10:27:07.154920 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: Host: 10.222.0.43 Jun 22 10:27:07.154920 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: Openstack-System-Scope: None Jun 22 10:27:07.154920 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: User-Agent: python-urllib3/1.26.9 Jun 22 10:27:07.154920 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-Auth-Token: gAAAAABisuy7PrqqyQesr95LVxly_fatV6so_rFauU71Lw0pOw-ec0qUNAiC-EM1bAwBV1rPBZdA7E7mV9Oe2uLSl52XJ9WLluPcBa8oGMYSVSd49ZrBqsF265LVYBKWbjX1LZSIWucQhbL7aKyV-q-u7AWOD1AY5xCUr3aEOBnlMEnzTVCOqVA Jun 22 10:27:07.154920 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-Domain-Id: None Jun 22 10:27:07.154920 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-Domain-Name: None Jun 22 10:27:07.154920 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-Identity-Status: Confirmed Jun 22 10:27:07.154920 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-Is-Admin-Project: True Jun 22 10:27:07.154920 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-Project-Domain-Id: default Jun 22 10:27:07.154920 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-Project-Domain-Name: Default Jun 22 10:27:07.154920 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-Project-Id: 1cb1af845e594466b12a11b7cab99a7c Jun 22 10:27:07.154920 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-Project-Name: tempest-TestVolumeBootPattern-1609151323 Jun 22 10:27:07.154920 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-Role: reader,member Jun 22 10:27:07.154920 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-Roles: reader,member Jun 22 10:27:07.156533 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/1cb1af845e594466b12a11b7cab99a7c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/1cb1af845e594466b12a11b7cab99a7c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_1cb1af845e594466b12a11b7cab99a7c", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/1cb1af845e594466b12a11b7cab99a7c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}] Jun 22 10:27:07.156533 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-Tenant: tempest-TestVolumeBootPattern-1609151323 Jun 22 10:27:07.156533 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-Tenant-Id: 1cb1af845e594466b12a11b7cab99a7c Jun 22 10:27:07.156533 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-Tenant-Name: tempest-TestVolumeBootPattern-1609151323 Jun 22 10:27:07.156533 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-User: tempest-TestVolumeBootPattern-1609151323-project Jun 22 10:27:07.156533 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-User-Domain-Id: default Jun 22 10:27:07.156533 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-User-Domain-Name: Default Jun 22 10:27:07.156533 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-User-Id: b2d3aa18a0a146808f584127411a1cf5 Jun 22 10:27:07.156533 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: X-User-Name: tempest-TestVolumeBootPattern-1609151323-project Jun 22 10:27:07.156533 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: method: > Jun 22 10:27:07.156533 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: exception: Instance 28c617f3-3db0-484a-9d66-15fef4010ec4 could not be found. Jun 22 10:27:07.156533 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: action_args: {'id': '28c617f3-3db0-484a-9d66-15fef4010ec4'} Jun 22 10:27:07.157408 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 10:27:07.157408 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:27:07.157408 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 22 10:27:07.157408 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 22 10:27:07.157408 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 22 10:27:07.157408 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 22 10:27:07.157408 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 22 10:27:07.157408 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 22 10:27:07.157408 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 22 10:27:07.157408 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 22 10:27:07.157408 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 28c617f3-3db0-484a-9d66-15fef4010ec4 could not be found. Jun 22 10:27:07.157408 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi Jun 22 10:27:07.157408 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 10:27:07.157408 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi Jun 22 10:27:07.157408 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:27:07.157408 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 10:27:07.157408 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 10:27:07.157408 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 10:27:07.157408 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 10:27:07.157408 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 10:27:07.158762 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 10:27:07.158762 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 22 10:27:07.158762 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 22 10:27:07.158762 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 22 10:27:07.158762 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 22 10:27:07.158762 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 22 10:27:07.158762 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 22 10:27:07.158762 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 22 10:27:07.158762 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 22 10:27:07.158762 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 28c617f3-3db0-484a-9d66-15fef4010ec4 could not be found. Jun 22 10:27:07.158762 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi Jun 22 10:27:07.158762 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 10:27:07.158762 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi Jun 22 10:27:07.158762 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:27:07.158762 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 10:27:07.158762 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 10:27:07.158762 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 10:27:07.158762 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 10:27:07.158762 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 28c617f3-3db0-484a-9d66-15fef4010ec4 could not be found. Jun 22 10:27:07.158762 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: ERROR nova.api.openstack.wsgi Jun 22 10:27:07.160154 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-48c4fa8e-3c9b-41a4-bd15-7335741e69c3 tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] Returning 404 to user: Instance 28c617f3-3db0-484a-9d66-15fef4010ec4 could not be found. {{(pid=117873) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 10:27:07.160154 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [None req-48c4fa8e-3c9b-41a4-bd15-7335741e69c3 tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] 10.222.0.43 "DELETE /compute/v2.1/servers/28c617f3-3db0-484a-9d66-15fef4010ec4" status: 404 len: 111 microversion: 2.1 time: 0.029241 Jun 22 10:27:07.160154 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 507/1021] 10.222.0.43 () {58 vars in 1238 bytes} [Wed Jun 22 10:27:07 2022] DELETE /compute/v2.1/servers/28c617f3-3db0-484a-9d66-15fef4010ec4 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 22 10:27:07.165717 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-aa90b0b8-2db2-4b85-946a-c0e508a73d65 tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] Calling method '>' {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:27:07.166424 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.compute.api [None req-aa90b0b8-2db2-4b85-946a-c0e508a73d65 tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] [instance: 28c617f3-3db0-484a-9d66-15fef4010ec4] Fetching instance by UUID {{(pid=117874) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:27:07.172430 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-aa90b0b8-2db2-4b85-946a-c0e508a73d65 tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:27:07.172966 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-aa90b0b8-2db2-4b85-946a-c0e508a73d65 tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:27:07.173817 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-aa90b0b8-2db2-4b85-946a-c0e508a73d65 tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:27:07.174319 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-aa90b0b8-2db2-4b85-946a-c0e508a73d65 tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:27:07.188736 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.wsgi [None req-aa90b0b8-2db2-4b85-946a-c0e508a73d65 tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] HTTP exception thrown: Instance 28c617f3-3db0-484a-9d66-15fef4010ec4 could not be found. Jun 22 10:27:07.190435 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-aa90b0b8-2db2-4b85-946a-c0e508a73d65 tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] Request method failure captured: Jun 22 10:27:07.190435 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: request: GET /compute/v2.1/servers/28c617f3-3db0-484a-9d66-15fef4010ec4 HTTP/1.1 Jun 22 10:27:07.190435 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: Accept: application/json Jun 22 10:27:07.190435 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: Accept-Encoding: identity Jun 22 10:27:07.190435 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: Connection: close Jun 22 10:27:07.190435 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: Content-Length: 0 Jun 22 10:27:07.190435 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: Content-Type: application/json Jun 22 10:27:07.190435 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: Host: 10.222.0.43 Jun 22 10:27:07.190435 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: Openstack-System-Scope: None Jun 22 10:27:07.190435 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: User-Agent: python-urllib3/1.26.9 Jun 22 10:27:07.190435 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-Auth-Token: gAAAAABisuy7PrqqyQesr95LVxly_fatV6so_rFauU71Lw0pOw-ec0qUNAiC-EM1bAwBV1rPBZdA7E7mV9Oe2uLSl52XJ9WLluPcBa8oGMYSVSd49ZrBqsF265LVYBKWbjX1LZSIWucQhbL7aKyV-q-u7AWOD1AY5xCUr3aEOBnlMEnzTVCOqVA Jun 22 10:27:07.190435 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-Domain-Id: None Jun 22 10:27:07.190435 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-Domain-Name: None Jun 22 10:27:07.190435 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-Identity-Status: Confirmed Jun 22 10:27:07.190435 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-Is-Admin-Project: True Jun 22 10:27:07.190435 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-Project-Domain-Id: default Jun 22 10:27:07.190435 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-Project-Domain-Name: Default Jun 22 10:27:07.190435 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-Project-Id: 1cb1af845e594466b12a11b7cab99a7c Jun 22 10:27:07.190435 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-Project-Name: tempest-TestVolumeBootPattern-1609151323 Jun 22 10:27:07.190435 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-Role: reader,member Jun 22 10:27:07.190435 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-Roles: reader,member Jun 22 10:27:07.192087 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/1cb1af845e594466b12a11b7cab99a7c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/1cb1af845e594466b12a11b7cab99a7c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_1cb1af845e594466b12a11b7cab99a7c", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/1cb1af845e594466b12a11b7cab99a7c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}] Jun 22 10:27:07.192087 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-Tenant: tempest-TestVolumeBootPattern-1609151323 Jun 22 10:27:07.192087 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-Tenant-Id: 1cb1af845e594466b12a11b7cab99a7c Jun 22 10:27:07.192087 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-Tenant-Name: tempest-TestVolumeBootPattern-1609151323 Jun 22 10:27:07.192087 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-User: tempest-TestVolumeBootPattern-1609151323-project Jun 22 10:27:07.192087 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-User-Domain-Id: default Jun 22 10:27:07.192087 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-User-Domain-Name: Default Jun 22 10:27:07.192087 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-User-Id: b2d3aa18a0a146808f584127411a1cf5 Jun 22 10:27:07.192087 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-User-Name: tempest-TestVolumeBootPattern-1609151323-project Jun 22 10:27:07.192087 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: method: > Jun 22 10:27:07.192087 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: exception: Instance 28c617f3-3db0-484a-9d66-15fef4010ec4 could not be found. Jun 22 10:27:07.192087 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: action_args: {'id': '28c617f3-3db0-484a-9d66-15fef4010ec4'} Jun 22 10:27:07.192981 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 10:27:07.192981 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:27:07.192981 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 22 10:27:07.192981 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 22 10:27:07.192981 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 22 10:27:07.192981 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 22 10:27:07.192981 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 22 10:27:07.192981 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 22 10:27:07.192981 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 22 10:27:07.192981 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 22 10:27:07.192981 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 28c617f3-3db0-484a-9d66-15fef4010ec4 could not be found. Jun 22 10:27:07.192981 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi Jun 22 10:27:07.192981 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 10:27:07.192981 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi Jun 22 10:27:07.192981 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:27:07.192981 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 10:27:07.192981 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 10:27:07.192981 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 10:27:07.192981 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 10:27:07.192981 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 10:27:07.194589 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 10:27:07.194589 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 22 10:27:07.194589 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 22 10:27:07.194589 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 22 10:27:07.194589 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 22 10:27:07.194589 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 22 10:27:07.194589 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 22 10:27:07.194589 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 28c617f3-3db0-484a-9d66-15fef4010ec4 could not be found. Jun 22 10:27:07.194589 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi Jun 22 10:27:07.194589 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 10:27:07.194589 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi Jun 22 10:27:07.194589 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:27:07.194589 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 10:27:07.194589 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 10:27:07.194589 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 10:27:07.194589 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 10:27:07.194589 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 28c617f3-3db0-484a-9d66-15fef4010ec4 could not be found. Jun 22 10:27:07.194589 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi Jun 22 10:27:07.196933 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-aa90b0b8-2db2-4b85-946a-c0e508a73d65 tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] Returning 404 to user: Instance 28c617f3-3db0-484a-9d66-15fef4010ec4 could not be found. {{(pid=117874) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 10:27:07.196933 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [None req-aa90b0b8-2db2-4b85-946a-c0e508a73d65 tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] 10.222.0.43 "GET /compute/v2.1/servers/28c617f3-3db0-484a-9d66-15fef4010ec4" status: 404 len: 111 microversion: 2.1 time: 0.031396 Jun 22 10:27:07.196933 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 515/1022] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:27:07 2022] GET /compute/v2.1/servers/28c617f3-3db0-484a-9d66-15fef4010ec4 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 22 10:27:07.995301 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [req-b4c6cb76-6b33-4864-bc14-09a1823a50e0 req-00191375-23ec-4bd9-a001-a11025895297 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3a9c029c-4daa-4ae2-b624-6d227fd03923", "tag": "36a8b53c-154d-40ba-acfc-8a025c723d78"}]} {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:27:08.002472 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG dbcounter [-] [117873] Writing DB stats nova_cell0:SELECT=2 {{(pid=117873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:27:08.006971 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [req-b4c6cb76-6b33-4864-bc14-09a1823a50e0 req-00191375-23ec-4bd9-a001-a11025895297 service nova] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:27:08.007416 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [req-b4c6cb76-6b33-4864-bc14-09a1823a50e0 req-00191375-23ec-4bd9-a001-a11025895297 service nova] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:27:08.020152 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.compute.server_external_events [req-b4c6cb76-6b33-4864-bc14-09a1823a50e0 req-00191375-23ec-4bd9-a001-a11025895297 service nova] Creating event network-changed:36a8b53c-154d-40ba-acfc-8a025c723d78 for instance 3a9c029c-4daa-4ae2-b624-6d227fd03923 on hv-cinder-84713 Jun 22 10:27:08.026855 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [req-b4c6cb76-6b33-4864-bc14-09a1823a50e0 req-00191375-23ec-4bd9-a001-a11025895297 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035409 Jun 22 10:27:08.027381 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 508/1023] 10.222.0.43 () {64 vars in 1317 bytes} [Wed Jun 22 10:27:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 10:27:08.658513 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-e0fcfa28-4f54-47d8-8a36-e19b15090397 tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] Calling method '.version_select at 0x7f36bde1b700>' {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:27:08.699129 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [None req-e0fcfa28-4f54-47d8-8a36-e19b15090397 tempest-TestVolumeBootPattern-1609151323 tempest-TestVolumeBootPattern-1609151323-project] 10.222.0.43 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1986835772" status: 202 len: 0 microversion: 2.1 time: 0.045589 Jun 22 10:27:08.702328 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 516/1024] 10.222.0.43 () {58 vars in 1262 bytes} [Wed Jun 22 10:27:08 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1986835772 => generated 0 bytes in 49 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 22 10:27:09.716103 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-972bc685-0d4c-4ebc-9411-441d8736eca7 tempest-TestMinimumBasicScenario-1602759881 tempest-TestMinimumBasicScenario-1602759881-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1673371361"}} {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:27:09.716636 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.compute.api [None req-972bc685-0d4c-4ebc-9411-441d8736eca7 tempest-TestMinimumBasicScenario-1602759881 tempest-TestMinimumBasicScenario-1602759881-project] [instance: 3a9c029c-4daa-4ae2-b624-6d227fd03923] Fetching instance by UUID {{(pid=117873) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:27:09.722794 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-972bc685-0d4c-4ebc-9411-441d8736eca7 tempest-TestMinimumBasicScenario-1602759881 tempest-TestMinimumBasicScenario-1602759881-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:27:09.723428 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-972bc685-0d4c-4ebc-9411-441d8736eca7 tempest-TestMinimumBasicScenario-1602759881 tempest-TestMinimumBasicScenario-1602759881-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:27:09.724216 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-972bc685-0d4c-4ebc-9411-441d8736eca7 tempest-TestMinimumBasicScenario-1602759881 tempest-TestMinimumBasicScenario-1602759881-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:27:09.724651 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-972bc685-0d4c-4ebc-9411-441d8736eca7 tempest-TestMinimumBasicScenario-1602759881 tempest-TestMinimumBasicScenario-1602759881-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:27:09.942458 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.network.security_group_api [None req-972bc685-0d4c-4ebc-9411-441d8736eca7 tempest-TestMinimumBasicScenario-1602759881 tempest-TestMinimumBasicScenario-1602759881-project] Adding security group b341b537-1b96-443b-9367-50ef9e9a2a7b to port 36a8b53c-154d-40ba-acfc-8a025c723d78 Jun 22 10:27:10.695297 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [None req-972bc685-0d4c-4ebc-9411-441d8736eca7 tempest-TestMinimumBasicScenario-1602759881 tempest-TestMinimumBasicScenario-1602759881-project] 10.222.0.43 "POST /compute/v2.1/servers/3a9c029c-4daa-4ae2-b624-6d227fd03923/action" status: 202 len: 0 microversion: 2.1 time: 0.984625 Jun 22 10:27:10.699434 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 509/1025] 10.222.0.43 () {60 vars in 1277 bytes} [Wed Jun 22 10:27:09 2022] POST /compute/v2.1/servers/3a9c029c-4daa-4ae2-b624-6d227fd03923/action => generated 0 bytes in 990 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 22 10:27:10.712713 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-fafdd0b1-8a56-4275-82e6-0d43bb3830a1 tempest-TestMinimumBasicScenario-1602759881 tempest-TestMinimumBasicScenario-1602759881-project] Calling method '>' {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:27:10.713229 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [req-e5e272d3-a22d-414f-8be2-c0c99cb3c762 req-ac5fd56e-6496-4ca2-b64c-bce6eae868ea service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3a9c029c-4daa-4ae2-b624-6d227fd03923", "tag": "36a8b53c-154d-40ba-acfc-8a025c723d78"}]} {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:27:10.714695 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.compute.api [None req-fafdd0b1-8a56-4275-82e6-0d43bb3830a1 tempest-TestMinimumBasicScenario-1602759881 tempest-TestMinimumBasicScenario-1602759881-project] [instance: 3a9c029c-4daa-4ae2-b624-6d227fd03923] Fetching instance by UUID {{(pid=117874) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:27:10.725295 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-fafdd0b1-8a56-4275-82e6-0d43bb3830a1 tempest-TestMinimumBasicScenario-1602759881 tempest-TestMinimumBasicScenario-1602759881-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:27:10.726077 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-fafdd0b1-8a56-4275-82e6-0d43bb3830a1 tempest-TestMinimumBasicScenario-1602759881 tempest-TestMinimumBasicScenario-1602759881-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:27:10.727584 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-fafdd0b1-8a56-4275-82e6-0d43bb3830a1 tempest-TestMinimumBasicScenario-1602759881 tempest-TestMinimumBasicScenario-1602759881-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:27:10.729433 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-fafdd0b1-8a56-4275-82e6-0d43bb3830a1 tempest-TestMinimumBasicScenario-1602759881 tempest-TestMinimumBasicScenario-1602759881-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:27:10.733869 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [req-e5e272d3-a22d-414f-8be2-c0c99cb3c762 req-ac5fd56e-6496-4ca2-b64c-bce6eae868ea service nova] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:27:10.734466 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [req-e5e272d3-a22d-414f-8be2-c0c99cb3c762 req-ac5fd56e-6496-4ca2-b64c-bce6eae868ea service nova] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:27:10.753257 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.compute.server_external_events [req-e5e272d3-a22d-414f-8be2-c0c99cb3c762 req-ac5fd56e-6496-4ca2-b64c-bce6eae868ea service nova] Creating event network-changed:36a8b53c-154d-40ba-acfc-8a025c723d78 for instance 3a9c029c-4daa-4ae2-b624-6d227fd03923 on hv-cinder-84713 Jun 22 10:27:10.762289 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [req-e5e272d3-a22d-414f-8be2-c0c99cb3c762 req-ac5fd56e-6496-4ca2-b64c-bce6eae868ea service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052812 Jun 22 10:27:10.766767 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 510/1026] 10.222.0.43 () {64 vars in 1317 bytes} [Wed Jun 22 10:27:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 10:27:11.061671 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.policy [None req-fafdd0b1-8a56-4275-82e6-0d43bb3830a1 tempest-TestMinimumBasicScenario-1602759881 tempest-TestMinimumBasicScenario-1602759881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21a35a18c4d74109ac1dacc120bbe0fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4d8e96d47af4667a2f478e6561353d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117874) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:27:11.071410 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [None req-fafdd0b1-8a56-4275-82e6-0d43bb3830a1 tempest-TestMinimumBasicScenario-1602759881 tempest-TestMinimumBasicScenario-1602759881-project] 10.222.0.43 "GET /compute/v2.1/servers/3a9c029c-4daa-4ae2-b624-6d227fd03923" status: 200 len: 1762 microversion: 2.1 time: 0.369159 Jun 22 10:27:11.083799 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 517/1027] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:27:10 2022] GET /compute/v2.1/servers/3a9c029c-4daa-4ae2-b624-6d227fd03923 => generated 1762 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:27:33.387961 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG dbcounter [-] [117873] Writing DB stats nova_api:SELECT=48,nova_api:UPDATE=1 {{(pid=117873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:27:33.388617 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG dbcounter [-] [117873] Writing DB stats nova_cell1:SELECT=36 {{(pid=117873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:27:33.392717 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-3c951624-2318-4b32-b2da-82b90930602d tempest-TestMinimumBasicScenario-1602759881 tempest-TestMinimumBasicScenario-1602759881-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:27:33.393748 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.compute.api [None req-3c951624-2318-4b32-b2da-82b90930602d tempest-TestMinimumBasicScenario-1602759881 tempest-TestMinimumBasicScenario-1602759881-project] [instance: 3a9c029c-4daa-4ae2-b624-6d227fd03923] Fetching instance by UUID {{(pid=117873) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:27:33.402682 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-3c951624-2318-4b32-b2da-82b90930602d tempest-TestMinimumBasicScenario-1602759881 tempest-TestMinimumBasicScenario-1602759881-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:27:33.403127 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-3c951624-2318-4b32-b2da-82b90930602d tempest-TestMinimumBasicScenario-1602759881 tempest-TestMinimumBasicScenario-1602759881-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:27:33.403881 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-3c951624-2318-4b32-b2da-82b90930602d tempest-TestMinimumBasicScenario-1602759881 tempest-TestMinimumBasicScenario-1602759881-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:27:33.404312 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-3c951624-2318-4b32-b2da-82b90930602d tempest-TestMinimumBasicScenario-1602759881 tempest-TestMinimumBasicScenario-1602759881-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:27:33.476190 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [None req-3c951624-2318-4b32-b2da-82b90930602d tempest-TestMinimumBasicScenario-1602759881 tempest-TestMinimumBasicScenario-1602759881-project] 10.222.0.43 "POST /compute/v2.1/servers/3a9c029c-4daa-4ae2-b624-6d227fd03923/action" status: 202 len: 0 microversion: 2.1 time: 0.089779 Jun 22 10:27:33.476808 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 511/1028] 10.222.0.43 () {60 vars in 1277 bytes} [Wed Jun 22 10:27:33 2022] POST /compute/v2.1/servers/3a9c029c-4daa-4ae2-b624-6d227fd03923/action => generated 0 bytes in 91 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 22 10:27:33.486527 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-e8020284-b683-4256-b1cf-679561a1662e tempest-TestMinimumBasicScenario-1602759881 tempest-TestMinimumBasicScenario-1602759881-project] Calling method '>' {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:27:33.487131 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.compute.api [None req-e8020284-b683-4256-b1cf-679561a1662e tempest-TestMinimumBasicScenario-1602759881 tempest-TestMinimumBasicScenario-1602759881-project] [instance: 3a9c029c-4daa-4ae2-b624-6d227fd03923] Fetching instance by UUID {{(pid=117874) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:27:33.489732 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG dbcounter [-] [117874] Writing DB stats nova_api:SELECT=49,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=117874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:27:33.490537 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG dbcounter [-] [117874] Writing DB stats nova_cell1:SELECT=23,nova_cell1:INSERT=1 {{(pid=117874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:27:33.496958 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-e8020284-b683-4256-b1cf-679561a1662e tempest-TestMinimumBasicScenario-1602759881 tempest-TestMinimumBasicScenario-1602759881-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:27:33.497469 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-e8020284-b683-4256-b1cf-679561a1662e tempest-TestMinimumBasicScenario-1602759881 tempest-TestMinimumBasicScenario-1602759881-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:27:33.499137 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-e8020284-b683-4256-b1cf-679561a1662e tempest-TestMinimumBasicScenario-1602759881 tempest-TestMinimumBasicScenario-1602759881-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:27:33.499572 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-e8020284-b683-4256-b1cf-679561a1662e tempest-TestMinimumBasicScenario-1602759881 tempest-TestMinimumBasicScenario-1602759881-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:27:33.650088 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.policy [None req-e8020284-b683-4256-b1cf-679561a1662e tempest-TestMinimumBasicScenario-1602759881 tempest-TestMinimumBasicScenario-1602759881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21a35a18c4d74109ac1dacc120bbe0fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4d8e96d47af4667a2f478e6561353d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117874) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:27:33.658548 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [None req-e8020284-b683-4256-b1cf-679561a1662e tempest-TestMinimumBasicScenario-1602759881 tempest-TestMinimumBasicScenario-1602759881-project] 10.222.0.43 "GET /compute/v2.1/servers/3a9c029c-4daa-4ae2-b624-6d227fd03923" status: 200 len: 1754 microversion: 2.1 time: 0.176032 Jun 22 10:27:33.659125 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 518/1029] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:27:33 2022] GET /compute/v2.1/servers/3a9c029c-4daa-4ae2-b624-6d227fd03923 => generated 1754 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:27:34.677533 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-f8c6472f-9411-472b-88ee-43a3579b46d6 tempest-TestMinimumBasicScenario-1602759881 tempest-TestMinimumBasicScenario-1602759881-project] Calling method '>' {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:27:34.678247 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.compute.api [None req-f8c6472f-9411-472b-88ee-43a3579b46d6 tempest-TestMinimumBasicScenario-1602759881 tempest-TestMinimumBasicScenario-1602759881-project] [instance: 3a9c029c-4daa-4ae2-b624-6d227fd03923] Fetching instance by UUID {{(pid=117873) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:27:34.685049 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-f8c6472f-9411-472b-88ee-43a3579b46d6 tempest-TestMinimumBasicScenario-1602759881 tempest-TestMinimumBasicScenario-1602759881-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:27:34.685490 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-f8c6472f-9411-472b-88ee-43a3579b46d6 tempest-TestMinimumBasicScenario-1602759881 tempest-TestMinimumBasicScenario-1602759881-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:27:34.686275 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-f8c6472f-9411-472b-88ee-43a3579b46d6 tempest-TestMinimumBasicScenario-1602759881 tempest-TestMinimumBasicScenario-1602759881-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:27:34.686706 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-f8c6472f-9411-472b-88ee-43a3579b46d6 tempest-TestMinimumBasicScenario-1602759881 tempest-TestMinimumBasicScenario-1602759881-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:27:34.828449 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.policy [None req-f8c6472f-9411-472b-88ee-43a3579b46d6 tempest-TestMinimumBasicScenario-1602759881 tempest-TestMinimumBasicScenario-1602759881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21a35a18c4d74109ac1dacc120bbe0fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4d8e96d47af4667a2f478e6561353d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117873) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:27:34.836255 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [None req-f8c6472f-9411-472b-88ee-43a3579b46d6 tempest-TestMinimumBasicScenario-1602759881 tempest-TestMinimumBasicScenario-1602759881-project] 10.222.0.43 "GET /compute/v2.1/servers/3a9c029c-4daa-4ae2-b624-6d227fd03923" status: 200 len: 1759 microversion: 2.1 time: 0.163436 Jun 22 10:27:34.837609 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 512/1030] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:27:34 2022] GET /compute/v2.1/servers/3a9c029c-4daa-4ae2-b624-6d227fd03923 => generated 1759 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:27:35.855365 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-7df3bfda-61c3-4c03-b801-502058d156f6 tempest-TestMinimumBasicScenario-1602759881 tempest-TestMinimumBasicScenario-1602759881-project] Calling method '>' {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:27:35.855969 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.compute.api [None req-7df3bfda-61c3-4c03-b801-502058d156f6 tempest-TestMinimumBasicScenario-1602759881 tempest-TestMinimumBasicScenario-1602759881-project] [instance: 3a9c029c-4daa-4ae2-b624-6d227fd03923] Fetching instance by UUID {{(pid=117874) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:27:35.861946 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-7df3bfda-61c3-4c03-b801-502058d156f6 tempest-TestMinimumBasicScenario-1602759881 tempest-TestMinimumBasicScenario-1602759881-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:27:35.862385 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-7df3bfda-61c3-4c03-b801-502058d156f6 tempest-TestMinimumBasicScenario-1602759881 tempest-TestMinimumBasicScenario-1602759881-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:27:35.863134 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-7df3bfda-61c3-4c03-b801-502058d156f6 tempest-TestMinimumBasicScenario-1602759881 tempest-TestMinimumBasicScenario-1602759881-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:27:35.863572 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-7df3bfda-61c3-4c03-b801-502058d156f6 tempest-TestMinimumBasicScenario-1602759881 tempest-TestMinimumBasicScenario-1602759881-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:27:36.009761 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.policy [None req-7df3bfda-61c3-4c03-b801-502058d156f6 tempest-TestMinimumBasicScenario-1602759881 tempest-TestMinimumBasicScenario-1602759881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21a35a18c4d74109ac1dacc120bbe0fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4d8e96d47af4667a2f478e6561353d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117874) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:27:36.017604 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [None req-7df3bfda-61c3-4c03-b801-502058d156f6 tempest-TestMinimumBasicScenario-1602759881 tempest-TestMinimumBasicScenario-1602759881-project] 10.222.0.43 "GET /compute/v2.1/servers/3a9c029c-4daa-4ae2-b624-6d227fd03923" status: 200 len: 1759 microversion: 2.1 time: 0.166767 Jun 22 10:27:36.018194 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 519/1031] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:27:35 2022] GET /compute/v2.1/servers/3a9c029c-4daa-4ae2-b624-6d227fd03923 => generated 1759 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:27:37.034979 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-51920ab0-87c5-4674-8186-f7ed9dfe4f78 tempest-TestMinimumBasicScenario-1602759881 tempest-TestMinimumBasicScenario-1602759881-project] Calling method '>' {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:27:37.035578 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.compute.api [None req-51920ab0-87c5-4674-8186-f7ed9dfe4f78 tempest-TestMinimumBasicScenario-1602759881 tempest-TestMinimumBasicScenario-1602759881-project] [instance: 3a9c029c-4daa-4ae2-b624-6d227fd03923] Fetching instance by UUID {{(pid=117873) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:27:37.041986 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-51920ab0-87c5-4674-8186-f7ed9dfe4f78 tempest-TestMinimumBasicScenario-1602759881 tempest-TestMinimumBasicScenario-1602759881-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:27:37.042426 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-51920ab0-87c5-4674-8186-f7ed9dfe4f78 tempest-TestMinimumBasicScenario-1602759881 tempest-TestMinimumBasicScenario-1602759881-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:27:37.043166 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-51920ab0-87c5-4674-8186-f7ed9dfe4f78 tempest-TestMinimumBasicScenario-1602759881 tempest-TestMinimumBasicScenario-1602759881-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:27:37.043593 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-51920ab0-87c5-4674-8186-f7ed9dfe4f78 tempest-TestMinimumBasicScenario-1602759881 tempest-TestMinimumBasicScenario-1602759881-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:27:37.189975 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.policy [None req-51920ab0-87c5-4674-8186-f7ed9dfe4f78 tempest-TestMinimumBasicScenario-1602759881 tempest-TestMinimumBasicScenario-1602759881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21a35a18c4d74109ac1dacc120bbe0fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4d8e96d47af4667a2f478e6561353d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117873) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:27:37.201791 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [None req-51920ab0-87c5-4674-8186-f7ed9dfe4f78 tempest-TestMinimumBasicScenario-1602759881 tempest-TestMinimumBasicScenario-1602759881-project] 10.222.0.43 "GET /compute/v2.1/servers/3a9c029c-4daa-4ae2-b624-6d227fd03923" status: 200 len: 1759 microversion: 2.1 time: 0.167318 Jun 22 10:27:37.201791 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 513/1032] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:27:37 2022] GET /compute/v2.1/servers/3a9c029c-4daa-4ae2-b624-6d227fd03923 => generated 1759 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:27:38.219506 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-df69e766-11b1-4595-94e6-b33a6bf786f9 tempest-TestMinimumBasicScenario-1602759881 tempest-TestMinimumBasicScenario-1602759881-project] Calling method '>' {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:27:38.220105 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.compute.api [None req-df69e766-11b1-4595-94e6-b33a6bf786f9 tempest-TestMinimumBasicScenario-1602759881 tempest-TestMinimumBasicScenario-1602759881-project] [instance: 3a9c029c-4daa-4ae2-b624-6d227fd03923] Fetching instance by UUID {{(pid=117874) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:27:38.226936 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-df69e766-11b1-4595-94e6-b33a6bf786f9 tempest-TestMinimumBasicScenario-1602759881 tempest-TestMinimumBasicScenario-1602759881-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:27:38.227959 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-df69e766-11b1-4595-94e6-b33a6bf786f9 tempest-TestMinimumBasicScenario-1602759881 tempest-TestMinimumBasicScenario-1602759881-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:27:38.228729 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-df69e766-11b1-4595-94e6-b33a6bf786f9 tempest-TestMinimumBasicScenario-1602759881 tempest-TestMinimumBasicScenario-1602759881-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:27:38.229169 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-df69e766-11b1-4595-94e6-b33a6bf786f9 tempest-TestMinimumBasicScenario-1602759881 tempest-TestMinimumBasicScenario-1602759881-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:27:38.377141 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.policy [None req-df69e766-11b1-4595-94e6-b33a6bf786f9 tempest-TestMinimumBasicScenario-1602759881 tempest-TestMinimumBasicScenario-1602759881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21a35a18c4d74109ac1dacc120bbe0fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4d8e96d47af4667a2f478e6561353d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117874) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:27:38.385931 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [None req-df69e766-11b1-4595-94e6-b33a6bf786f9 tempest-TestMinimumBasicScenario-1602759881 tempest-TestMinimumBasicScenario-1602759881-project] 10.222.0.43 "GET /compute/v2.1/servers/3a9c029c-4daa-4ae2-b624-6d227fd03923" status: 200 len: 1759 microversion: 2.1 time: 0.172646 Jun 22 10:27:38.386488 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 520/1033] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:27:38 2022] GET /compute/v2.1/servers/3a9c029c-4daa-4ae2-b624-6d227fd03923 => generated 1759 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:27:39.403585 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-f5efa2e9-b8c2-4209-8378-dccc24b36170 tempest-TestMinimumBasicScenario-1602759881 tempest-TestMinimumBasicScenario-1602759881-project] Calling method '>' {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:27:39.404131 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.compute.api [None req-f5efa2e9-b8c2-4209-8378-dccc24b36170 tempest-TestMinimumBasicScenario-1602759881 tempest-TestMinimumBasicScenario-1602759881-project] [instance: 3a9c029c-4daa-4ae2-b624-6d227fd03923] Fetching instance by UUID {{(pid=117873) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:27:39.410711 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-f5efa2e9-b8c2-4209-8378-dccc24b36170 tempest-TestMinimumBasicScenario-1602759881 tempest-TestMinimumBasicScenario-1602759881-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:27:39.411150 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-f5efa2e9-b8c2-4209-8378-dccc24b36170 tempest-TestMinimumBasicScenario-1602759881 tempest-TestMinimumBasicScenario-1602759881-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:27:39.411891 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-f5efa2e9-b8c2-4209-8378-dccc24b36170 tempest-TestMinimumBasicScenario-1602759881 tempest-TestMinimumBasicScenario-1602759881-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:27:39.412318 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-f5efa2e9-b8c2-4209-8378-dccc24b36170 tempest-TestMinimumBasicScenario-1602759881 tempest-TestMinimumBasicScenario-1602759881-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:27:39.562734 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.policy [None req-f5efa2e9-b8c2-4209-8378-dccc24b36170 tempest-TestMinimumBasicScenario-1602759881 tempest-TestMinimumBasicScenario-1602759881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21a35a18c4d74109ac1dacc120bbe0fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4d8e96d47af4667a2f478e6561353d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117873) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:27:39.570752 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [None req-f5efa2e9-b8c2-4209-8378-dccc24b36170 tempest-TestMinimumBasicScenario-1602759881 tempest-TestMinimumBasicScenario-1602759881-project] 10.222.0.43 "GET /compute/v2.1/servers/3a9c029c-4daa-4ae2-b624-6d227fd03923" status: 200 len: 1759 microversion: 2.1 time: 0.170980 Jun 22 10:27:39.571322 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 514/1034] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:27:39 2022] GET /compute/v2.1/servers/3a9c029c-4daa-4ae2-b624-6d227fd03923 => generated 1759 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:27:40.587947 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-bdbdb3bc-0dab-4276-8fb6-d9276fc321a2 tempest-TestMinimumBasicScenario-1602759881 tempest-TestMinimumBasicScenario-1602759881-project] Calling method '>' {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:27:40.588549 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.compute.api [None req-bdbdb3bc-0dab-4276-8fb6-d9276fc321a2 tempest-TestMinimumBasicScenario-1602759881 tempest-TestMinimumBasicScenario-1602759881-project] [instance: 3a9c029c-4daa-4ae2-b624-6d227fd03923] Fetching instance by UUID {{(pid=117874) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:27:40.595117 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-bdbdb3bc-0dab-4276-8fb6-d9276fc321a2 tempest-TestMinimumBasicScenario-1602759881 tempest-TestMinimumBasicScenario-1602759881-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:27:40.595565 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-bdbdb3bc-0dab-4276-8fb6-d9276fc321a2 tempest-TestMinimumBasicScenario-1602759881 tempest-TestMinimumBasicScenario-1602759881-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:27:40.596322 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-bdbdb3bc-0dab-4276-8fb6-d9276fc321a2 tempest-TestMinimumBasicScenario-1602759881 tempest-TestMinimumBasicScenario-1602759881-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:27:40.596752 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-bdbdb3bc-0dab-4276-8fb6-d9276fc321a2 tempest-TestMinimumBasicScenario-1602759881 tempest-TestMinimumBasicScenario-1602759881-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:27:40.743123 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.policy [None req-bdbdb3bc-0dab-4276-8fb6-d9276fc321a2 tempest-TestMinimumBasicScenario-1602759881 tempest-TestMinimumBasicScenario-1602759881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21a35a18c4d74109ac1dacc120bbe0fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4d8e96d47af4667a2f478e6561353d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117874) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:27:40.751067 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [None req-bdbdb3bc-0dab-4276-8fb6-d9276fc321a2 tempest-TestMinimumBasicScenario-1602759881 tempest-TestMinimumBasicScenario-1602759881-project] 10.222.0.43 "GET /compute/v2.1/servers/3a9c029c-4daa-4ae2-b624-6d227fd03923" status: 200 len: 1759 microversion: 2.1 time: 0.167051 Jun 22 10:27:40.751636 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 521/1035] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:27:40 2022] GET /compute/v2.1/servers/3a9c029c-4daa-4ae2-b624-6d227fd03923 => generated 1759 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:27:41.768666 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-38e61ff0-737d-41ce-be39-66bca6501728 tempest-TestMinimumBasicScenario-1602759881 tempest-TestMinimumBasicScenario-1602759881-project] Calling method '>' {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:27:41.769277 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.compute.api [None req-38e61ff0-737d-41ce-be39-66bca6501728 tempest-TestMinimumBasicScenario-1602759881 tempest-TestMinimumBasicScenario-1602759881-project] [instance: 3a9c029c-4daa-4ae2-b624-6d227fd03923] Fetching instance by UUID {{(pid=117873) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:27:41.776371 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-38e61ff0-737d-41ce-be39-66bca6501728 tempest-TestMinimumBasicScenario-1602759881 tempest-TestMinimumBasicScenario-1602759881-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:27:41.776816 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-38e61ff0-737d-41ce-be39-66bca6501728 tempest-TestMinimumBasicScenario-1602759881 tempest-TestMinimumBasicScenario-1602759881-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:27:41.777573 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-38e61ff0-737d-41ce-be39-66bca6501728 tempest-TestMinimumBasicScenario-1602759881 tempest-TestMinimumBasicScenario-1602759881-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:27:41.778030 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-38e61ff0-737d-41ce-be39-66bca6501728 tempest-TestMinimumBasicScenario-1602759881 tempest-TestMinimumBasicScenario-1602759881-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:27:41.923201 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.policy [None req-38e61ff0-737d-41ce-be39-66bca6501728 tempest-TestMinimumBasicScenario-1602759881 tempest-TestMinimumBasicScenario-1602759881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21a35a18c4d74109ac1dacc120bbe0fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4d8e96d47af4667a2f478e6561353d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117873) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:27:41.931661 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [None req-38e61ff0-737d-41ce-be39-66bca6501728 tempest-TestMinimumBasicScenario-1602759881 tempest-TestMinimumBasicScenario-1602759881-project] 10.222.0.43 "GET /compute/v2.1/servers/3a9c029c-4daa-4ae2-b624-6d227fd03923" status: 200 len: 1759 microversion: 2.1 time: 0.166254 Jun 22 10:27:41.932227 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 515/1036] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:27:41 2022] GET /compute/v2.1/servers/3a9c029c-4daa-4ae2-b624-6d227fd03923 => generated 1759 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:27:42.951555 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-eea593f9-3c3d-46cc-bb28-234740375577 tempest-TestMinimumBasicScenario-1602759881 tempest-TestMinimumBasicScenario-1602759881-project] Calling method '>' {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:27:42.952113 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.compute.api [None req-eea593f9-3c3d-46cc-bb28-234740375577 tempest-TestMinimumBasicScenario-1602759881 tempest-TestMinimumBasicScenario-1602759881-project] [instance: 3a9c029c-4daa-4ae2-b624-6d227fd03923] Fetching instance by UUID {{(pid=117874) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:27:42.958530 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-eea593f9-3c3d-46cc-bb28-234740375577 tempest-TestMinimumBasicScenario-1602759881 tempest-TestMinimumBasicScenario-1602759881-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:27:42.958966 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-eea593f9-3c3d-46cc-bb28-234740375577 tempest-TestMinimumBasicScenario-1602759881 tempest-TestMinimumBasicScenario-1602759881-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:27:42.959715 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-eea593f9-3c3d-46cc-bb28-234740375577 tempest-TestMinimumBasicScenario-1602759881 tempest-TestMinimumBasicScenario-1602759881-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:27:42.960144 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-eea593f9-3c3d-46cc-bb28-234740375577 tempest-TestMinimumBasicScenario-1602759881 tempest-TestMinimumBasicScenario-1602759881-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:27:43.105407 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.policy [None req-eea593f9-3c3d-46cc-bb28-234740375577 tempest-TestMinimumBasicScenario-1602759881 tempest-TestMinimumBasicScenario-1602759881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21a35a18c4d74109ac1dacc120bbe0fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4d8e96d47af4667a2f478e6561353d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117874) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:27:43.113514 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [None req-eea593f9-3c3d-46cc-bb28-234740375577 tempest-TestMinimumBasicScenario-1602759881 tempest-TestMinimumBasicScenario-1602759881-project] 10.222.0.43 "GET /compute/v2.1/servers/3a9c029c-4daa-4ae2-b624-6d227fd03923" status: 200 len: 1759 microversion: 2.1 time: 0.166717 Jun 22 10:27:43.114113 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 522/1037] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:27:42 2022] GET /compute/v2.1/servers/3a9c029c-4daa-4ae2-b624-6d227fd03923 => generated 1759 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:27:44.130288 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-220d1e73-60fb-4254-93c9-3ce937566fbe tempest-TestMinimumBasicScenario-1602759881 tempest-TestMinimumBasicScenario-1602759881-project] Calling method '>' {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:27:44.130895 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.compute.api [None req-220d1e73-60fb-4254-93c9-3ce937566fbe tempest-TestMinimumBasicScenario-1602759881 tempest-TestMinimumBasicScenario-1602759881-project] [instance: 3a9c029c-4daa-4ae2-b624-6d227fd03923] Fetching instance by UUID {{(pid=117873) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:27:44.137496 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-220d1e73-60fb-4254-93c9-3ce937566fbe tempest-TestMinimumBasicScenario-1602759881 tempest-TestMinimumBasicScenario-1602759881-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:27:44.137971 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-220d1e73-60fb-4254-93c9-3ce937566fbe tempest-TestMinimumBasicScenario-1602759881 tempest-TestMinimumBasicScenario-1602759881-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:27:44.138729 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-220d1e73-60fb-4254-93c9-3ce937566fbe tempest-TestMinimumBasicScenario-1602759881 tempest-TestMinimumBasicScenario-1602759881-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:27:44.139162 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-220d1e73-60fb-4254-93c9-3ce937566fbe tempest-TestMinimumBasicScenario-1602759881 tempest-TestMinimumBasicScenario-1602759881-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:27:44.281889 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.policy [None req-220d1e73-60fb-4254-93c9-3ce937566fbe tempest-TestMinimumBasicScenario-1602759881 tempest-TestMinimumBasicScenario-1602759881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21a35a18c4d74109ac1dacc120bbe0fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4d8e96d47af4667a2f478e6561353d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117873) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:27:44.289677 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [None req-220d1e73-60fb-4254-93c9-3ce937566fbe tempest-TestMinimumBasicScenario-1602759881 tempest-TestMinimumBasicScenario-1602759881-project] 10.222.0.43 "GET /compute/v2.1/servers/3a9c029c-4daa-4ae2-b624-6d227fd03923" status: 200 len: 1759 microversion: 2.1 time: 0.163226 Jun 22 10:27:44.290763 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 516/1038] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:27:44 2022] GET /compute/v2.1/servers/3a9c029c-4daa-4ae2-b624-6d227fd03923 => generated 1759 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:27:45.307947 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-99452db9-b297-494e-b21e-402fafa45b15 tempest-TestMinimumBasicScenario-1602759881 tempest-TestMinimumBasicScenario-1602759881-project] Calling method '>' {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:27:45.308566 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.compute.api [None req-99452db9-b297-494e-b21e-402fafa45b15 tempest-TestMinimumBasicScenario-1602759881 tempest-TestMinimumBasicScenario-1602759881-project] [instance: 3a9c029c-4daa-4ae2-b624-6d227fd03923] Fetching instance by UUID {{(pid=117874) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:27:45.315306 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-99452db9-b297-494e-b21e-402fafa45b15 tempest-TestMinimumBasicScenario-1602759881 tempest-TestMinimumBasicScenario-1602759881-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:27:45.315757 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-99452db9-b297-494e-b21e-402fafa45b15 tempest-TestMinimumBasicScenario-1602759881 tempest-TestMinimumBasicScenario-1602759881-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:27:45.316529 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-99452db9-b297-494e-b21e-402fafa45b15 tempest-TestMinimumBasicScenario-1602759881 tempest-TestMinimumBasicScenario-1602759881-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:27:45.316970 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-99452db9-b297-494e-b21e-402fafa45b15 tempest-TestMinimumBasicScenario-1602759881 tempest-TestMinimumBasicScenario-1602759881-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:27:45.460868 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.policy [None req-99452db9-b297-494e-b21e-402fafa45b15 tempest-TestMinimumBasicScenario-1602759881 tempest-TestMinimumBasicScenario-1602759881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21a35a18c4d74109ac1dacc120bbe0fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4d8e96d47af4667a2f478e6561353d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117874) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:27:45.469023 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [None req-99452db9-b297-494e-b21e-402fafa45b15 tempest-TestMinimumBasicScenario-1602759881 tempest-TestMinimumBasicScenario-1602759881-project] 10.222.0.43 "GET /compute/v2.1/servers/3a9c029c-4daa-4ae2-b624-6d227fd03923" status: 200 len: 1762 microversion: 2.1 time: 0.165766 Jun 22 10:27:45.469596 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 523/1039] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:27:45 2022] GET /compute/v2.1/servers/3a9c029c-4daa-4ae2-b624-6d227fd03923 => generated 1762 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:28:04.162501 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-0ab78e91-1739-475a-80e8-3d911d4b8c6a tempest-TestShelveInstance-1869927250 tempest-TestShelveInstance-1869927250-project] Calling method '>' {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:28:04.163019 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.compute.api [None req-0ab78e91-1739-475a-80e8-3d911d4b8c6a tempest-TestShelveInstance-1869927250 tempest-TestShelveInstance-1869927250-project] [instance: 46804c86-520a-407d-84a9-2f6d1ea1cff0] Fetching instance by UUID {{(pid=117873) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:28:04.166388 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [req-4c4bcc10-f60a-4515-ad0f-0ab2956a086c req-256f6eed-99df-42db-aa5e-9555402c343f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "46804c86-520a-407d-84a9-2f6d1ea1cff0", "tag": "377da38d-a656-43c8-babd-6b00935ec9f5"}]} {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:28:04.169554 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG dbcounter [-] [117873] Writing DB stats nova_api:SELECT=12 {{(pid=117873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:28:04.170372 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG dbcounter [-] [117873] Writing DB stats nova_cell1:SELECT=40,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:28:04.172599 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-0ab78e91-1739-475a-80e8-3d911d4b8c6a tempest-TestShelveInstance-1869927250 tempest-TestShelveInstance-1869927250-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:28:04.173125 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-0ab78e91-1739-475a-80e8-3d911d4b8c6a tempest-TestShelveInstance-1869927250 tempest-TestShelveInstance-1869927250-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:28:04.174073 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-0ab78e91-1739-475a-80e8-3d911d4b8c6a tempest-TestShelveInstance-1869927250 tempest-TestShelveInstance-1869927250-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:28:04.174604 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-0ab78e91-1739-475a-80e8-3d911d4b8c6a tempest-TestShelveInstance-1869927250 tempest-TestShelveInstance-1869927250-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:28:04.174731 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG dbcounter [-] [117874] Writing DB stats nova_api:SELECT=12 {{(pid=117874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:28:04.175415 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG dbcounter [-] [117874] Writing DB stats nova_cell1:SELECT=36 {{(pid=117874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:28:04.177654 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [req-4c4bcc10-f60a-4515-ad0f-0ab2956a086c req-256f6eed-99df-42db-aa5e-9555402c343f service nova] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:28:04.178329 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [req-4c4bcc10-f60a-4515-ad0f-0ab2956a086c req-256f6eed-99df-42db-aa5e-9555402c343f service nova] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:28:04.192612 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.compute.server_external_events [req-4c4bcc10-f60a-4515-ad0f-0ab2956a086c req-256f6eed-99df-42db-aa5e-9555402c343f service nova] Creating event network-changed:377da38d-a656-43c8-babd-6b00935ec9f5 for instance 46804c86-520a-407d-84a9-2f6d1ea1cff0 on hv-cinder-84713 Jun 22 10:28:04.198017 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [req-4c4bcc10-f60a-4515-ad0f-0ab2956a086c req-256f6eed-99df-42db-aa5e-9555402c343f service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036686 Jun 22 10:28:04.200049 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 524/1040] 10.222.0.43 () {64 vars in 1317 bytes} [Wed Jun 22 10:28:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 10:28:04.205968 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.compute.api [None req-0ab78e91-1739-475a-80e8-3d911d4b8c6a tempest-TestShelveInstance-1869927250 tempest-TestShelveInstance-1869927250-project] [instance: 46804c86-520a-407d-84a9-2f6d1ea1cff0] Going to try to terminate instance {{(pid=117873) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 22 10:28:04.292010 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [None req-0ab78e91-1739-475a-80e8-3d911d4b8c6a tempest-TestShelveInstance-1869927250 tempest-TestShelveInstance-1869927250-project] 10.222.0.43 "DELETE /compute/v2.1/servers/46804c86-520a-407d-84a9-2f6d1ea1cff0" status: 204 len: 0 microversion: 2.1 time: 0.133586 Jun 22 10:28:04.293603 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 517/1041] 10.222.0.43 () {58 vars in 1238 bytes} [Wed Jun 22 10:28:04 2022] DELETE /compute/v2.1/servers/46804c86-520a-407d-84a9-2f6d1ea1cff0 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 22 10:28:04.302636 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-93360a49-02fa-48bf-a53d-a2e6e788f650 tempest-TestShelveInstance-1869927250 tempest-TestShelveInstance-1869927250-project] Calling method '>' {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:28:04.302922 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.compute.api [None req-93360a49-02fa-48bf-a53d-a2e6e788f650 tempest-TestShelveInstance-1869927250 tempest-TestShelveInstance-1869927250-project] [instance: 46804c86-520a-407d-84a9-2f6d1ea1cff0] Fetching instance by UUID {{(pid=117874) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:28:04.309525 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-93360a49-02fa-48bf-a53d-a2e6e788f650 tempest-TestShelveInstance-1869927250 tempest-TestShelveInstance-1869927250-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:28:04.310085 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-93360a49-02fa-48bf-a53d-a2e6e788f650 tempest-TestShelveInstance-1869927250 tempest-TestShelveInstance-1869927250-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:28:04.310933 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-93360a49-02fa-48bf-a53d-a2e6e788f650 tempest-TestShelveInstance-1869927250 tempest-TestShelveInstance-1869927250-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:28:04.311443 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-93360a49-02fa-48bf-a53d-a2e6e788f650 tempest-TestShelveInstance-1869927250 tempest-TestShelveInstance-1869927250-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:28:04.454998 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.policy [None req-93360a49-02fa-48bf-a53d-a2e6e788f650 tempest-TestShelveInstance-1869927250 tempest-TestShelveInstance-1869927250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6428e56cd9b46feb6a7b04e4d00c162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa9a1da5cb5a4279abb88ec7bdb1ef6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117874) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:28:04.463614 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [None req-93360a49-02fa-48bf-a53d-a2e6e788f650 tempest-TestShelveInstance-1869927250 tempest-TestShelveInstance-1869927250-project] 10.222.0.43 "GET /compute/v2.1/servers/46804c86-520a-407d-84a9-2f6d1ea1cff0" status: 200 len: 1568 microversion: 2.1 time: 0.165540 Jun 22 10:28:04.464188 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 525/1042] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:28:04 2022] GET /compute/v2.1/servers/46804c86-520a-407d-84a9-2f6d1ea1cff0 => generated 1568 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 10:28:05.483530 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-b40106c0-1c5e-4bbd-bb8d-f0ac9707c00b tempest-TestShelveInstance-1869927250 tempest-TestShelveInstance-1869927250-project] Calling method '>' {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:28:05.484242 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.compute.api [None req-b40106c0-1c5e-4bbd-bb8d-f0ac9707c00b tempest-TestShelveInstance-1869927250 tempest-TestShelveInstance-1869927250-project] [instance: 46804c86-520a-407d-84a9-2f6d1ea1cff0] Fetching instance by UUID {{(pid=117873) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:28:05.490576 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-b40106c0-1c5e-4bbd-bb8d-f0ac9707c00b tempest-TestShelveInstance-1869927250 tempest-TestShelveInstance-1869927250-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:28:05.491015 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-b40106c0-1c5e-4bbd-bb8d-f0ac9707c00b tempest-TestShelveInstance-1869927250 tempest-TestShelveInstance-1869927250-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:28:05.491790 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-b40106c0-1c5e-4bbd-bb8d-f0ac9707c00b tempest-TestShelveInstance-1869927250 tempest-TestShelveInstance-1869927250-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:28:05.492216 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-b40106c0-1c5e-4bbd-bb8d-f0ac9707c00b tempest-TestShelveInstance-1869927250 tempest-TestShelveInstance-1869927250-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:28:05.624231 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.policy [None req-b40106c0-1c5e-4bbd-bb8d-f0ac9707c00b tempest-TestShelveInstance-1869927250 tempest-TestShelveInstance-1869927250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6428e56cd9b46feb6a7b04e4d00c162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa9a1da5cb5a4279abb88ec7bdb1ef6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117873) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:28:05.631582 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [None req-b40106c0-1c5e-4bbd-bb8d-f0ac9707c00b tempest-TestShelveInstance-1869927250 tempest-TestShelveInstance-1869927250-project] 10.222.0.43 "GET /compute/v2.1/servers/46804c86-520a-407d-84a9-2f6d1ea1cff0" status: 200 len: 1568 microversion: 2.1 time: 0.153260 Jun 22 10:28:05.632147 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 518/1043] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:28:05 2022] GET /compute/v2.1/servers/46804c86-520a-407d-84a9-2f6d1ea1cff0 => generated 1568 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:28:06.320629 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [req-9478eec8-220c-43ba-9dd3-279eee88d0b7 req-cb3bffba-0a7d-4e77-91f8-a7d5f2eb5d20 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "46804c86-520a-407d-84a9-2f6d1ea1cff0", "name": "network-vif-deleted", "tag": "377da38d-a656-43c8-babd-6b00935ec9f5"}]} {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:28:06.331073 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [req-9478eec8-220c-43ba-9dd3-279eee88d0b7 req-cb3bffba-0a7d-4e77-91f8-a7d5f2eb5d20 service nova] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:28:06.331522 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [req-9478eec8-220c-43ba-9dd3-279eee88d0b7 req-cb3bffba-0a7d-4e77-91f8-a7d5f2eb5d20 service nova] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:28:06.343327 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.compute.server_external_events [req-9478eec8-220c-43ba-9dd3-279eee88d0b7 req-cb3bffba-0a7d-4e77-91f8-a7d5f2eb5d20 service nova] Creating event network-vif-deleted:377da38d-a656-43c8-babd-6b00935ec9f5 for instance 46804c86-520a-407d-84a9-2f6d1ea1cff0 on hv-cinder-84713 Jun 22 10:28:06.347980 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [req-9478eec8-220c-43ba-9dd3-279eee88d0b7 req-cb3bffba-0a7d-4e77-91f8-a7d5f2eb5d20 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031271 Jun 22 10:28:06.348704 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 526/1044] 10.222.0.43 () {64 vars in 1317 bytes} [Wed Jun 22 10:28:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 10:28:06.648534 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-f242a94a-a0d9-4eaa-9a20-5c97ff36cbd1 tempest-TestShelveInstance-1869927250 tempest-TestShelveInstance-1869927250-project] Calling method '>' {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:28:06.649130 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.compute.api [None req-f242a94a-a0d9-4eaa-9a20-5c97ff36cbd1 tempest-TestShelveInstance-1869927250 tempest-TestShelveInstance-1869927250-project] [instance: 46804c86-520a-407d-84a9-2f6d1ea1cff0] Fetching instance by UUID {{(pid=117873) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:28:06.656390 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-f242a94a-a0d9-4eaa-9a20-5c97ff36cbd1 tempest-TestShelveInstance-1869927250 tempest-TestShelveInstance-1869927250-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:28:06.656832 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-f242a94a-a0d9-4eaa-9a20-5c97ff36cbd1 tempest-TestShelveInstance-1869927250 tempest-TestShelveInstance-1869927250-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:28:06.657642 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-f242a94a-a0d9-4eaa-9a20-5c97ff36cbd1 tempest-TestShelveInstance-1869927250 tempest-TestShelveInstance-1869927250-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:28:06.658107 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-f242a94a-a0d9-4eaa-9a20-5c97ff36cbd1 tempest-TestShelveInstance-1869927250 tempest-TestShelveInstance-1869927250-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:28:06.693883 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-f242a94a-a0d9-4eaa-9a20-5c97ff36cbd1 tempest-TestShelveInstance-1869927250 tempest-TestShelveInstance-1869927250-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:28:06.694907 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-f242a94a-a0d9-4eaa-9a20-5c97ff36cbd1 tempest-TestShelveInstance-1869927250 tempest-TestShelveInstance-1869927250-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:28:06.695710 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.objects.instance [None req-f242a94a-a0d9-4eaa-9a20-5c97ff36cbd1 tempest-TestShelveInstance-1869927250 tempest-TestShelveInstance-1869927250-project] Lazy-loading 'fault' on Instance uuid 46804c86-520a-407d-84a9-2f6d1ea1cff0 {{(pid=117873) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 22 10:28:06.739346 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.policy [None req-f242a94a-a0d9-4eaa-9a20-5c97ff36cbd1 tempest-TestShelveInstance-1869927250 tempest-TestShelveInstance-1869927250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6428e56cd9b46feb6a7b04e4d00c162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa9a1da5cb5a4279abb88ec7bdb1ef6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117873) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:28:06.747817 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [None req-f242a94a-a0d9-4eaa-9a20-5c97ff36cbd1 tempest-TestShelveInstance-1869927250 tempest-TestShelveInstance-1869927250-project] 10.222.0.43 "GET /compute/v2.1/servers/46804c86-520a-407d-84a9-2f6d1ea1cff0" status: 200 len: 1224 microversion: 2.1 time: 0.103033 Jun 22 10:28:06.748538 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 519/1045] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:28:06 2022] GET /compute/v2.1/servers/46804c86-520a-407d-84a9-2f6d1ea1cff0 => generated 1224 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:28:07.766317 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-e769ce44-a28b-40f4-a2ab-7412af4a90fe tempest-TestShelveInstance-1869927250 tempest-TestShelveInstance-1869927250-project] Calling method '>' {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:28:07.767041 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.compute.api [None req-e769ce44-a28b-40f4-a2ab-7412af4a90fe tempest-TestShelveInstance-1869927250 tempest-TestShelveInstance-1869927250-project] [instance: 46804c86-520a-407d-84a9-2f6d1ea1cff0] Fetching instance by UUID {{(pid=117874) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:28:07.773235 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-e769ce44-a28b-40f4-a2ab-7412af4a90fe tempest-TestShelveInstance-1869927250 tempest-TestShelveInstance-1869927250-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:28:07.773683 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-e769ce44-a28b-40f4-a2ab-7412af4a90fe tempest-TestShelveInstance-1869927250 tempest-TestShelveInstance-1869927250-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:28:07.774466 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-e769ce44-a28b-40f4-a2ab-7412af4a90fe tempest-TestShelveInstance-1869927250 tempest-TestShelveInstance-1869927250-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:28:07.774897 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-e769ce44-a28b-40f4-a2ab-7412af4a90fe tempest-TestShelveInstance-1869927250 tempest-TestShelveInstance-1869927250-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:28:07.788583 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.wsgi [None req-e769ce44-a28b-40f4-a2ab-7412af4a90fe tempest-TestShelveInstance-1869927250 tempest-TestShelveInstance-1869927250-project] HTTP exception thrown: Instance 46804c86-520a-407d-84a9-2f6d1ea1cff0 could not be found. Jun 22 10:28:07.790212 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-e769ce44-a28b-40f4-a2ab-7412af4a90fe tempest-TestShelveInstance-1869927250 tempest-TestShelveInstance-1869927250-project] Request method failure captured: Jun 22 10:28:07.790212 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: request: GET /compute/v2.1/servers/46804c86-520a-407d-84a9-2f6d1ea1cff0 HTTP/1.1 Jun 22 10:28:07.790212 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: Accept: application/json Jun 22 10:28:07.790212 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: Accept-Encoding: identity Jun 22 10:28:07.790212 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: Connection: close Jun 22 10:28:07.790212 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: Content-Length: 0 Jun 22 10:28:07.790212 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: Content-Type: application/json Jun 22 10:28:07.790212 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: Host: 10.222.0.43 Jun 22 10:28:07.790212 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: Openstack-System-Scope: None Jun 22 10:28:07.790212 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: User-Agent: python-urllib3/1.26.9 Jun 22 10:28:07.790212 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-Auth-Token: gAAAAABisu2hBF1IY1paz1ptLhMtV_ZeEdJVwK_kw-Ml7pIMRRQgJW8ULE-GCEhi2pQPyukGmMlwHmi-idnIHrHNzG5N5vXLruCMM3ZmMTEOmuqggfiWX1-mOIvJClP2GCzqOS6ArKEtu3aDAFpnG1HTHpyr3BWcd0HAJE0bhecVTlTUKSOf8qI Jun 22 10:28:07.790212 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-Domain-Id: None Jun 22 10:28:07.790212 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-Domain-Name: None Jun 22 10:28:07.790212 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-Identity-Status: Confirmed Jun 22 10:28:07.790212 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-Is-Admin-Project: True Jun 22 10:28:07.790212 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-Project-Domain-Id: default Jun 22 10:28:07.790212 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-Project-Domain-Name: Default Jun 22 10:28:07.790212 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-Project-Id: aa9a1da5cb5a4279abb88ec7bdb1ef6b Jun 22 10:28:07.790212 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-Project-Name: tempest-TestShelveInstance-1869927250 Jun 22 10:28:07.790212 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-Role: reader,member Jun 22 10:28:07.790212 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-Roles: reader,member Jun 22 10:28:07.791949 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/aa9a1da5cb5a4279abb88ec7bdb1ef6b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/aa9a1da5cb5a4279abb88ec7bdb1ef6b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_aa9a1da5cb5a4279abb88ec7bdb1ef6b", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/aa9a1da5cb5a4279abb88ec7bdb1ef6b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}] Jun 22 10:28:07.791949 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-Tenant: tempest-TestShelveInstance-1869927250 Jun 22 10:28:07.791949 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-Tenant-Id: aa9a1da5cb5a4279abb88ec7bdb1ef6b Jun 22 10:28:07.791949 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-Tenant-Name: tempest-TestShelveInstance-1869927250 Jun 22 10:28:07.791949 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-User: tempest-TestShelveInstance-1869927250-project Jun 22 10:28:07.791949 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-User-Domain-Id: default Jun 22 10:28:07.791949 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-User-Domain-Name: Default Jun 22 10:28:07.791949 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-User-Id: d6428e56cd9b46feb6a7b04e4d00c162 Jun 22 10:28:07.791949 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-User-Name: tempest-TestShelveInstance-1869927250-project Jun 22 10:28:07.791949 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: method: > Jun 22 10:28:07.791949 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: exception: Instance 46804c86-520a-407d-84a9-2f6d1ea1cff0 could not be found. Jun 22 10:28:07.791949 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: action_args: {'id': '46804c86-520a-407d-84a9-2f6d1ea1cff0'} Jun 22 10:28:07.793543 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 10:28:07.793543 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:28:07.793543 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 22 10:28:07.793543 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 22 10:28:07.793543 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 22 10:28:07.793543 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 22 10:28:07.793543 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 22 10:28:07.793543 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 22 10:28:07.793543 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 22 10:28:07.793543 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 22 10:28:07.793543 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 46804c86-520a-407d-84a9-2f6d1ea1cff0 could not be found. Jun 22 10:28:07.793543 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi Jun 22 10:28:07.793543 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 10:28:07.793543 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi Jun 22 10:28:07.793543 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:28:07.793543 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 10:28:07.793543 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 10:28:07.793543 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 10:28:07.793543 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 10:28:07.793543 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 10:28:07.795016 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 10:28:07.795016 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 22 10:28:07.795016 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 22 10:28:07.795016 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 22 10:28:07.795016 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 22 10:28:07.795016 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 22 10:28:07.795016 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 22 10:28:07.795016 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 46804c86-520a-407d-84a9-2f6d1ea1cff0 could not be found. Jun 22 10:28:07.795016 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi Jun 22 10:28:07.795016 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 10:28:07.795016 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi Jun 22 10:28:07.795016 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:28:07.795016 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 10:28:07.795016 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 10:28:07.795016 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 10:28:07.795016 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 10:28:07.795016 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 46804c86-520a-407d-84a9-2f6d1ea1cff0 could not be found. Jun 22 10:28:07.795016 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi Jun 22 10:28:07.796293 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-e769ce44-a28b-40f4-a2ab-7412af4a90fe tempest-TestShelveInstance-1869927250 tempest-TestShelveInstance-1869927250-project] Returning 404 to user: Instance 46804c86-520a-407d-84a9-2f6d1ea1cff0 could not be found. {{(pid=117874) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 10:28:07.796293 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [None req-e769ce44-a28b-40f4-a2ab-7412af4a90fe tempest-TestShelveInstance-1869927250 tempest-TestShelveInstance-1869927250-project] 10.222.0.43 "GET /compute/v2.1/servers/46804c86-520a-407d-84a9-2f6d1ea1cff0" status: 404 len: 111 microversion: 2.1 time: 0.029987 Jun 22 10:28:07.796293 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 527/1046] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:28:07 2022] GET /compute/v2.1/servers/46804c86-520a-407d-84a9-2f6d1ea1cff0 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 22 10:28:07.954777 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-3a159365-33a8-4f02-9aa5-11e1eaeeeb85 tempest-TestShelveInstance-1869927250 tempest-TestShelveInstance-1869927250-project] Calling method '.version_select at 0x7f36be5c0430>' {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:28:07.978418 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [None req-3a159365-33a8-4f02-9aa5-11e1eaeeeb85 tempest-TestShelveInstance-1869927250 tempest-TestShelveInstance-1869927250-project] 10.222.0.43 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-503902195" status: 202 len: 0 microversion: 2.1 time: 0.027411 Jun 22 10:28:07.979039 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 520/1047] 10.222.0.43 () {58 vars in 1250 bytes} [Wed Jun 22 10:28:07 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-503902195 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 22 10:28:17.874031 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-110910c7-00c3-4891-a257-907f8110cd7e tempest-TestMinimumBasicScenario-1602759881 tempest-TestMinimumBasicScenario-1602759881-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1673371361"}} {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:28:17.874663 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.compute.api [None req-110910c7-00c3-4891-a257-907f8110cd7e tempest-TestMinimumBasicScenario-1602759881 tempest-TestMinimumBasicScenario-1602759881-project] [instance: 3a9c029c-4daa-4ae2-b624-6d227fd03923] Fetching instance by UUID {{(pid=117874) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:28:17.877121 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG dbcounter [-] [117874] Writing DB stats nova_api:SELECT=8 {{(pid=117874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:28:17.877798 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG dbcounter [-] [117874] Writing DB stats nova_cell1:SELECT=12 {{(pid=117874) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:28:17.883533 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-110910c7-00c3-4891-a257-907f8110cd7e tempest-TestMinimumBasicScenario-1602759881 tempest-TestMinimumBasicScenario-1602759881-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:28:17.883981 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-110910c7-00c3-4891-a257-907f8110cd7e tempest-TestMinimumBasicScenario-1602759881 tempest-TestMinimumBasicScenario-1602759881-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:28:17.884744 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-110910c7-00c3-4891-a257-907f8110cd7e tempest-TestMinimumBasicScenario-1602759881 tempest-TestMinimumBasicScenario-1602759881-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:28:17.885185 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-110910c7-00c3-4891-a257-907f8110cd7e tempest-TestMinimumBasicScenario-1602759881 tempest-TestMinimumBasicScenario-1602759881-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:28:18.013272 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.network.security_group_api [None req-110910c7-00c3-4891-a257-907f8110cd7e tempest-TestMinimumBasicScenario-1602759881 tempest-TestMinimumBasicScenario-1602759881-project] Removing security group b341b537-1b96-443b-9367-50ef9e9a2a7b from port 36a8b53c-154d-40ba-acfc-8a025c723d78 Jun 22 10:28:18.357108 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [None req-110910c7-00c3-4891-a257-907f8110cd7e tempest-TestMinimumBasicScenario-1602759881 tempest-TestMinimumBasicScenario-1602759881-project] 10.222.0.43 "POST /compute/v2.1/servers/3a9c029c-4daa-4ae2-b624-6d227fd03923/action" status: 202 len: 0 microversion: 2.1 time: 0.487905 Jun 22 10:28:18.358084 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 528/1048] 10.222.0.43 () {60 vars in 1277 bytes} [Wed Jun 22 10:28:17 2022] POST /compute/v2.1/servers/3a9c029c-4daa-4ae2-b624-6d227fd03923/action => generated 0 bytes in 489 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 22 10:28:18.371677 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [req-20558545-7ae1-4483-8c41-ecae2ba6b322 req-538ec9b5-6987-4620-a1b3-ffed231329a0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3a9c029c-4daa-4ae2-b624-6d227fd03923", "tag": "36a8b53c-154d-40ba-acfc-8a025c723d78"}]} {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:28:18.375834 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG dbcounter [-] [117873] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:28:18.378868 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG dbcounter [-] [117873] Writing DB stats nova_api:SELECT=16,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=117873) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:28:18.398629 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [req-20558545-7ae1-4483-8c41-ecae2ba6b322 req-538ec9b5-6987-4620-a1b3-ffed231329a0 service nova] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:28:18.399133 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [req-20558545-7ae1-4483-8c41-ecae2ba6b322 req-538ec9b5-6987-4620-a1b3-ffed231329a0 service nova] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:28:18.420255 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.compute.server_external_events [req-20558545-7ae1-4483-8c41-ecae2ba6b322 req-538ec9b5-6987-4620-a1b3-ffed231329a0 service nova] Creating event network-changed:36a8b53c-154d-40ba-acfc-8a025c723d78 for instance 3a9c029c-4daa-4ae2-b624-6d227fd03923 on hv-cinder-84713 Jun 22 10:28:18.428901 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [req-20558545-7ae1-4483-8c41-ecae2ba6b322 req-538ec9b5-6987-4620-a1b3-ffed231329a0 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061278 Jun 22 10:28:18.429813 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 521/1049] 10.222.0.43 () {64 vars in 1317 bytes} [Wed Jun 22 10:28:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 10:28:19.561904 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-40432922-3cd5-441d-9aad-6e2c871e268b tempest-TestMinimumBasicScenario-1602759881 tempest-TestMinimumBasicScenario-1602759881-project] Calling method '>' {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:28:19.562494 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.compute.api [None req-40432922-3cd5-441d-9aad-6e2c871e268b tempest-TestMinimumBasicScenario-1602759881 tempest-TestMinimumBasicScenario-1602759881-project] [instance: 3a9c029c-4daa-4ae2-b624-6d227fd03923] Fetching instance by UUID {{(pid=117874) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:28:19.568674 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-40432922-3cd5-441d-9aad-6e2c871e268b tempest-TestMinimumBasicScenario-1602759881 tempest-TestMinimumBasicScenario-1602759881-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:28:19.569202 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-40432922-3cd5-441d-9aad-6e2c871e268b tempest-TestMinimumBasicScenario-1602759881 tempest-TestMinimumBasicScenario-1602759881-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:28:19.570072 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-40432922-3cd5-441d-9aad-6e2c871e268b tempest-TestMinimumBasicScenario-1602759881 tempest-TestMinimumBasicScenario-1602759881-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:28:19.570582 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-40432922-3cd5-441d-9aad-6e2c871e268b tempest-TestMinimumBasicScenario-1602759881 tempest-TestMinimumBasicScenario-1602759881-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:28:19.653750 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.objects.instance [None req-40432922-3cd5-441d-9aad-6e2c871e268b tempest-TestMinimumBasicScenario-1602759881 tempest-TestMinimumBasicScenario-1602759881-project] Lazy-loading 'services' on Instance uuid 3a9c029c-4daa-4ae2-b624-6d227fd03923 {{(pid=117874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 22 10:28:19.726410 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [None req-40432922-3cd5-441d-9aad-6e2c871e268b tempest-TestMinimumBasicScenario-1602759881 tempest-TestMinimumBasicScenario-1602759881-project] 10.222.0.43 "DELETE /compute/v2.1/servers/3a9c029c-4daa-4ae2-b624-6d227fd03923/os-volume_attachments/c40d0a6f-d5f0-4df4-ba05-72ca161a71cc" status: 202 len: 0 microversion: 2.1 time: 0.168745 Jun 22 10:28:19.736434 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-c469ae8b-59a0-4e2c-86d9-cf236e017423 tempest-TestMinimumBasicScenario-1602759881 tempest-TestMinimumBasicScenario-1602759881-project] Calling method '>' {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:28:19.737459 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.compute.api [None req-c469ae8b-59a0-4e2c-86d9-cf236e017423 tempest-TestMinimumBasicScenario-1602759881 tempest-TestMinimumBasicScenario-1602759881-project] [instance: 3a9c029c-4daa-4ae2-b624-6d227fd03923] Fetching instance by UUID {{(pid=117873) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:28:19.740708 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 529/1050] 10.222.0.43 () {58 vars in 1415 bytes} [Wed Jun 22 10:28:19 2022] DELETE /compute/v2.1/servers/3a9c029c-4daa-4ae2-b624-6d227fd03923/os-volume_attachments/c40d0a6f-d5f0-4df4-ba05-72ca161a71cc => generated 0 bytes in 174 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 22 10:28:19.744787 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-c469ae8b-59a0-4e2c-86d9-cf236e017423 tempest-TestMinimumBasicScenario-1602759881 tempest-TestMinimumBasicScenario-1602759881-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:28:19.745420 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-c469ae8b-59a0-4e2c-86d9-cf236e017423 tempest-TestMinimumBasicScenario-1602759881 tempest-TestMinimumBasicScenario-1602759881-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:28:19.746374 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-c469ae8b-59a0-4e2c-86d9-cf236e017423 tempest-TestMinimumBasicScenario-1602759881 tempest-TestMinimumBasicScenario-1602759881-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:28:19.746971 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-c469ae8b-59a0-4e2c-86d9-cf236e017423 tempest-TestMinimumBasicScenario-1602759881 tempest-TestMinimumBasicScenario-1602759881-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:28:19.783619 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [None req-c469ae8b-59a0-4e2c-86d9-cf236e017423 tempest-TestMinimumBasicScenario-1602759881 tempest-TestMinimumBasicScenario-1602759881-project] 10.222.0.43 "GET /compute/v2.1/servers/3a9c029c-4daa-4ae2-b624-6d227fd03923/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051371 Jun 22 10:28:19.784231 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 522/1051] 10.222.0.43 () {58 vars in 1301 bytes} [Wed Jun 22 10:28:19 2022] GET /compute/v2.1/servers/3a9c029c-4daa-4ae2-b624-6d227fd03923/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 10:28:20.461072 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [req-5dd3ae63-9732-475a-9978-c57f7928abb3 req-eef73205-4d1d-42f4-80ac-e3b6e5eab441 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3a9c029c-4daa-4ae2-b624-6d227fd03923", "tag": "36a8b53c-154d-40ba-acfc-8a025c723d78"}]} {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:28:20.470893 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [req-5dd3ae63-9732-475a-9978-c57f7928abb3 req-eef73205-4d1d-42f4-80ac-e3b6e5eab441 service nova] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:28:20.471468 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [req-5dd3ae63-9732-475a-9978-c57f7928abb3 req-eef73205-4d1d-42f4-80ac-e3b6e5eab441 service nova] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:28:20.484324 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.compute.server_external_events [req-5dd3ae63-9732-475a-9978-c57f7928abb3 req-eef73205-4d1d-42f4-80ac-e3b6e5eab441 service nova] Creating event network-changed:36a8b53c-154d-40ba-acfc-8a025c723d78 for instance 3a9c029c-4daa-4ae2-b624-6d227fd03923 on hv-cinder-84713 Jun 22 10:28:20.488999 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [req-5dd3ae63-9732-475a-9978-c57f7928abb3 req-eef73205-4d1d-42f4-80ac-e3b6e5eab441 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031974 Jun 22 10:28:20.489862 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 530/1052] 10.222.0.43 () {64 vars in 1317 bytes} [Wed Jun 22 10:28:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 10:28:20.796323 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-8e2fbfd1-a5b7-4146-a227-e26067a2ebf9 tempest-TestMinimumBasicScenario-1602759881 tempest-TestMinimumBasicScenario-1602759881-project] Calling method '>' {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:28:20.797404 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.compute.api [None req-8e2fbfd1-a5b7-4146-a227-e26067a2ebf9 tempest-TestMinimumBasicScenario-1602759881 tempest-TestMinimumBasicScenario-1602759881-project] [instance: 3a9c029c-4daa-4ae2-b624-6d227fd03923] Fetching instance by UUID {{(pid=117873) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:28:20.804059 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-8e2fbfd1-a5b7-4146-a227-e26067a2ebf9 tempest-TestMinimumBasicScenario-1602759881 tempest-TestMinimumBasicScenario-1602759881-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:28:20.804505 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-8e2fbfd1-a5b7-4146-a227-e26067a2ebf9 tempest-TestMinimumBasicScenario-1602759881 tempest-TestMinimumBasicScenario-1602759881-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:28:20.805264 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-8e2fbfd1-a5b7-4146-a227-e26067a2ebf9 tempest-TestMinimumBasicScenario-1602759881 tempest-TestMinimumBasicScenario-1602759881-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:28:20.805712 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-8e2fbfd1-a5b7-4146-a227-e26067a2ebf9 tempest-TestMinimumBasicScenario-1602759881 tempest-TestMinimumBasicScenario-1602759881-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:28:20.834547 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [None req-8e2fbfd1-a5b7-4146-a227-e26067a2ebf9 tempest-TestMinimumBasicScenario-1602759881 tempest-TestMinimumBasicScenario-1602759881-project] 10.222.0.43 "GET /compute/v2.1/servers/3a9c029c-4daa-4ae2-b624-6d227fd03923/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042966 Jun 22 10:28:20.835108 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 523/1053] 10.222.0.43 () {58 vars in 1301 bytes} [Wed Jun 22 10:28:20 2022] GET /compute/v2.1/servers/3a9c029c-4daa-4ae2-b624-6d227fd03923/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 22 10:28:20.846022 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-b802f52d-268e-48c1-953a-89cde04d3d71 tempest-TestMinimumBasicScenario-1602759881 tempest-TestMinimumBasicScenario-1602759881-project] Calling method '>' {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:28:20.846607 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.compute.api [None req-b802f52d-268e-48c1-953a-89cde04d3d71 tempest-TestMinimumBasicScenario-1602759881 tempest-TestMinimumBasicScenario-1602759881-project] [instance: 3a9c029c-4daa-4ae2-b624-6d227fd03923] Fetching instance by UUID {{(pid=117874) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:28:20.853034 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-b802f52d-268e-48c1-953a-89cde04d3d71 tempest-TestMinimumBasicScenario-1602759881 tempest-TestMinimumBasicScenario-1602759881-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:28:20.853488 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-b802f52d-268e-48c1-953a-89cde04d3d71 tempest-TestMinimumBasicScenario-1602759881 tempest-TestMinimumBasicScenario-1602759881-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:28:20.854295 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-b802f52d-268e-48c1-953a-89cde04d3d71 tempest-TestMinimumBasicScenario-1602759881 tempest-TestMinimumBasicScenario-1602759881-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:28:20.855478 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-b802f52d-268e-48c1-953a-89cde04d3d71 tempest-TestMinimumBasicScenario-1602759881 tempest-TestMinimumBasicScenario-1602759881-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:28:20.934387 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.wsgi [None req-b802f52d-268e-48c1-953a-89cde04d3d71 tempest-TestMinimumBasicScenario-1602759881 tempest-TestMinimumBasicScenario-1602759881-project] HTTP exception thrown: Instance 3a9c029c-4daa-4ae2-b624-6d227fd03923 is not attached to volume c40d0a6f-d5f0-4df4-ba05-72ca161a71cc Jun 22 10:28:20.936776 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-b802f52d-268e-48c1-953a-89cde04d3d71 tempest-TestMinimumBasicScenario-1602759881 tempest-TestMinimumBasicScenario-1602759881-project] Request method failure captured: Jun 22 10:28:20.936776 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: request: DELETE /compute/v2.1/servers/3a9c029c-4daa-4ae2-b624-6d227fd03923/os-volume_attachments/c40d0a6f-d5f0-4df4-ba05-72ca161a71cc HTTP/1.1 Jun 22 10:28:20.936776 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: Accept: application/json Jun 22 10:28:20.936776 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: Accept-Encoding: identity Jun 22 10:28:20.936776 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: Connection: close Jun 22 10:28:20.936776 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: Content-Length: 0 Jun 22 10:28:20.936776 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: Content-Type: application/json Jun 22 10:28:20.936776 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: Host: 10.222.0.43 Jun 22 10:28:20.936776 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: Openstack-System-Scope: None Jun 22 10:28:20.936776 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: User-Agent: python-urllib3/1.26.9 Jun 22 10:28:20.936776 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-Auth-Token: gAAAAABisu5LMJp_-jrB4xPmUg3gPJrt82QdLpAhlL4uZOl7hU2n7pJWLiLFYETfmCKgAD5y_Q9rfByhzTNT7qvU9Wl6hYIPCfs5WfM-Q0nUF20gzovbkyUcfMusk0wIsG0RC16szpgvlYvu5zl7g8mm37PmQlbGuihtu87YihBGt7o2AZWBP84 Jun 22 10:28:20.936776 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-Domain-Id: None Jun 22 10:28:20.936776 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-Domain-Name: None Jun 22 10:28:20.936776 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-Identity-Status: Confirmed Jun 22 10:28:20.936776 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-Is-Admin-Project: True Jun 22 10:28:20.936776 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-Project-Domain-Id: default Jun 22 10:28:20.936776 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-Project-Domain-Name: Default Jun 22 10:28:20.936776 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-Project-Id: f4d8e96d47af4667a2f478e6561353d4 Jun 22 10:28:20.936776 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-Project-Name: tempest-TestMinimumBasicScenario-1602759881 Jun 22 10:28:20.936776 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-Role: reader,member Jun 22 10:28:20.936776 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-Roles: reader,member Jun 22 10:28:20.938231 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/f4d8e96d47af4667a2f478e6561353d4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/f4d8e96d47af4667a2f478e6561353d4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_f4d8e96d47af4667a2f478e6561353d4", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/f4d8e96d47af4667a2f478e6561353d4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}] Jun 22 10:28:20.938231 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-Tenant: tempest-TestMinimumBasicScenario-1602759881 Jun 22 10:28:20.938231 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-Tenant-Id: f4d8e96d47af4667a2f478e6561353d4 Jun 22 10:28:20.938231 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1602759881 Jun 22 10:28:20.938231 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-User: tempest-TestMinimumBasicScenario-1602759881-project Jun 22 10:28:20.938231 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-User-Domain-Id: default Jun 22 10:28:20.938231 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-User-Domain-Name: Default Jun 22 10:28:20.938231 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-User-Id: 21a35a18c4d74109ac1dacc120bbe0fc Jun 22 10:28:20.938231 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-User-Name: tempest-TestMinimumBasicScenario-1602759881-project Jun 22 10:28:20.938231 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: method: > Jun 22 10:28:20.938231 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: exception: Instance 3a9c029c-4daa-4ae2-b624-6d227fd03923 is not attached to volume c40d0a6f-d5f0-4df4-ba05-72ca161a71cc Jun 22 10:28:20.939056 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: action_args: {'server_id': '3a9c029c-4daa-4ae2-b624-6d227fd03923', 'id': 'c40d0a6f-d5f0-4df4-ba05-72ca161a71cc'} Jun 22 10:28:20.939056 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 10:28:20.939056 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:28:20.939056 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Jun 22 10:28:20.939056 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Jun 22 10:28:20.939056 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 22 10:28:20.939056 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 22 10:28:20.939056 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Jun 22 10:28:20.939056 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Jun 22 10:28:20.939056 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id c40d0a6f-d5f0-4df4-ba05-72ca161a71cc. Jun 22 10:28:20.939056 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi Jun 22 10:28:20.939056 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 10:28:20.939056 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi Jun 22 10:28:20.939056 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:28:20.939056 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 10:28:20.939056 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 10:28:20.939056 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 10:28:20.939056 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 10:28:20.939056 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 10:28:20.940476 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 10:28:20.940476 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Jun 22 10:28:20.940476 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jun 22 10:28:20.940476 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3a9c029c-4daa-4ae2-b624-6d227fd03923 is not attached to volume c40d0a6f-d5f0-4df4-ba05-72ca161a71cc Jun 22 10:28:20.940476 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi Jun 22 10:28:20.940476 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 10:28:20.940476 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi Jun 22 10:28:20.940476 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:28:20.940476 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 10:28:20.940476 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 10:28:20.940476 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 10:28:20.940476 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 10:28:20.940476 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3a9c029c-4daa-4ae2-b624-6d227fd03923 is not attached to volume c40d0a6f-d5f0-4df4-ba05-72ca161a71cc Jun 22 10:28:20.940476 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi Jun 22 10:28:20.940476 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-b802f52d-268e-48c1-953a-89cde04d3d71 tempest-TestMinimumBasicScenario-1602759881 tempest-TestMinimumBasicScenario-1602759881-project] Returning 404 to user: Instance 3a9c029c-4daa-4ae2-b624-6d227fd03923 is not attached to volume c40d0a6f-d5f0-4df4-ba05-72ca161a71cc {{(pid=117874) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 10:28:20.941491 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [None req-b802f52d-268e-48c1-953a-89cde04d3d71 tempest-TestMinimumBasicScenario-1602759881 tempest-TestMinimumBasicScenario-1602759881-project] 10.222.0.43 "DELETE /compute/v2.1/servers/3a9c029c-4daa-4ae2-b624-6d227fd03923/os-volume_attachments/c40d0a6f-d5f0-4df4-ba05-72ca161a71cc" status: 404 len: 154 microversion: 2.1 time: 0.097225 Jun 22 10:28:20.941491 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 531/1054] 10.222.0.43 () {58 vars in 1415 bytes} [Wed Jun 22 10:28:20 2022] DELETE /compute/v2.1/servers/3a9c029c-4daa-4ae2-b624-6d227fd03923/os-volume_attachments/c40d0a6f-d5f0-4df4-ba05-72ca161a71cc => generated 154 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 22 10:28:22.076307 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-42ca4fa2-4c81-4ffc-947c-6d6272ba6929 tempest-TestMinimumBasicScenario-1602759881 tempest-TestMinimumBasicScenario-1602759881-project] Calling method '>' {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:28:22.076811 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.compute.api [None req-42ca4fa2-4c81-4ffc-947c-6d6272ba6929 tempest-TestMinimumBasicScenario-1602759881 tempest-TestMinimumBasicScenario-1602759881-project] [instance: 3a9c029c-4daa-4ae2-b624-6d227fd03923] Fetching instance by UUID {{(pid=117873) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:28:22.083254 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-42ca4fa2-4c81-4ffc-947c-6d6272ba6929 tempest-TestMinimumBasicScenario-1602759881 tempest-TestMinimumBasicScenario-1602759881-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:28:22.083697 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-42ca4fa2-4c81-4ffc-947c-6d6272ba6929 tempest-TestMinimumBasicScenario-1602759881 tempest-TestMinimumBasicScenario-1602759881-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:28:22.084444 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-42ca4fa2-4c81-4ffc-947c-6d6272ba6929 tempest-TestMinimumBasicScenario-1602759881 tempest-TestMinimumBasicScenario-1602759881-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:28:22.084873 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-42ca4fa2-4c81-4ffc-947c-6d6272ba6929 tempest-TestMinimumBasicScenario-1602759881 tempest-TestMinimumBasicScenario-1602759881-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:28:22.113285 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.compute.api [None req-42ca4fa2-4c81-4ffc-947c-6d6272ba6929 tempest-TestMinimumBasicScenario-1602759881 tempest-TestMinimumBasicScenario-1602759881-project] [instance: 3a9c029c-4daa-4ae2-b624-6d227fd03923] Going to try to terminate instance {{(pid=117873) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 22 10:28:22.191779 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [None req-42ca4fa2-4c81-4ffc-947c-6d6272ba6929 tempest-TestMinimumBasicScenario-1602759881 tempest-TestMinimumBasicScenario-1602759881-project] 10.222.0.43 "DELETE /compute/v2.1/servers/3a9c029c-4daa-4ae2-b624-6d227fd03923" status: 204 len: 0 microversion: 2.1 time: 0.118887 Jun 22 10:28:22.192269 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 524/1055] 10.222.0.43 () {58 vars in 1238 bytes} [Wed Jun 22 10:28:22 2022] DELETE /compute/v2.1/servers/3a9c029c-4daa-4ae2-b624-6d227fd03923 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 22 10:28:22.201482 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-9844a058-bf64-4d72-8a4f-1d7cadab1de7 tempest-TestMinimumBasicScenario-1602759881 tempest-TestMinimumBasicScenario-1602759881-project] Calling method '>' {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:28:22.202788 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.compute.api [None req-9844a058-bf64-4d72-8a4f-1d7cadab1de7 tempest-TestMinimumBasicScenario-1602759881 tempest-TestMinimumBasicScenario-1602759881-project] [instance: 3a9c029c-4daa-4ae2-b624-6d227fd03923] Fetching instance by UUID {{(pid=117874) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:28:22.218155 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-9844a058-bf64-4d72-8a4f-1d7cadab1de7 tempest-TestMinimumBasicScenario-1602759881 tempest-TestMinimumBasicScenario-1602759881-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:28:22.218599 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-9844a058-bf64-4d72-8a4f-1d7cadab1de7 tempest-TestMinimumBasicScenario-1602759881 tempest-TestMinimumBasicScenario-1602759881-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:28:22.219360 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-9844a058-bf64-4d72-8a4f-1d7cadab1de7 tempest-TestMinimumBasicScenario-1602759881 tempest-TestMinimumBasicScenario-1602759881-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:28:22.219788 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-9844a058-bf64-4d72-8a4f-1d7cadab1de7 tempest-TestMinimumBasicScenario-1602759881 tempest-TestMinimumBasicScenario-1602759881-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:28:22.352117 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.policy [None req-9844a058-bf64-4d72-8a4f-1d7cadab1de7 tempest-TestMinimumBasicScenario-1602759881 tempest-TestMinimumBasicScenario-1602759881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21a35a18c4d74109ac1dacc120bbe0fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4d8e96d47af4667a2f478e6561353d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117874) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:28:22.359848 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [None req-9844a058-bf64-4d72-8a4f-1d7cadab1de7 tempest-TestMinimumBasicScenario-1602759881 tempest-TestMinimumBasicScenario-1602759881-project] 10.222.0.43 "GET /compute/v2.1/servers/3a9c029c-4daa-4ae2-b624-6d227fd03923" status: 200 len: 1556 microversion: 2.1 time: 0.162593 Jun 22 10:28:22.360400 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 532/1056] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:28:22 2022] GET /compute/v2.1/servers/3a9c029c-4daa-4ae2-b624-6d227fd03923 => generated 1556 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:28:23.377753 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-f7760347-c6e8-4ee0-8731-333c8bb86667 tempest-TestMinimumBasicScenario-1602759881 tempest-TestMinimumBasicScenario-1602759881-project] Calling method '>' {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:28:23.378389 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.compute.api [None req-f7760347-c6e8-4ee0-8731-333c8bb86667 tempest-TestMinimumBasicScenario-1602759881 tempest-TestMinimumBasicScenario-1602759881-project] [instance: 3a9c029c-4daa-4ae2-b624-6d227fd03923] Fetching instance by UUID {{(pid=117873) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:28:23.384758 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-f7760347-c6e8-4ee0-8731-333c8bb86667 tempest-TestMinimumBasicScenario-1602759881 tempest-TestMinimumBasicScenario-1602759881-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:28:23.385198 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-f7760347-c6e8-4ee0-8731-333c8bb86667 tempest-TestMinimumBasicScenario-1602759881 tempest-TestMinimumBasicScenario-1602759881-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:28:23.386081 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-f7760347-c6e8-4ee0-8731-333c8bb86667 tempest-TestMinimumBasicScenario-1602759881 tempest-TestMinimumBasicScenario-1602759881-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:28:23.386510 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-f7760347-c6e8-4ee0-8731-333c8bb86667 tempest-TestMinimumBasicScenario-1602759881 tempest-TestMinimumBasicScenario-1602759881-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:28:23.517578 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.policy [None req-f7760347-c6e8-4ee0-8731-333c8bb86667 tempest-TestMinimumBasicScenario-1602759881 tempest-TestMinimumBasicScenario-1602759881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21a35a18c4d74109ac1dacc120bbe0fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4d8e96d47af4667a2f478e6561353d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117873) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:28:23.525008 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [None req-f7760347-c6e8-4ee0-8731-333c8bb86667 tempest-TestMinimumBasicScenario-1602759881 tempest-TestMinimumBasicScenario-1602759881-project] 10.222.0.43 "GET /compute/v2.1/servers/3a9c029c-4daa-4ae2-b624-6d227fd03923" status: 200 len: 1556 microversion: 2.1 time: 0.151548 Jun 22 10:28:23.525573 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 525/1057] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:28:23 2022] GET /compute/v2.1/servers/3a9c029c-4daa-4ae2-b624-6d227fd03923 => generated 1556 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:28:24.296758 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [req-73677e48-f9d4-4cf8-9984-ef13978770bc req-966b6c36-b366-4879-bcbc-95c8795cc9e5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3a9c029c-4daa-4ae2-b624-6d227fd03923", "name": "network-vif-deleted", "tag": "36a8b53c-154d-40ba-acfc-8a025c723d78"}]} {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:28:24.309919 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [req-73677e48-f9d4-4cf8-9984-ef13978770bc req-966b6c36-b366-4879-bcbc-95c8795cc9e5 service nova] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:28:24.310445 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [req-73677e48-f9d4-4cf8-9984-ef13978770bc req-966b6c36-b366-4879-bcbc-95c8795cc9e5 service nova] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:28:24.322274 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.compute.server_external_events [req-73677e48-f9d4-4cf8-9984-ef13978770bc req-966b6c36-b366-4879-bcbc-95c8795cc9e5 service nova] Creating event network-vif-deleted:36a8b53c-154d-40ba-acfc-8a025c723d78 for instance 3a9c029c-4daa-4ae2-b624-6d227fd03923 on hv-cinder-84713 Jun 22 10:28:24.329106 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [req-73677e48-f9d4-4cf8-9984-ef13978770bc req-966b6c36-b366-4879-bcbc-95c8795cc9e5 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036177 Jun 22 10:28:24.329718 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 533/1058] 10.222.0.43 () {64 vars in 1317 bytes} [Wed Jun 22 10:28:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 10:28:24.542137 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-70d24656-04ae-4d18-add2-4e521a69ce80 tempest-TestMinimumBasicScenario-1602759881 tempest-TestMinimumBasicScenario-1602759881-project] Calling method '>' {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:28:24.542691 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.compute.api [None req-70d24656-04ae-4d18-add2-4e521a69ce80 tempest-TestMinimumBasicScenario-1602759881 tempest-TestMinimumBasicScenario-1602759881-project] [instance: 3a9c029c-4daa-4ae2-b624-6d227fd03923] Fetching instance by UUID {{(pid=117873) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:28:24.549109 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-70d24656-04ae-4d18-add2-4e521a69ce80 tempest-TestMinimumBasicScenario-1602759881 tempest-TestMinimumBasicScenario-1602759881-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:28:24.549557 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-70d24656-04ae-4d18-add2-4e521a69ce80 tempest-TestMinimumBasicScenario-1602759881 tempest-TestMinimumBasicScenario-1602759881-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:28:24.550345 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-70d24656-04ae-4d18-add2-4e521a69ce80 tempest-TestMinimumBasicScenario-1602759881 tempest-TestMinimumBasicScenario-1602759881-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:28:24.550783 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-70d24656-04ae-4d18-add2-4e521a69ce80 tempest-TestMinimumBasicScenario-1602759881 tempest-TestMinimumBasicScenario-1602759881-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:28:24.582774 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-70d24656-04ae-4d18-add2-4e521a69ce80 tempest-TestMinimumBasicScenario-1602759881 tempest-TestMinimumBasicScenario-1602759881-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:28:24.583229 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG oslo_concurrency.lockutils [None req-70d24656-04ae-4d18-add2-4e521a69ce80 tempest-TestMinimumBasicScenario-1602759881 tempest-TestMinimumBasicScenario-1602759881-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117873) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:28:24.583695 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.objects.instance [None req-70d24656-04ae-4d18-add2-4e521a69ce80 tempest-TestMinimumBasicScenario-1602759881 tempest-TestMinimumBasicScenario-1602759881-project] Lazy-loading 'fault' on Instance uuid 3a9c029c-4daa-4ae2-b624-6d227fd03923 {{(pid=117873) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 22 10:28:24.628181 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.policy [None req-70d24656-04ae-4d18-add2-4e521a69ce80 tempest-TestMinimumBasicScenario-1602759881 tempest-TestMinimumBasicScenario-1602759881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21a35a18c4d74109ac1dacc120bbe0fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4d8e96d47af4667a2f478e6561353d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117873) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:28:24.636305 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [None req-70d24656-04ae-4d18-add2-4e521a69ce80 tempest-TestMinimumBasicScenario-1602759881 tempest-TestMinimumBasicScenario-1602759881-project] 10.222.0.43 "GET /compute/v2.1/servers/3a9c029c-4daa-4ae2-b624-6d227fd03923" status: 200 len: 1349 microversion: 2.1 time: 0.097733 Jun 22 10:28:24.637310 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 526/1059] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:28:24 2022] GET /compute/v2.1/servers/3a9c029c-4daa-4ae2-b624-6d227fd03923 => generated 1349 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:28:25.655313 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-3a8b75f1-4d68-4764-ab58-99874232872e tempest-TestMinimumBasicScenario-1602759881 tempest-TestMinimumBasicScenario-1602759881-project] Calling method '>' {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:28:25.656011 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.compute.api [None req-3a8b75f1-4d68-4764-ab58-99874232872e tempest-TestMinimumBasicScenario-1602759881 tempest-TestMinimumBasicScenario-1602759881-project] [instance: 3a9c029c-4daa-4ae2-b624-6d227fd03923] Fetching instance by UUID {{(pid=117874) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:28:25.662793 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-3a8b75f1-4d68-4764-ab58-99874232872e tempest-TestMinimumBasicScenario-1602759881 tempest-TestMinimumBasicScenario-1602759881-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:28:25.663239 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-3a8b75f1-4d68-4764-ab58-99874232872e tempest-TestMinimumBasicScenario-1602759881 tempest-TestMinimumBasicScenario-1602759881-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:28:25.663995 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-3a8b75f1-4d68-4764-ab58-99874232872e tempest-TestMinimumBasicScenario-1602759881 tempest-TestMinimumBasicScenario-1602759881-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:28:25.664429 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG oslo_concurrency.lockutils [None req-3a8b75f1-4d68-4764-ab58-99874232872e tempest-TestMinimumBasicScenario-1602759881 tempest-TestMinimumBasicScenario-1602759881-project] Lock "3a2aa31d-c4ea-4d33-acd1-474d1dd4c687" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117874) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:28:25.678214 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.wsgi [None req-3a8b75f1-4d68-4764-ab58-99874232872e tempest-TestMinimumBasicScenario-1602759881 tempest-TestMinimumBasicScenario-1602759881-project] HTTP exception thrown: Instance 3a9c029c-4daa-4ae2-b624-6d227fd03923 could not be found. Jun 22 10:28:25.679865 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-3a8b75f1-4d68-4764-ab58-99874232872e tempest-TestMinimumBasicScenario-1602759881 tempest-TestMinimumBasicScenario-1602759881-project] Request method failure captured: Jun 22 10:28:25.679865 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: request: GET /compute/v2.1/servers/3a9c029c-4daa-4ae2-b624-6d227fd03923 HTTP/1.1 Jun 22 10:28:25.679865 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: Accept: application/json Jun 22 10:28:25.679865 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: Accept-Encoding: identity Jun 22 10:28:25.679865 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: Connection: close Jun 22 10:28:25.679865 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: Content-Length: 0 Jun 22 10:28:25.679865 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: Content-Type: application/json Jun 22 10:28:25.679865 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: Host: 10.222.0.43 Jun 22 10:28:25.679865 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: Openstack-System-Scope: None Jun 22 10:28:25.679865 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: User-Agent: python-urllib3/1.26.9 Jun 22 10:28:25.679865 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-Auth-Token: gAAAAABisu5LMJp_-jrB4xPmUg3gPJrt82QdLpAhlL4uZOl7hU2n7pJWLiLFYETfmCKgAD5y_Q9rfByhzTNT7qvU9Wl6hYIPCfs5WfM-Q0nUF20gzovbkyUcfMusk0wIsG0RC16szpgvlYvu5zl7g8mm37PmQlbGuihtu87YihBGt7o2AZWBP84 Jun 22 10:28:25.679865 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-Domain-Id: None Jun 22 10:28:25.679865 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-Domain-Name: None Jun 22 10:28:25.679865 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-Identity-Status: Confirmed Jun 22 10:28:25.679865 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-Is-Admin-Project: True Jun 22 10:28:25.679865 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-Project-Domain-Id: default Jun 22 10:28:25.679865 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-Project-Domain-Name: Default Jun 22 10:28:25.679865 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-Project-Id: f4d8e96d47af4667a2f478e6561353d4 Jun 22 10:28:25.679865 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-Project-Name: tempest-TestMinimumBasicScenario-1602759881 Jun 22 10:28:25.679865 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-Role: reader,member Jun 22 10:28:25.679865 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-Roles: reader,member Jun 22 10:28:25.681470 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/f4d8e96d47af4667a2f478e6561353d4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/f4d8e96d47af4667a2f478e6561353d4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_f4d8e96d47af4667a2f478e6561353d4", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/f4d8e96d47af4667a2f478e6561353d4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}] Jun 22 10:28:25.681470 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-Tenant: tempest-TestMinimumBasicScenario-1602759881 Jun 22 10:28:25.681470 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-Tenant-Id: f4d8e96d47af4667a2f478e6561353d4 Jun 22 10:28:25.681470 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1602759881 Jun 22 10:28:25.681470 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-User: tempest-TestMinimumBasicScenario-1602759881-project Jun 22 10:28:25.681470 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-User-Domain-Id: default Jun 22 10:28:25.681470 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-User-Domain-Name: Default Jun 22 10:28:25.681470 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-User-Id: 21a35a18c4d74109ac1dacc120bbe0fc Jun 22 10:28:25.681470 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: X-User-Name: tempest-TestMinimumBasicScenario-1602759881-project Jun 22 10:28:25.681470 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: method: > Jun 22 10:28:25.681470 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: exception: Instance 3a9c029c-4daa-4ae2-b624-6d227fd03923 could not be found. Jun 22 10:28:25.681470 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: action_args: {'id': '3a9c029c-4daa-4ae2-b624-6d227fd03923'} Jun 22 10:28:25.683104 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: {{(pid=117874) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 10:28:25.683104 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:28:25.683104 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 22 10:28:25.683104 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 22 10:28:25.683104 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 22 10:28:25.683104 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 22 10:28:25.683104 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 22 10:28:25.683104 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 22 10:28:25.683104 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 22 10:28:25.683104 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 22 10:28:25.683104 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3a9c029c-4daa-4ae2-b624-6d227fd03923 could not be found. Jun 22 10:28:25.683104 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi Jun 22 10:28:25.683104 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 10:28:25.683104 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi Jun 22 10:28:25.683104 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:28:25.683104 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 10:28:25.683104 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 10:28:25.683104 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 10:28:25.683104 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 10:28:25.683104 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 10:28:25.684675 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 10:28:25.684675 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 22 10:28:25.684675 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 22 10:28:25.684675 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 22 10:28:25.684675 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 22 10:28:25.684675 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 22 10:28:25.684675 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 22 10:28:25.684675 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3a9c029c-4daa-4ae2-b624-6d227fd03923 could not be found. Jun 22 10:28:25.684675 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi Jun 22 10:28:25.684675 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 10:28:25.684675 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi Jun 22 10:28:25.684675 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:28:25.684675 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 10:28:25.684675 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 10:28:25.684675 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 10:28:25.684675 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 10:28:25.684675 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3a9c029c-4daa-4ae2-b624-6d227fd03923 could not be found. Jun 22 10:28:25.684675 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: ERROR nova.api.openstack.wsgi Jun 22 10:28:25.686145 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: DEBUG nova.api.openstack.wsgi [None req-3a8b75f1-4d68-4764-ab58-99874232872e tempest-TestMinimumBasicScenario-1602759881 tempest-TestMinimumBasicScenario-1602759881-project] Returning 404 to user: Instance 3a9c029c-4daa-4ae2-b624-6d227fd03923 could not be found. {{(pid=117874) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 10:28:25.686145 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO nova.api.openstack.requestlog [None req-3a8b75f1-4d68-4764-ab58-99874232872e tempest-TestMinimumBasicScenario-1602759881 tempest-TestMinimumBasicScenario-1602759881-project] 10.222.0.43 "GET /compute/v2.1/servers/3a9c029c-4daa-4ae2-b624-6d227fd03923" status: 404 len: 111 microversion: 2.1 time: 0.030505 Jun 22 10:28:25.686145 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: [pid: 117874|app: 0|req: 534/1060] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 22 10:28:25 2022] GET /compute/v2.1/servers/3a9c029c-4daa-4ae2-b624-6d227fd03923 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 22 10:28:25.690314 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: DEBUG nova.api.openstack.wsgi [None req-96ec9065-3eb2-4642-823a-e4d56d875e02 tempest-TestMinimumBasicScenario-1602759881 tempest-TestMinimumBasicScenario-1602759881-project] Calling method '.version_select at 0x7f36c033bc10>' {{(pid=117873) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:28:25.709072 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO nova.api.openstack.requestlog [None req-96ec9065-3eb2-4642-823a-e4d56d875e02 tempest-TestMinimumBasicScenario-1602759881 tempest-TestMinimumBasicScenario-1602759881-project] 10.222.0.43 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1333361041" status: 202 len: 0 microversion: 2.1 time: 0.022448 Jun 22 10:28:25.709554 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: [pid: 117873|app: 0|req: 527/1061] 10.222.0.43 () {58 vars in 1271 bytes} [Wed Jun 22 10:28:25 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1333361041 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 22 10:29:09.602561 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 22 10:29:09.603144 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: Wed Jun 22 10:29:09 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 22 10:29:16.188495 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 22 10:29:16.189131 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: Wed Jun 22 10:29:16 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 22 10:29:28.698439 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 22 10:29:28.699056 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: Wed Jun 22 10:29:28 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 22 10:31:14.476706 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 22 10:31:14.477582 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: Wed Jun 22 10:31:14 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 22 10:31:18.985279 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 22 10:31:18.985857 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: Wed Jun 22 10:31:18 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 22 10:31:28.129222 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 22 10:31:28.129817 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: Wed Jun 22 10:31:28 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 22 10:32:29.611093 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 22 10:32:29.611730 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: Wed Jun 22 10:32:29 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 22 10:32:36.196833 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 22 10:32:36.197636 dv-cinder-847131-1-iscsi devstack@n-api.service[117873]: Wed Jun 22 10:32:36 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 22 10:32:48.707979 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 22 10:32:48.708592 dv-cinder-847131-1-iscsi devstack@n-api.service[117874]: Wed Jun 22 10:32:48 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!